I'm sure I also oscillate between dy-- and j-- depending on context and audience. I suspect "due" is most likely to go to the initial j, "duel" least. Also, the surrounding sounds probably affect things - I think I'm more likely to say "sanjoon" for "sand dune" than "joon" for "dune", for instance.