I can empathize.
Had a friend back in school that stuttered. It was stressful as hell just watching him deal with it, so I can imagine how much stress it would feel like, even if he hadn't expressed much the same things you have.
He ended up finding some stress relief via singing, and only hanging around people that didn't put pressure on him.
Cool dude; haven't seen him in years though. He left the state for college (wrestling scholarship), and doesn't come back except to visit family, so we rarely have time to catch up.
He ended up doing technical writing, like for instructions and textbooks and the like. Freelance now, or was.