MK9750, you're not alone. I'm currently loading up a second jacket with patches.
I loved checking out the red patch jackets of adults when I was a kid, and I think it's a great advertisement for the program. You constantly get kids and others wanting to look it over and talk about the many outings symbolized by the patches.
It's interesting that patches are such a big part of the scouting program, but they make it so hard to wear them. What good do they do sitting at home in a box or hanging on a fake skin? I can't see myself walking about with a patch blanket drapped around me, and I don't think the patch vest is an acceptable option for most adults. Also interesting that kids are encouraged to load the vest, which closely resembles the jacket, with as many patches as possible.
I've also heard people suggest using an "unofficial" jacket for patch display. I love the jac shirt, but I've been unable to find something like it in an alternate color on Woolrich or similar websites. Perhaps one day BSA supply will see this as the big revenue source it could be and offer an official "load it til you collapse from the weight of all the activity patches" jac shirt for scouters like us.