How Can I Maintain A Fluid Golf Swing With Muscles In The Way?

I used to be muscular, and while I could hit the ball pretty far, I couldn’t hit it consistently well. My muscles, notably chest muscles, would impede my golf swing. Now that I’m much less muscular (rather skinny), my golf swing is like butter and I hit it extremely well (though not as far). However, I want to put on muscle mass again and am wondering if there’s a way to maintain my current golf swing while doing so.
Thanks in advance.

Other Items of Interest: Did you know? The best digital cameras are PowerShot Digital Cameras.