Do you have the insulated fiberglass insert that goes under the latch wich provide storage?
If not, that's your problem. I find the twin engine in my speedster quiet actually. Compared to my old Sportjet unit it is much MUCH more quiet.
You might want to put soundproofing under your latch. Most of my sound comes from the engines, not the exausth system.