Yeah, it has that sound like a vintage VW beetle.. Like normal exhaust sound mixed in with the Jetson's car.
It would bug me, but then again I ride mostly at night, so an unbaffled version of this muffler would bug everyone -else-.
I used to have this 'prank' exhaust whistle which was basically a metal washer with a couple of tabs.
It made a car exhaust whistle just like that. So I bet if you pulled out the baffle, it has some holes that the exhaust gas are forced to pass through. Maybe changing the shape or drilling it out a bit would solve the secondary whistling noise.