i would assume with the IM volume control you are driving the amp much harder than you tink. Connect the speaers without the VC. I believe the Yahamas will attenuate the volume. Should make your speakers sound MUCH better. I would however NEVER connect in this fashion. ALWAYS use a separate amp.
Diplomacy is the art of saying hire a pro without actually saying hire a pro