Connecting a USB headset with microphone

Featuring a USB headset with microphone and a sound output jack adapter for a mobile phone, I wanted to connect the headphones to the USB jack to listen to music from my phone through the adapter. The problem is that this adapter comes on the mic jack, which means that I can not hear anything in the headset when I start the music on the phone. Gently unplugging the adapter, I hear the music, but quietly. I think we can cobble something behind to remove the microphone and listen to the music. The sound is not strong when I unplug slightly because I think that contact is not made well into the jack because it is slightly disconnected.