A workaround would be to mute the device itself, and then use the remote (which has its own mic, and works well in noisy environments since you just hold it closer to your mouth).