Press and hold the ModMic Wireless button for 2 seconds, then release. The lights should go out on the device.

The ModMic Wireless should turn off on its own if the receiver is not powered (e.g. you turn off your PC) after several minutes.