Sure.
4K box output to the amp input using the coax (single RCA cable correct?)
Select the Coax input on your amp, and output to the headphone jack, which is connected to your wireless headphone base. Also check if it has a Record-Out on your amp, you could connect your headphones to that as well. The record-out will be better if you control the volume using the headphones.