On my Xbox 360 I use a nice set of over ear gaming headphones. They can connect via 2.5 headphone jack and RCA Left and Right straight out of the Xbox. With Xbox One you can use HDMI and/or Toslink spdif digital. Now, BF4 is not very conducive to a sleeping toddler FYI, so I had to turn my volume way down or off. Neither of which is good for hearing gunfire or a tank about to run you over.
I found a nice solution on newegg. Its a $15 digital to RCA adapter. Very small, quiet, and uses hardly any power. One issue is that you do not have any control over volume with this setup. In my case the headphones have a volume control, but as far as just getting the sound to RCA it works great.
Now Microsoft just needs to get the third party audio working so I can use my headphones mic.