You may want to consider getting an RCA (analog, line, A/V, whatever you call 'em) splitter that has 2 male to 1 female connections. Then you could plug this into the L & R audio outputs and plug the audio cable into this. Although you still will not get stereo sound from your TV, you will be hearing what is coming from both audio channels, so that you are always hearing all of the sounds. Therefore, you won't get a problem like ths again, as both sound channels would be connected.
[Link: radioshack.com]