No, you need to worry about the A/V equipment causeing noise which interferes with the X10 equipment. That can be solved with a few plug-in filters.

The only interference that you 'might' get in the other direction is on AM radios but then that's only when the radio is very close to the X10 transmitter and it only lasts for the duration of each X10 signal (about 3/4 sec)