I have done both, and settles on a combination.

My partner liked to use wall mounted relay racks or swing gate racks for the Data.... but we didn't want to put any lof the RF or standard phone terminations in there for the servicing issues Jayson listed above.

Now we also put in whole house speaker terminations on Neutrik speakons to fill in the rack (and justify the cost of the rack).

We also used OnQ's custom panels (with the bi-directional mount pattern) and their phone punchdowns, RF bulkheads and amplifiers.