Many materials that appear opaque to the human transmit IR. I use aluminum foil as the blocking agent. Then I use tape to hold the foil, and perhaps to hide the foil from view.

In a rack environment, it may be possible that enough IR leaks out of one unit to control another. You may need more than a dot of foil to control this.