Is their any reason you can't just paint the grille? I have found that if you spray paint the grilles, the holes don't generally fill in, and then the colour match is exact.

If you need to use fabric, look for one that is somewhat loosely woven, allowing the most sound to come through. Many Custom Car audio shops will have special speaker grille cloth in a rainbow of colours.

Derek