Is there a speaker level switcher that can be used, where you'd then use the speaker level inputs of the subwoofer? That would sure simplify your switching needs.
I think that most of us, purists that we are, don't ever want to use speaker level inputs. Let me just say I could argue that it won't hurt unless your main power amp is total crap. Give it a try and see if you can tell any difference.
A good answer is easier with a clear question giving the make and model of everything. "The biggest problem in communication is the illusion that it has taken place." -- G. “Bernie” Shaw