He didn't say "segregate your issues." In fact, you put it in quotes as though that is exactly what he said. Which he didn't.
He said "sometimes segregation is good." That which he ACTUALLY said is much more likely to be misinterpreted than the harmless construction you supplied to try to prove a point.
"Ownership" has never been mostly used to refer to slaves or blacks. "Segregation" has.
A good answer is easier with a clear question giving the make and model of everything. "The biggest problem in communication is the illusion that it has taken place." -- G. “Bernie” Shaw