You can load an empty 'template' list with all your colors after CSV import and then use the 'Copy From...' button.
I think you better think again ;-).
It DOES help you. Using a 'template' to hold your list color settings will allow you to import your CSV, apply color settings from your template, etc...