light: don't try to set brightness dp when switching to colour
Condition for setting brightness dp included checking self.raw_color_mode,
but if we were switching to ColorMode it would still apply brightness to
the dp. In color mode, normally the rgbhsv includes brightness, so this
leads to double brightness, or unexpected mode switching.
Review triggered by discussion #1595