It could be the rotary wheel - mine is indeed a little sticky.
I only use it in a single activity, but apparently rotating it wakes up the device even when the it is not configured.
Maybe it is time to disassemble and clean the remote.

I havent spilled anything on it and I replaced the batteries last year, so they should be good.

Sebastian