Sounds like you need to take the unit apart and with a pencil eraser clean the contacts on the board and then also clean the contacts under these buttons.
I don't suspect dirt/grime but rather cracked rubber under the plastic buttons. If that is the case, buy a used pronto off ebay and then replace the entire button set.
Note that you must buy a remote with the same type of scroll wheel - plastic or metal.