I would charge him. You were called at home, late at night and were inconvenienced to say the least. If you called a locksmith in a like situation you would be hosed let alone charged. I'm not suggesting you drastically elevate your bill but I couldn't imagine he would expect not to pay considering the situation.