You need another gig. If you boss gets paid for your time there in a situation like this, so should you. If not, he should re-book you for when they are done or come down and wait himself from 5:00.