Nope.
If I don't go to a doctor, any and all contributions made to HSA, 100% IS mine.
In other words, if I was stupid enough, I could put $0.00 into my HSA, and as long as I and my family didn't see any doctors that year it would be literally free.

I realize that this is on corporate plans where the employer pays into the program and as such may not be available to small, one man shops.
In my experience, the switch from whatever premium you'll pay into PPO are lateral into HDHP, with additional bonuses of USA options.
The reason insurance companies do it, and it was mentioned by someone else above, it's to empower people to make smarter (less expensive) decisions about not rushing to ER with a headache or a cough.