How to fix strange ceiling fan setup?

I have a strange ceiling fan setup. The ceiling fan in one of my rooms is setup on a single switch but if you flip the switch once the fan comes on, twice the light comes on, three times both come on. I really don't like this design but not sure how to resolve it. It's not the switch, I've tried replacing it and it's the same. Any ideas what to try before just replacing the fan?