I hear good things about a "heat pump".
My sister in law is in the heating/cooling biz and she had one installed in her own home.
I just moved and my new place has a heat pump for moderate weather and an oil fired traditional furnace for when it gets cold.
I can't comment on how that works since we've only been there for about 36 hours.
So far so good, though
K