Plugged/restricted heater core and/or incorrect/bad engine coolant thermostat would be my suggestion to check. These things warm up faster with above-idle rpms.
Disclaimer: Links on this page pointing to Amazon, eBay and other sites may include affiliate code. If you click them and make a purchase, we may earn a small commission.