Sorry to disagree, but I have personally done that change albeit on a much heavier chassis. Ford Motorhome actually. So many RV owners do it there’s even an acronym. CHF or the ”Cheap Handling Fix”. I will certainly agree there’s a wee difference between the vehicles.
In that case it was noticeable to my passengers as well.
On the other hand, some claim handling benefits using poly bushings rather than rubber; seems like a minor difference in dimensional compression to me, but I have no experience.
I suppose it all depends on how sensitive an individual driver is to vehicle dynamics.