One also gives up a true off-road capability when switching to 20s and larger. The owner's manual states this. The sidewall of a tire is what absorbs the bumps in the road, along with the suspension of course. But the tire is the first point of contact and also the taller the sidewall, the more air, the more air, the higher the weight rating, generally speaking.
As for me and my house, I'm sticking with the 17s and AT LT tires until they wear out.
Your other consideration is whether or not you want a P-Metric tire or an LT tire. Better ride with the P-Metric but more durability with the LTs.