Well, you've left out one type of racing that is one of the least expensive and safest ways to participate: autocross.
Aside from having an appropriate vehicle that's properly maintained, you only need a helmet, which most organizations have on hand as rentals. Past that, high-performance (or...