Really? Who is your insurance carrier? I used to do that on the 40 until I asked them what it actually cost with a low mileage per year. It was silly not to keep it. I'm with USAA, so maybe your results will vary.
And on the original topic, I still have zero regrets going from 80 to 100 for what we do. I did some mild wheeling in the limo and it was sweet. Plenty of power to tow the camping trailer, trail capability, and good mileage & ride to boot. Sure, there are "better" wheelers, but for most of what I do this is enough, and the street use is SO much sweeter. If I want to crawl a twisty, I still have the 40.
1978 13BT-40, 70 series mechanicals
1966 FJ45 lwb stock
2003 100 stock
1974V8J40, 1992FJ80, 1985FJ60, 1971FJ55, 1978FJ40, 1974FJ40, 1997 LX450 all long gone.