I completely understand the hesitation.

There are several useful questions to explore, IMO.

1. Can you reduce your wage-earning work gradually over several years? This could let your investments continue to grow as your part-time income covers expenses (until it doesn't).

2. Depending on whether you want to leave a bequest, does moving some of your funds into less risky income-producing assets make sense? This could be low-cost fixed annuities, high-yield savings accounts, TIPS, etc.

3. Can you start (or scale up) fun projects that could replace a portion of your income, letting you scale down your job more rapidly (or even immediately)?

4. What portion of your retirement budget would be discretionary? If 50% is discretionary, you could drastically cut spending when the market is down, and splurge more when it's up.

5. Do you have a significant other whose income would continue for a few years after you retire, reducing the risk of your investments tanking and you having to sell shares at low prices?