Depends on what kind a person you are...
I started out with a HF lathe (stamped out tin foil model) and used it for a few pieces. It was a pain to work with, but it got me started. I had that for several years before I really learned anything though. Oh I turned the odd thing now and then, but I didn't even know the difference between scraping and cutting.
Then a couple of my co-workers dragged me off to a club meeting. The club was just getting started, but I volunteered to do the newsletter. Before I knew it I was hooked. Had to sell the HF to afford the Jet Mini and some HSS tools, and I decimated my small savings account to get the Nova Midi chuck (on sale no less!). (JOIN A CLUB!)
I don't have money, but I've got some time and a little mechanical knowhow. And I probably won't be able to afford a big lathe for quite some time...
But right now, I just LOVE my Jet mini. I'm looking forward to carrying it to club outings at craft fairs or all day demos. You can do quite a few things on it. All of our club demos for the last year and a half have been done on a mini.
We've seen eggs and bottle stoppers, we've seen Tagua nuts turned, we've seen bowls, platters, and hollow forms turned. I've seen turned boxes and even a cowboy hat turned. And yes, some of these things have maxed out the lathe. But they've all been done on our mini's....
My thinking is that I can sell a few things along the way and pay for this hobby. And as the lathe pays for itself I can save up for a bigger one. But it's going to take a long time at this rate. I haven't sold the first thing. 🙄 Wanna buy some turnings? 😀
If you love to tinker, then the internet is just rife with things you can fabricate for your lathe, without breaking the bank. I've seen collet chucks, longworth chucks, sanding drum and fluting attachments, indexing wheels, steady rests and grinding jigs. And all of this is stuff you can make yourself. So if you like the process of setting up, you can tinker for a long time without "moving up" or "keeping up with the Joneses". And then the mini will always be there when you do move up to a bigger lathe.
I think the direction you go, and will be satisfied with, ultimately is up to you. Since I'm a perfectionist tinkerer type, I'll be happy with my small setup for quite some time, both because I like making jigs and small stuff (Big stuff scares me!) and because I don't have a bunch of money. ($300 is a lot of money for me!)
The thing that is really addictive about this craft/art is that is the closest thing to instant gratification there is in the woodworking hobby. I think that's the heart of the Vortex!
Well that's my thinking anyway. Feel free to do whatever floats your boat.