I’ve found it’s really a spend what you want hobby. I’ve got a turntable and powered speakers and it sounds great. You can build a setup with more features or more vintage equipment but that’s not actually necessary to enjoy it. And certainly not as a barrier to entry.
I go the "budget" audiophile route and opt for a $600 pair of Grado headphones and a nice external DAC/Amp.