READ FIRST
To begin with, most people decide to spend very little because they wish to "see if they like it" so opt for below entry level equipment. Or on the spur of the moment buy a pretty suitcase player or have been gifted one.
Another reason could be you have heard that records sound better than digital. While this is a hotly debated topic, records can only sound better than digital IF you spend a lot to get great equipment. Digital can provide nice sound at very affordable cost and is more convenient.
ALL suitcase & all-in-one players should be avoided because they have a cheap mechanism which is prone to skipping, inconsistent speed and often breakdown. Image below depicts the tell tale look of this bad mechanism.
However if you must buy an all-in-one player the 1 By One H009 All-In-One Turntable is acceptable. This is NOT A RECOMMENDATION, merely pointing out this is the least worst one. It will work OK and does have a proper tone arm with adjustments.
Plus this model has Line/Phono output so you can upgrade to external powered speakers or a main amplifier with passive speakers which will make a big improvement over the built-in speakers.