So, are you asking for help on how to rip CDs, to get the mp3 files on your PC? Do you want to be able to play them from the PC?
That can be done quite easily. There are software available to do rip mp3 from a CD for your PC. These are called CD Rippers.
I suggest :
FairStars CD Ripper : http://www.fairstars.com/cdripper/index.htm
Koyote CD Ripper : http://www.koyotesoft.com/indexEn.html
They are easy to use, and self-explanatory. But, if you need help, please post here, and we will provide you with the steps.
Yes, there are inexpensive mp3 players available. You can use them. You can put these mp3 in those players, and then listen to them.
There is however one thing to be careful of. You should be careful, if its allowed to rip the particular CD or not. If you own CDs, then its perfectly legal to rip them, and keep them as backup. But, if these are owned by others, then you should be careful of the legal implications.