A safety razor is much cheaper to use and it isn't that difficult to use. I suppose most guys (and girls) my age learned to shave with one.
To be safe, start out with a Gillette Tech, which is a three piece razor as opposed to a twist to open (TTO). You can get a Tech off e-bay for around $10. or you may find one for sale on this board. You can get a new Tech style razor made by Lord (Lord Tech) new for about $8. The Techs are pretty mild razors and you can learn to shave with a saftey razor, commonly referred to as a "DE" for double edged, without too much worry about cutting yourself. I prefer the three piece razors to the TTO's but you will figure out what you want to use after you have tried a few different types. The choices are many and everyone has a favorite but you don't have to spend a lot of money getting into this so if you don't like it you can just ditch it.
You can get an inexpensive soap and brush at Wallgreens for just a few bucks. The brand is "Van der Hagen" commonly referred to as VDH. You will find soap and brush way better than the canned stuff from the drug store that you're probably using plus it is entertaining to learn.
I still use Williams soap most of the time but I don't recommend it as a first soap - you may never want to bother with it actually but chances are you will eventually take on the challenge. I think it is the most contested soap on B & B so if you don't try it you will never get to take a side.
Then there are a great number of brands of blades to try; that seems to be a hobby in itself. Just get a sampler pack to start with and read the reviews.
Other members will provide more advice and this is the place to come for good advice and laughs. I've found the members here to be a great bunch and I've learned quite a lot from them.
Also, there are often newbie starter kits offered for sale on the board and that may be your best and most efficient introduction to the hobby. I had never thought of shaving as a hobby but it seems to be turning into one.
Enjoy!
And you have to admit, you love every minute of that hobby don't you??