How would I go about doing this?
 

Ok, so I've got 3 pcs at home, 2 running windows xp, and the third running linux (redhat I believe, but it's been awhile so i'd have to double check)

I want to set up my network like this, how hard would it be to do, and what do I need to do?

http://img166.imageshack.us/img166/5422/28953242pg8.png

Thanks!

I'm looking to eventually be able to connect to it through the net... pic of that coming soon :)

Additional Spam:
This is what I'm ultimatly looking at doing.

http://img146.imageshack.us/img146/1150/10650095nh2.png

I want to be able to connect to my home network through the internet, but have it behave as if I had connected to it at home (after I log in and stuff). What's the best way to go about doing that, and where should I start?

Huh? I doubt you have your router connected to your linux server, which in turn is connected to the internet? Isn't it exactly the other way around?
Usually the router is connected to the modem, which provides access to the net.

What you want is OpenVPN.

Some questions: How does your cabling look? Is this router device a router-only one or does it also provide switching functionality?

It's not pugged into anything at the moment, but it has 2 nic cards in it, and will be plugged into the wall (fibre opic connection) and then into the router to the other PCs... That is hopefully going to work... hopefully.

Why? Too much complexity. Multiple routers chained is a pain. DHCP conflicts and all. Plug the Router into the Internet and the Server into the Router.

Ah... ok - sorry, I was told that the best way to set up my home network as a VPN would be to have the server connect to the internet, then connect the router to the server, and the other pcs/laptops to the router. That's what I was told would be the easiest way to do it, since my router (Linksys WRT52GS) only has VPN passthrough? I don't know though, i'm new to this whole VPN thing, just thought that I would try it out because it sounded like a neat idea :P

You might wanna start reading their DOCS:
Welcome to OpenVPN

VPN setup is not trivial when you wanna do it right. It's however easy to use after you have set it up.

Putting the server on the edge of the network like that will give you the option of using powerful traffic shaping tools the manage the flow of packets in and out of your LAN. If that isn't something that interests you, than I wouldn't bother trying that setup; just let the router appliance act as the gateway. You can still setup the server to act as a VPN endpoint with the proper settings on the router.