How to connect 2 routers?

I am new to networking. I have a LINKSYS router w/4 port 10/100 hub. (BEFSR41) I installed it myself and it works great. I have 2 pc's side by side connected to it and one in the cellar. Recently I purchased laptop and was given a D-LINK wireless router w/4 port 10/100 hub. (DI 614+) What I want to do is place this router in the cellar so I can use the ports on it. My question is how do I connect these routers together?
The LINKSYS has 6 ports on it, uplink, wan, 1-4. I am using 2,3,4 for the existing computers, The wan port is connected to my cable modem. port 2 runs to the cellar, Everything is cat5. The new D-LINK router has 5 ports on it, wan, 1-4. I will use the existing cat five cable to the cellar to connect the two routers but I don't want to plug it in and blow something. So, what do I do?

 

Ron - just to make sure we are in agreement on the terms here - you have a pair of devices that are both a router and a switch.

Routers are needed to allow different networks to communicate but are not needed and do not work on a single network. When I speak of "network" I'm talking about the TCP/IP settings rather than the physical wires. For instance, using a subnet mask of 255.255.255.0, all of the IP address except the last 3 numbers describe the network so that 192.168.0.xxx and 192.168.1.xxx are different networks.

You will be connecting the switch portion of the wireless device and DO NOT want to be using any of it's routing features unless you have your network more complicated than it needs to be.

If you can run a cable, you will need crossover (either by cable or by using a port in the switch that does it automatically) connection between the two switches. So one port on each device used for connecting the two switches. The other ports can be used for PCs and they will talk fine.

Rule of thumb - similar devices (switch to switch, switch to hub, PC to PC) require a crossover connection. dis-simlar devices (PC to switch) require normal (non-crossed) connection.

If you plan on a wireless connection between the two switches, you'll need an additional piece of hardware - a "wireless access point" that plugs into a port on the wired switch and takes a signal from the wireless switch.

 

Yes I have two devices that are both a router and a switch. I also have a couple of devices that are just switches and not routers.
I think I get it. Let me try to explain what I think I know. A normal PC to switch connection is considered a straight through cable. A connection from one switch to another switch would require a crossover cable. I only need one router to connect to the internet via the cable modem as it exists now, and 2 switches connected together with a crossover cable. Just because the router and switch are in one unit does not matter. So what I should do in just put a switch in the cellar, connect it with the crossover and I am good to go. Now on the switch that I have that is not a router there are 5 ports, Uplink, 1-4. Do I use the uplink or one of the numbered ports to connect them together?
OH! By the way thanks for the help.