newbie to networking

i have a
win98se computer ,winxp computer,a 4 port router( linksys)
no software w/router.
2 dsl modems,and various ethernet cables (thru & cross-over)with swbell ISP
HOW do i set these two computer's up to use internet at same time
please be gentle!
thanks

 

Go here. Read.

The answer to your question is a book.

Ask specific questions.

Do you already have DSL service? Are you sure you can get it?

What are the installation options available from your provider?

The filters from your DSL provider go on your telephones. Most DSL providers, today, are providing the DSL modem. ...but you have two of your own? One of the DSL modems that you have/will have plugs directly into the phone line.

Are your DSL modems USB or do they have 10 MHz RJ-45 ethernet connectors?

If USB you will be constrained to using a proxy.

Are they DOCSIS compliant modems?

Get specific with equipment names and models.

You don't need software for your router.

Read the documentation for your DSL modem. Read the documentation for your router.

Do you have NICs in your computers?

After you find out you can get DSL service, set up your LAN so that your two computers can talk. Whatever it is that you don't know about making your two computers talk on a local area network, ask.