WinXp address toolbar in taskbar problem and/or Iexplore problem

In the WinXP when I try to access the Internet by typing in a URL into the the address toolbar in the taskbar I get an error message to try using the search feature through the start menu. I'm guessing the problem isn't really with the toolbar but with iexplore becaue if i already have an Internet window open then accessing a URL from the taskbar address toolbar will work. any ideas on what to do? thank you...

 

thanks...will try solutions and post on my success. thanks again.

 

so far neither solution has worked...have uninstalled and reinstalled IExplorer. that didn't work either. may just cut my losses and reinstall xp...thanks!