Get to the Internet Options dialog box (shown below) either by the Start
Menu/Control Panel
or from within Internet Explorer
Click the "Clear History"
button shown here.
You will get a pop-up box like this
Click OK.....
Then OK again on the Main Internet Options Page and you are done