Check the Connections tab in the Internet Options dialog (click Tools > Options in Internet Explorer).
Set the radio buttons to "Never dial a connection". The disadvantage of this setting is that you have to connect to the internet manually when you want to view websites on your computer.