Absolutely, it just depends on your operating system (i.e. Windows XP/7/whatever, Mac, Linux).
However, it might be easier to do it from your router. If you know how to get into your config, you should see settings that will limit access and block websites.