Press ALT when in Windows Explorer is open to expose the Tools menu.

It can be hidden in Windows Server 2008 R2, not allowing one to go to Tools > Folder Options to unhide file extensions and hidden files as suggested here.