The simplest way to do this is by setting the Access Permisson in Site Administration to PUBLIC. This would enable all content to be publicly accessible to visitors, except content set to PRIVATE or LOGGED IN USERS by members. You will also need a site menu plugin to set the menu for public access. You can find this plugin by going to Elgg Plugins.