Site language when logged out

I'm slowly working through translating the 4.0 resources on Transifex to Scottish Gaelic and manually uploading the language files to my site. I've set the default language of my site and when I am signed in the site is displayed in Scottish Gaelic, but when I am logged out the site display in English. Is there a way I can set the default language to Gaelic when logged out?