Enabling HTTPS logins doesn't work for non standard port

If you enable HTTPS logins from the installer, you can never login if you have a non standard SSL port. There's no way to specify the port from the installer. If you prepend https:// to the site url in the installer, the site becomes httpss://