Did you disable some language packs in the settings?
The problem is that Firefox comes with all langpacks enabled by default, and thus it loads every translation on launch and unloads everything on close, and that can cause slight delay due to large amount of data in these packs. Try disabling everything except your locale, this can help.