I don't seem to suffer from slowness with my FF setup. My home connection is 400Mbit/50Mbit unlimited. I surf heavily/code/SlingTV all the time. I also keep a similarly locked-down instance of Vivaldi on hand for email and banking only. Everything else goes through FF or OpenSSH.
So do I and it is slow and frustrating too.