Yes, there's an “enable JXL (JPEG XL) support” toggle in the settings (tabs and browsing → media on librewolf (which is what I use too), or in ‘firefox labs’ on normal firefox).