I tried it and moved the directory. Results:

• Firefox opens, settings from the profile are still there.
• Empty ./mozilla/extensions directories are recreated on startup.
• Firefox cannot show any websites anymore.

Yikes.