If they come to France still check that the US SIM would work there, or that eSIM is supported. Theoretically it's compatible but US carriers can be ... finicky.
For banking if depositing check can be done simply via the Web, then the app is not needed. Might have to ask your bank. Keeping the old phone would work indeed but not the most convenient.