From what I read on the internet, it's very random. Some banks (percentage unknown) only allow access through applications (e.g. with a Google security thing NOT available on custom ROMs), or IRL but it's inconvenient. It depends on the bank and the country.
I happen to have accounts with 2 French banks that allow GrapheneOS without issue, and still have usable web sites. One bank is a brick-and-mortar "credit union" as Americans call it, the other bank is an online bank with only phone call support.
I don't use my phone to pay though because it would require me to use Google Wallet, but I can still use Wero (the new European thingy), or my debit card most of the time.
But if you get another French bank, or you are in another country, you may be less lucky than me.