HR is quite individual, so you can’t say for sure either way from what you wrote. I think you should listen to your body, and if things feel off, find an expert and take their advice seriously. But otherwise, go nuts.
I started racing bikes in my 40s, and during peak efforts (VO2Max efforts to failure mostly), I would hit what I would consider my max heart rate at 170-something. I did this for many many years (10+).
I do have heart issues, but I think that’s from the more sustained endurance efforts that you get from training for bike racing at a very high level. High calcium scoring is a thing among endurance athletes like that.