I have something very similar in one of my garden beds, but I can't remember what it is! I actually have a similar picture in my plantnet gallery from April 11th last year, so I am quite sure it is a perennial, as I also have it in my garden bed this spring, so if I were you I wouldn't dig it up yet.
Edit:
Is there a chance that it could be a Lily?
