The people who remained there after the Romans destroyed the place just converted to Islam. Most current Jews are other ethnicities that converted to judaism afterwards.

That's a misconception. Judaism, especially Rabbinical Judaism which predominated after the Jewish-Roman Wars, generally doesn't fare too well with converts. There has been a lot of intermarriage with other ethnicities over the years, but modern Jews are definitely descendants of Israelites, by and large