Some instances opt out of Lemvotes getting anything, and, afaik, it returns a generic 404 error instead of actually telling you the source instance you put into the bar has opted out.
However, it could also run into issues if there is any kind of middleman bot checking like Cloudflare or Anubis on the host instance.