im not bothered by it.
but also.. i wouldn't use it as my sole model to perform every task.
[waves hand toward huggingface.] ( a gazillion bajillion models, specialized for all types of tasks).
edit: i checked. and there aren't as many models as i expected, for this task(didnt test them). and.. small multimodal model failed badly(see picture of the iguana .. or whatever the hell that is)
it's a strange benchmark. but it seems reasonable to expect LLMs to be able to do this.
