compiled a list of 2500+ vision benchmarks for VLMs
I love reading benchmark / eval papers. It's one of the best way to stay up-to-date with progress in Vision Language Models, and understand where they fall short. Vision tasks vary quite a lot from one to another. For example: vision tasks t…