Previous work in L&V has collected and used datasets where annotators produced free and natural utterances for a given image. These datasets typically record utterances that are more complex than a single word, such as image captions, referring expressions, visual dialogues or image paragraphs.

While object names occur in all of these datasets, they are not necessarily marked up and linked to the corresponding image regions.