The images are selected from seven domains: ANIMALS PLANTS, BUILDINGS, CLOTHING, FOOD, HOME, PEOPLE, VEHICLES.

Within each domain, the dataset aimed at collecting instances at different taxonomic levels to cover a wide range of phenomena. It defined a set of 52 synsets that are used to collect object instances from VG.

University of Michigan - Ann Arbor

The data is taken from VisualGenome (VG) because its dense annotations of images can be beneficial to analyze the factors affecting naming, and how these impact the modeling of natural language in L&V. VG suits the purpose of collecting names for naturalistic instances of common objects, as it has images of varying complexity, with close-ups as well as images with many objects.

ManyNames Dataset

Silberer, C., Zarrieß, S., & Boleda, G. (2020). Object naming in language and vision: A survey and a new dataset. In Calzolari N, Béchet F, Blache P, Choukri K, Cieri C, Declerck T, Goggi S, Isahara H, Maegaard B, Mariani J, Mazo H, Moreno A, Odijk J, Piperidis S, editors. Proceedings of the 12th Language Resources and Evaluation Conference; 2020 May 13-15; Marseilles, France. Stroudsburg (PA): ACL; 2020. p. 5792-801. ACL (Association for Computational Linguistics).

Object Naming in Language and Vision: A Survey and a New Dataset

ManyNames: Sampling of Instances

ManyNames gathers many more names per object than previous datasets: 35.3 on average. It also contains the most variability, since objects have on average 5.7 names. ManyNames shows high potential use for studying the degree of inter-subject naming agreement, and what factors influence variation. 

Despite the care in filtering out objects that are occluded or have unclear bounding boxes, there are still many examples where annotators identified different objects for the same box. Typically, workers named an adjacent object or one supported by the target object, or a part of the target object. While some of these cases are arguably annotation errors, in many cases it is not possible to distinguish which object is being indicated by the box. Referential uncertainty of this kind is a roadblock for the use of L&V resources to study naming variation.

Learn Before

Related