Category Archives: Demo

Workshop summary – Two birds, one stone: Bridging cultural heritage collections with crowds and niches

On Monday the 31st of October the workshop entitled “Two birds, one stone: Bridging cultural heritage collections with crowds and niches”, was held at the Netherlands Institute for Sound and Vision. The workshop was divided in two sessions: presentations and a practical session. In the first session, cultural heritage institutions gave a presentation about their experiences with crowdsourcing, while the practical session involved testing of the systems presented.

The first presentation was by Maarten Brinkerink from the Netherlands Institute of Sound and Vision and was titled “What’s That? Video Tagging Games for Audiovisual Heritage Collections”. In his presentation, Maarten stressed the importance of enriching one of the vast audiovisual collection in Europe that Netherlands Institute of Sound and Vision holds, not only by professional annotations, but also by using the crowd. One such crowdsourcing initiative is the “Waisda? ” crowdsourcing game where users are able to annotate videos online, the goal being the consensus between players. Slides and talk.

Next, Sander Pieterse from Naturalis and Xeno-canto Foundation for Nature Sounds in his presentation “Every Feather and Song: Crowdsourcing and Co-curation from a Natural History Perspective” emphasized crowdsourcing as a significant tool for “building a big collection together” and ensuring enrichment of the existing natural history collections. Moreover, he showed how crowdsourcing can be used as a way of networking between amateurs and professionals and how it can build a sense of connectedness within the communities it addresses. Slides and talk.

Saskia Scheltjens from Rijksmuseum Amsterdam in “Accurator: Consolidation and Integration of Annotations” presented the Accurator system, a project done in collaboration with VU University Amsterdam. Accurator is used for annotating artworks in Rijksmuseum, but despite its usefulness, the results are still to be integrated in the collections at the museum due to the various restructuring that is currently taking place within Rijksmuseum. Slides and talk.

The last presentation was held by Chris Dijkshoorn from VU University Amsterdam and was titled “DigiBird: on the fly collection integration using crowdsourcing”. He presented the results of DigiBird, a project that reinforces crowdsourcing initiatives and integrates four distinct nature-related collections. He mentioned how crowdsourcing is evolving to be a valuable approach to collect data, but faces challenges regarding sustainability and use of results. Slides and talk.

After these presentations, followed a practical session where the participants tried out the crowdsourcing systems presented: Accurator and Waisda?, together with the DigiBird platform. In the scope of the DigiBird project, an instance of the Waisda? game was created with a selection of videos that contain birds, while in the Accurator system a selection of artworks from the bird domain was selected. On the DigiBird platform the participants could see not only on the fly integration of results from the crowdsourcing systems presented, but also results from platforms like Xeno-canto and Naturalis and general statistics of the integrated platforms, together with real-time updates of annotations for artworks and videos containing birds.


DigiBird prototype

We extended the DigiBird website with new functionality showcasing the DigiBird integration pipeline. The main additions:

  • Annotation wall shows objects of crowdsourcing initiatives to which recently information has been added
  • Species page allows searching through multiple collections at once by entering the common name of a bird

Check it out on The code of the prototype is available at github.

SEALINCMedia @WebSci2014

Large datasets such as Cultural Heritage collections require detailed annotations when digitised and made available online. Annotating dierent aspects of such collections requires a variety of knowledge and expertise which is not always possessed by the collection curators. Artwork annotation is an example of a knowledge intensive image annotation task, i.e. a task that demands annotators to have domain-specic knowledge in order to be successfully completed. Today, Lora Aroyo will present WebSci2014 conference the results of a study aimed at investigating the applicability of crowdsourcing techniques to knowledge intensive image annotation tasks. We observed a clear relationship between the annotation difficulty of an image, in terms of number of items to identify and annotate, and the performance of the recruited workers. Here you can see the poster and the slides of the presentation.