Semi-automatic tagging of images on Wikimedia Commons

(17) Help us test the enhanced version of the ISA Tool, a crowdsourcing tool for tagging images on Commons

ISA Tool - User Tests in the Context of GLAMhack 2022

Documents / Links:

Usability Tests could focus on:


  • Look, feel, and usability of the tagging tool with the machine vision / metadata-to-concept enhancements in place.
  • Usefulness of the tool from the point of view of the Wikimedia Commons community (alignment with community norms, helpfulness in getting the ‘work’ done, etc.)
  • Usefulness of the structured data that is being generated thanks to the tool from the perspective of GLAM institutions (e.g. in the context of content donations).

The involvement of GLAM staff in the project would be most helpful with regard to 1 and 3.


  • The level of involvement will depend on their availability, readiness, personal background, prior experience, organizational context, etc. – Forms of involvement may include:

  • “Play” around with the ISA Tool, make a few edits, and give us feedback from the point of view of an occasional user (with or without prior experience as a contributor to Wikimedia Commons).
  • Make a substantial contribution to the tagging of a collection / campaign (several hours of work with the tool, possibly exchanges with the community), and give us feedback from the point of view of an advanced user of the tool. Assess to what extent they could imagine that someone at their institution would use the tool for the tagging of their own image collections.
  • Assess the usefulness of the structured data generated with the help of the tool. If possible: Compare it to other tools / other approaches which they are familiar with.
  • Help us identify / provide data that could be used for benchmarking the quality of the tagging on Wikimedia Commons with the help of the ISA Tool against other algorithm-supported tagging tools (automatic or semi-automatic). – This would require that the given institution already has used such approaches on their own image collections that are available on Wikimedia Commons.  
  • Evaluate the desirability of using the ISA Tool as the basis for their own crowdsourcing campaigns. – This would require that the given institution already has carried out or at least given some thought to carrying out their own crowdsourcing campaigns.

User stories / usage scenarios

This content is a preview from an external site.

Description of the tool:

Testing / discussions to focus on:

  1. Design, ease of use of the tool
  2. What is considered "good" tagging? - Best practices in adding "depicts" statements on Commons; instructions; challenging cases
  3. Usage scenarios / use cases for the data generated
  4. Assessment of the tool from the point of view of heritage institutions - use by own staff members, carrying out crowdsourcing campaigns

Event finished

05.11.2022 16:30

Joined the team

05.11.2022 15:43 ~ jonaslendenmann

Repository updated

04.11.2022 14:36 ~ beatestermann

Event started

04.11.2022 09:00


04.11.2022 08:56

Edited content version 5

04.11.2022 08:56 ~ jonaslendenmann

Edited content version 3

04.11.2022 08:36 ~ beatestermann

Challenge posted

04.11.2022 08:31 ~ beatestermann
Contributed 1 year ago by beatestermann for GLAMhack 2022
All attendees, sponsors, partners, volunteers and staff at our hackathon are required to agree with the Hack Code of Conduct. Organisers will enforce this code throughout the event. We expect cooperation from all participants to ensure a safe environment for everybody.

Creative Commons LicenceThe contents of this website, unless otherwise stated, are licensed under a Creative Commons Attribution 4.0 International License.

GLAMhack 2022