Template: Instructions On Data Annotation (Machine Learning / AI)

Sven Piechottka
November 15, 2023

Template Download

This is a free template, provided by OpenRegulatory.

If you are a user of Formwork, our eQMS software, choose “QMS” on the top menu and “OpenRegulatory Templates” on the left menu, and then open the relevant folder to find this template ready to load into Formwork.

If, for some mysterious reason, you’re using a different QMS Software, you can also simply download this template – specifically, as Word (.docx), PDF, Google Docs or Markdown file. Scroll down for a preview!

The template license applies (don’t remove the copyright at the bottom).

Tired of copy-pasting? If you want to save time and edit these templates directly, you can use Formwork, our eQMS software. And if you’re looking for step-by-step instructions for filling them out, check out our Wizard 🙂

Don't Miss Updates to This Template
Subscribe to our newsletter and we'll keep you posted on which templates we've changed.

Questions? Still Lost in Regulation?

Good news! Our goal is to provide lots of stuff for free, but we also offer consulting if you need a more hands-on approach. We get stuff done really fast. Have a look!

Template preview

Intended Purpose:

The Instructions on Data Annotation specify the way in which datasets shall be annotated by medical experts to apply labelling required for the training of the machine learning model. It provides a standard annotation style, including the accuracy and form of annotation. Annotation requirements shall be specific enough to enable any given third party to evaluate the quality of annotation. The guidelines shall als provide a reasoning for the selection of labels and the methodology used to derive the ground truth for model development.

Relevant other documentation:

  • SOP Machine Learning Model Development
  • Intended Use
  • Instructions on Data Acquisition

Note: This is an example of content that could be considered for a specific use case. All content has to be replaced and customized to your specific product use case. You could also consider documenting this in format of a slides presentation in order to easily include helpful images.

General Information

Annotation experts shall draw segmentations around the following findings:

  • Tumors
  • Other suspicious findings
  • (…)

Annotation experts must make sure to segment all visible findings as missing a possible findings will lead to an algorithmic classification as unsuspicious and decreased model performance.

Annotation experts shall NOT segment the following findings:

  • Benign finding XYZ
  • (…)


Annotation instructions:

  • Ensure that the segmentation captures the entire tumor
  • (…)

Document the following information:

  • Tumor classification
  • Biopsy information
  • Confidence level
  • (…)

Other Suspicious Findings

Annotation instructions:

  • Ensure that the segmentation captures the entire finding
  • (…)

Document the following information:

  • Type of suspicious finding
  • Biopsy information
  • Confidence level
  • (…)

Template Copyright openregulatory.com. See template license.

Please don’t remove this notice even if you’ve modified contents of this template.

Template preview


Leave the first comment