What are the inspection processes for annotation jobs

In order to ensure the annotation accuracy, we’ll have several rounds of inspection for your data, which shows below.

Annotation:

• Upon receiving the job, the team leader assigns it to team members for annotation.

Review:

• The Review Job is assigned by the team leader to the reviewer.
• The reviewer checks the annotated data.
• If the data is qualified, it is submitted for Inspection-1.
• If the data is unqualified, the reviewer can make modifications or return it to the annotators for correction.

Inspection-1:

• Inspection-1 involves the acceptance of data submitted by the team reviewer.
• If the data is accepted and qualified, it proceeds to Inspection-2.
• If the data is unqualified, it is sent back to the Team Review for correction.

Inspection-2:

• Inspection-2 is a re-acceptance process for the data that passed Inspection-1.
• If the data is accepted and qualified, it proceeds to Inspection-3.
• If the data is unqualified, it is sent back to Inspection-1 for correction.

Inspection-3:

• If the data is accepted and qualified in Inspection-3, the batch of data is completed.
• If the data is unqualified, it is sent back to Inspection-2 for correction.