Dynamic Review Capabilities

Allows you to assign another person to review your project automatically

Dynamic review automatically assigns a reviewer when labelers have conflicts in a project. This feature works best for small teams with only a few labelers available. The assigned dynamic reviewer will receive an email notification when a conflict occurs in the project.

How do we enable Dynamic Review?

Dynamic review setting is available in step 4 of project creation.

1. Assign at least 2 labelers and set the consensus to 2 to allow conflicts to occur and be sent for review.

1. Enable Allow dynamic review assignment setting. Choose how to assign the reviewer:

   1. Any other team member automatically selects one team member, regardless of their role in the workspace, except those who have been assigned as labelers in the project.

   2. Any reviewer automatically selects one team member whose role in the workspace is Reviewer.

   3. Dedicated member allows you to select a specific member as the reviewer.

Two Possible Outcomes:

No conflicts

1. Admin assign at least 2 labelers.

2. Labelers start labeling.

3. Labelers complete the project and mark it as complete.

4. No conflicts are found.

5. The project status will automatically update as Completed.

Conflicts

1. Admin assign at least 2 labelers.

2. Labelers start labeling.

3. Labelers complete the project and mark it as complete.

4. At least 1 conflict is found.

5. The project status will automatically update to Ready for review and the assigned dynamic reviewer will receive a notification.