Datasaur
Visit our websitePricingBlogPlaygroundAPI Docs
  • Welcome to Datasaur
    • Getting started with Datasaur
  • Data Studio Projects
    • Labeling Task Types
      • Span Based
        • OCR Labeling
        • Audio Project
      • Row Based
      • Document Based
      • Bounding Box
      • Conversational
      • Mixed Labeling
      • Project Templates
        • Test Project
    • Creating a Project
      • Data Formats
      • Data Samples
      • Split Files
      • Consensus
      • Dynamic Review Capabilities
    • Pre-Labeled Project
    • Let's Get Labeling!
      • Span Based
        • Span + Line Labeling
      • Row & Document Based
      • Bounding Box Labeling
      • Conversational Labeling
      • Label Sets / Question Sets
        • Dynamic Question Set
      • Multiple Label Sets
    • Reviewing Projects
      • Review Sampling
    • Adding Documents to an Ongoing Project
    • Export Project
  • LLM Projects
    • LLM Labs Introduction
    • Sandbox
      • Direct Access LLMs
      • File Attachment
      • Conversational Prompt
    • Deployment
      • Deployment API
    • Knowledge base
      • External Object Storage
      • File Properties
    • Models
      • Amazon SageMaker JumpStart
      • Amazon Bedrock
      • Open AI
      • Azure OpenAI
      • Vertex AI
      • Custom model
      • Fine-tuning
      • LLM Comparison Table
    • Evaluation
      • Automated Evaluation
        • Multi-application evaluation
        • Custom metrics
      • Ranking (RLHF)
      • Rating
      • Performance Monitoring
    • Dataset
    • Pricing Plan
  • Workspace Management
    • Workspace
    • Role & Permission
    • Analytics
      • Inter-Annotator Agreement (IAA)
        • Cohen's Kappa Calculation
        • Krippendorff's Alpha Calculation
      • Custom Report Builder
      • Project Report
      • Evaluation Metrics
    • Activity
    • File Transformer
      • Import Transformer
      • Export Transformer
      • Upload File Transformer
      • Running File Transformer
    • Label Management
      • Label Set Management
      • Question Set Management
    • Project Management
      • Self-Assignment
        • Self-Unassign
      • Transfer Assignment Ownership
      • Reset Labeling Work
      • Mark Document as Complete
      • Project Status Workflow
        • Read-only Mode
      • Comment Feature
      • Archive Project
    • Automation
      • Action: Create Projects
  • Assisted Labeling
    • ML Assisted Labeling
      • Amazon Comprehend
      • Amazon SageMaker
      • Azure ML
      • CoreNLP NER
      • CoreNLP POS
      • Custom API
      • FewNERD
      • Google Vertex AI
      • Hugging Face
      • LLM Assisted Labeling
        • Prompt Examples
        • Custom Provider
      • LLM Labs (beta)
      • NLTK
      • Sentiment Analysis
      • spaCy
      • SparkNLP NER
      • SparkNLP POS
    • Data Programming
      • Example of Labeling Functions
      • Labeling Function Analysis
      • Inter-Annotator Agreement for Data Programming
    • Predictive Labeling
  • Assisted Review
    • Label Error Detection
  • Building Your Own Model
    • Datasaur Dinamic
      • Datasaur Dinamic with Hugging Face
      • Datasaur Dinamic with Amazon SageMaker Autopilot
  • Advanced
    • Script-Generated Question
    • Shortcuts
    • Extensions
      • Labels
      • Review
      • Document and Row Labeling
      • Bounding Box Labels
      • List of Files
      • Comments
      • Analytics
      • Dictionary
      • Search
      • Labeling Guidelines
      • Metadata
      • Grammar Checker
      • ML Assisted Labeling
      • Data Programming
      • Datasaur Dinamic
      • Predictive Labeling
      • Label Error Detection
      • LLM Sandbox
    • Tokenizers
  • Integrations
    • External Object Storage
      • AWS S3
        • With IRSA
      • Google Cloud Storage
      • Azure Blob Storage
      • Dropbox
    • SAML
      • Okta
      • Microsoft Entra ID
    • SCIM
      • Okta
      • Microsoft Entra ID
    • Webhook Notifications
      • Webhook Signature
      • Events
      • Custom Headers
    • Robosaur
      • Commands
        • Create Projects
        • Apply Project Tags
        • Export Projects
        • Generate Time Per Task Report
        • Split Document
      • Storage Options
  • API
    • Datasaur APIs
    • Credentials
    • Create Project
      • New mutation (createProject)
      • Python Script Example
    • Adding Documents
    • Labeling
      • Create Label Set
      • Add Label Sets into Existing Project
      • Get List of Label Sets in a Project
      • Add Label Set Item into Project's Label Set
      • Programmatic API Labeling
      • Inserting Span and Arrow Label into Document
    • Export Project
      • Custom Webhook
    • Get Data
      • Get List of Projects
      • Get Document Information
      • Get List of Tags
      • Get Cabinet
      • Export Team Overview
      • Check Job
    • Custom OCR
      • Importable Format
    • Custom ASR
    • Run ML-Assisted Labeling
  • Security and Compliance
    • Security and Compliance
      • 2FA
  • Compatibility & Updates
    • Common Terminology
    • Recommended Machine Specifications
    • Supported Formats
    • Supported Languages
    • Release Notes
      • Version 6
        • 6.111.0
        • 6.110.0
        • 6.109.0
        • 6.108.0
        • 6.107.0
        • 6.106.0
        • 6.105.0
        • 6.104.0
        • 6.103.0
        • 6.102.0
        • 6.101.0
        • 6.100.0
        • 6.99.0
        • 6.98.0
        • 6.97.0
        • 6.96.0
        • 6.95.0
        • 6.94.0
        • 6.93.0
        • 6.92.0
        • 6.91.0
        • 6.90.0
        • 6.89.0
        • 6.88.0
        • 6.87.0
        • 6.86.0
        • 6.85.0
        • 6.84.0
        • 6.83.0
        • 6.82.0
        • 6.81.0
        • 6.80.0
        • 6.79.0
        • 6.78.0
        • 6.77.0
        • 6.76.0
        • 6.75.0
        • 6.74.0
        • 6.73.0
        • 6.72.0
        • 6.71.0
        • 6.70.0
        • 6.69.0
        • 6.68.0
        • 6.67.0
        • 6.66.0
        • 6.65.0
        • 6.64.0
        • 6.63.0
        • 6.62.0
        • 6.61.0
        • 6.60.0
        • 6.59.0
        • 6.58.0
        • 6.57.0
        • 6.56.0
        • 6.55.0
        • 6.54.0
        • 6.53.0
        • 6.52.0
        • 6.51.0
        • 6.50.0
        • 6.49.0
        • 6.48.0
        • 6.47.0
        • 6.46.0
        • 6.45.0
        • 6.44.0
        • 6.43.0
        • 6.42.0
        • 6.41.0
        • 6.40.0
        • 6.39.0
        • 6.38.0
        • 6.37.0
        • 6.36.0
        • 6.35.0
        • 6.34.0
        • 6.33.0
        • 6.32.0
        • 6.31.0
        • 6.30.0
        • 6.29.0
        • 6.28.0
        • 6.27.0
        • 6.26.0
        • 6.25.0
        • 6.24.0
        • 6.23.0
        • 6.22.0
        • 6.21.0
        • 6.20.0
        • 6.19.0
        • 6.18.0
        • 6.17.0
        • 6.16.0
        • 6.15.0
        • 6.14.0
        • 6.13.0
        • 6.12.0
        • 6.11.0
        • 6.10.0
        • 6.9.0
        • 6.8.0
        • 6.7.0
        • 6.6.0
        • 6.5.0
        • 6.4.0
        • 6.3.0
        • 6.2.0
        • 6.1.0
        • 6.0.0
      • Version 5
        • 5.63.0
        • 5.62.0
        • 5.61.0
        • 5.60.0
  • Deployment
    • Self-Hosted
      • AWS Marketplace
        • Data Studio
        • LLM Labs
Powered by GitBook
On this page
  • Enabling Self-Assignment
  • Preparing Projects for Self-Assignment
  • How Labelers Can Self-Assign
  • Unassigned Projects Tab
  • Assigned Projects Tab
  • Within the Project
  • How Admins and Supervisors Can Self-Assign as Labelers
  • Additional Configuration
  • Document Limit
  • Time Limit
  1. Workspace Management
  2. Project Management

Self-Assignment

Last updated 3 months ago

The Self-Assignment feature enables labelers to proactively assign documents to themselves from a pool of available projects. It is especially useful for teams that want to give labelers more control over their work and ensure unassigned tasks are quickly picked up.

An available project is a project with incomplete assignments, either because some documents remain unassigned or the assignment count has not yet reached the consensus number.

Self-assignment is not available by default for projects created before Datasaur v6.90.

Enabling Self-Assignment

Admins can enable Self-Assignment feature through the workspace settings:

  1. Navigate to the Workspace Settings via the sidebar menu on the Projects page.

  2. Go to the Assignment tab and check the option “Allow self-assignment for labelers.”

  3. Click Save Changes to apply the new setting.

Once the feature is enabled, there will be some differences in the Projects page for certain team roles.

  • Admins and Supervisors will be able to see projects with incomplete assignments marked by the “Incomplete assignment” chip.

  • Labelers will see a new Unassigned projects tab. There, they will be able to view projects they are not assigned to, and able to self-assign themselves to those projects.

Preparing Projects for Self-Assignment

To make a project available for self-assignment, create the project as usual. Then, in the Assignment step of the project creation process, assign only Reviewers.

How Labelers Can Self-Assign

Once the self-assignment feature is enabled, labelers can self-assign documents from multiple places: the Unassigned Projects tab, the Assigned Projects tab, or directly within the project.

Unassigned Projects Tab

Labelers can self-assign to projects they are not currently assigned to by following these steps:

  1. Open the Projects page.

  2. Go to the Unassigned projects tab to view available projects and the number of documents that can be assigned to.

  3. Click “+ Assign myself…” on the desired project.

  4. Enter the number of documents to assign and click “Assign to me”.

  5. When the self-assignment is successful, the project will open immediately, allowing them to begin work.

Assigned Projects Tab

If Labelers would like to self-assign to additional documents within projects they are already working on, they can do so by following these steps:

  1. Open the Projects page.

  2. Go to the Assigned projects tab to view the projects and click on the three-dot icon of the desired project.

  3. Enter the number of documents to assign and click “Assign to me”.

  4. When the self-assignment is successful, the project will open immediately, allowing them to begin work.

Within the Project

When labelers have completed the labeling work and marked all the documents they are assigned to as complete, they will be prompted with a dialog asking if they want to self-assign additional documents if the project still has incomplete assignments.

They will be able to choose whether they want to self-assign more documents or simply mark the project as done instead.

If multiple labelers attempt to self-assign the same project simultaneously, it is possible that some documents may not be allocated as requested. For example, if you request 5 documents but another labeler has already self-assigned some, you may only receive 3.

How Admins and Supervisors Can Self-Assign as Labelers

Aside from Labelers, Admins and Supervisors can self-assign as well by following these steps:

  1. Open the Projects page and click on the three-dot icon of the desired project.

  2. Enter the number of documents to assign and click “Assign to me”.

  3. When the self-assignment is successful, the project will open immediately, allowing them to begin work.

Additional Configuration

You can configure various settings to manage how labelers interact with documents. These configurations help control the flow of tasks and ensure that the labeling process remains efficient and manageable.

They can be customized:

  1. During project creation in step 5 of the Project Creation Wizard.

  2. Or after project creation by updating settings from project settings in the Administrator tab.

    Note: Changes to the time limit only apply to new assignments. For example, if you update the time limit (enable, increase, decrease, or disable it) after a labeler has already self-assigned a document, that document will still follow the original time limit set at the time it was assigned. New assignments will use the updated time limit.

Notes

  • These settings are applied at the project level, so they will need to be set up again when creating a new project.

  • When either setting is enabled, labelers will only be able to self-assign one document at a time in the self-assignment dialog.

Document Limit

The document limit applies only to self-assignment actions, preventing team members from assigning themselves more documents once they reach the set limit. This ensures that no labeler takes on more tasks than they can handle at once, which helps to distribute tasks more fairly across the team.

When It Should Be Used

Use this setting when you want to manage how many documents a labeler can work in a project. It prevents a single labeler from taking on too many tasks and ensures that other team members can self-assign documents as well.

Key Notes

  • The minimum document limit is 1 document, and the maximum is 1000 documents.

  • This setting does not prevent Admins or Supervisors from assigning documents through the project creation or project settings. They can still assign more documents to a labeler, even if the document limit is reached.

Example

If a document limit set to 3:

  • A labeler can self-assign up to 3 documents throughout the project.

  • Admins can assign more than 3 documents to a labeler, even if the document limit is set to 3.

  • If a labeler has already been assigned 2 documents by an admin, they can only self-assign 1 more document (since the limit is 3). However, admins can still assign additional documents beyond the limit.

Time Limit

The time limit defines how much time a labeler has to complete a document once it has been assigned, either through self-assignment or by an admin. This helps ensure that tasks are completed in a timely manner, keeping the project on track.

When It Should Be Used

Use this setting when there is a need for time control to maintain consistency in task completion. For example, when there are deadlines or a need to manage the pace of work across multiple labelers.

Key Notes

  • The minimum time limit is 1 minute, and the maximum is 480 hours and 59 minutes.

  • Countdown Start: The countdown begins immediately once a document is assigned. The time left will be displayed in a countdown indicator beside the document name in the top bar and in the List of Files extension.

  • Countdown Stop: The countdown stops when the document is marked as complete. Once marked complete, the document's status cannot be reverted to "In Progress."

  • Expiration: If the time limit expires before completion, the document will be unassigned and added back to the list of documents available for self-assignment.