Labels

Overview

The Labels extensions are available for span, span + line, span + line + document, and conversational labeling projects. Both extensions display the pre-configured label set up during project creation, allowing users to label related to each span.

Label Set Modification

You can manage and update label sets either from the Label Management page in your workspace or directly within a project. This includes adding new label sets, editing existing ones or removing them. Learn more about label set management.

Within a project, label sets can be modified through the menu by right-clicking the three-dot icon in the extension.

Add a new label set

A label set can be added in three ways:

1. Upload a label set with a .csv or .tsv format

2. Choose from a library of label sets

   The library has three label sets loaded by default: INACL, Stanford, and Default NER. If you have created a project before, previous label sets will be automatically added to the library.

   Note: Uploading or choosing a new label set will delete all existing labels in the document.

   
3. Type the labels in manually

Note: maximum label set size is 500 KB.

Replace existing label set

This option allows you to choose between upload/create manually or select one of the pre-stored label sets from the library. Doing so will replace the current label set in use and remove any existing labels associated with it.

Edit label set

This option allows you to adjust the label set even after a project has started. You can add new label, edit existing ones, or remove them.

Editing the label set in the project will not automatically apply changes to the corresponding label set in Label Management page.

Adding Labels

You can directly add label items in the provided section, as shown below.

You can also move a label by clicking the dots and dragging the label up and down.

• Some users find that colors can help them memorize labels and reduce human error while labeling.

• We now support label hierarchies up to 10 levels!

Editing Label

Select the label you want to modify and make the necessary changes. You can update both UI-related properties, such as: label set name, label item name, label color, and label position.

For label color, we provide twelve colors that you can select from.

Delete label set

Delete the current label set to switch to a different one whenever you need.

Save to library

Save the current label set to your library (Label Management page) so it can be reused in other projects.

Show instances by labels

As you can see in the screenshots above, Datasaur count all labels applied to a span of tokens and a relation. If you click on the counter, you can see the instances.

Clicking one of the instances will directly navigate to the instance's location in the text editor.

Marking Unapplied Label as Not Applicable

While labeling, users may find that certain labels do not apply to a document. For example, if a label set includes a 'Signature' label but it is not applicable to a particular document, users lack a straightforward method to indicate the absence of certain label classes.

The introduction of this capability allows users to mark labels that are not applied to a document as N/A (not applicable).

How to: Enable Marking Unapplied Label as Not Applicable

This can be enabled either during the project's creation through the Project Creation Wizard or in the Project Settings within a project.

1. To enable it through the Project Creation Wizard, proceed to Step 5.

   
2. To enable it through Project Settings, navigate to the File, Settings menu and open the Administrator tab. Then, enable the "Allow marking unapplied label classes as N/A" option.

   

Marking a Label Class as Not Applicable

Once enabled, you can mark a label class as N/A (not applicable) within the extension. A label eligible for being marked as N/A is one that has not yet been applied to the document, indicated by an instance counter of 0 displayed in the extension.

To mark the label class as “N/A”, click on the instance counter.

Note: • If you apply a label class that was previously marked as N/A to a span in the document, the N/A mark will be automatically removed, as it becomes applicable to the document. • The N/A mark will only be visible to the user who marks the label class as N/A. It will not affect other users.

To remove the N/A mark, simply click again on the label class you previously marked as N/A.

Review The Unapplied Label Classes

When you mark a document as complete and there are label classes that have not been applied, a dialog box will appear displaying a list of these unapplied label classes. This list excludes any label classes that have already been marked as N/A, enabling you to review and take appropriate action.

If you wish to mark all unapplied label classes as N/A, check the "Mark all unapplied label classes as N/A" option and then click "Mark as complete."