Row & Document Based

In row labeling and document labeling projects, the goal is to answer questions. In row labeling, you answer questions for each row using the Row labeling extension. In document labeling, you answer questions for the entire document using the Document labeling extension.

You can navigate to the next question by using your mouse or using Tab on the keyboard.

Go menu

You can move to the desired row via the Go menu.

• Go to start: Takes you to the first row.

• Go to end: Takes you to the last row.

• Go to line: Takes you to a specific row.

• Go to next unlabeled line: Takes you to the next unlabeled row.

• Go to previous unlabeled line: Takes you to the previous unlabeled row.

• Go to next file: Takes you to the next file.

• Go to previous file: Takes you to the previous file.

Row page navigation

For row labeling projects, you can choose how many rows are shown per page during project creation. Go to step 2, and set the value in Number of rows displayed per page field. By default, all rows are shown on one page.

Inside the project, you can navigate between pages using the pagination control at the top right of the table.

There are three views in row labeling projects:

• Tabular view (default): Shows the data in a table format.

  
• URL view (image): Preview the image URLs so you can label based on the image.

  
• URL view (website): Preview the web page URLs so you can label based on the page content.

  

Document navigation

To navigate to the next document, use the navigation control located at the bottom left of the labeling interface.

Required question

The asterisk (*) next to the question indicates that the question requires an answer. Leaving it blank will trigger an error.

Sort and filter column

If you create questions with text field, text area, dropdown, hierarchical dropdown, date, time, checkbox, slider, grouped attributes and URL question types, you can sort and filter the columns.

For text field, URL, and text area answer columns, you can filter by searching keywords.

For the dropdown and hierarchical dropdown column, you can filter based on the dropdown value.

For the date and time columns, you can filter by selecting a date range or a time range.

For the checkbox column, you can filter it by true or false to check whether is it checked or not.

For the slider column, you can filter it by a specific value or a value range.

For the grouped attributes column, click the arrow next to the question type header name to open the filter options.

It will display a list of each question type in the grouped attributes question.

You can start filtering based on the labeled answers by clicking a question and applying the filter.

If filters are already applied, the arrow next to the question header changes into a filter icon.

Filtering is not supported for radio questions inside the grouped attributes question type.

Keyboard shortcuts for dropdown questions

When the question type is dropdown, keyboard shortcuts are shown in the answer options. In the example below, you can press 1 on your keyboard to select Children as the answer.

Filter rows

In reviewer mode of row labeling projects, you can filter rows from the View menu.

Filter unlabeled rows only

This filter shows only rows that have not been labeled yet. It helps you quickly find and prioritize data that still needs labeling.

Filter conflicted rows only

This filter shows only rows with conflicting labels. It helps you identify and review disagreements in the data so you can resolve them.

Filter unreviewed rows only

This filter shows rows that have not been reviewed yet. It helps reviewers track which data still needs review and ensure everything is checked before finalizing.

Unreviewed rows include both consensus and conflicted rows where the reviewer has not submitted an answer.

Filter reviewed rows only

This filter shows rows that have already been reviewed and approved. It helps you work only with verified and reliable labeled data.

Hide and rename headers

You can hide and rename headers by right-clicking on a column header.

• Hide column: The column is hidden only for you. Other labelers are not affected.

• Hide column from labelers: The column is hidden for all assigned labelers, but remain visible to reviewers. This setting is only available in reviewer mode.

Insert new rows

Inserted rows work like regular rows. They are automatically numbered and can be edited at any time.

Both labelers and reviewers can insert new rows in a project.

• Labelers can insert rows while labeling.

• Reviewers can insert rows during review, and also decide whether to accept or reject insertions made by labelers.

To insert new rows:

• Right-click any row.

• Select Insert row above or Insert row below.

Delete rows

Both labelers and reviewers can delete rows in a project.

• Labelers can delete rows while labeling.

• Reviewers can delete rows during review, and also decide whether to accept or reject deletions made by labelers.

Note: Deleted rows can't be undone and won't automatically replace the original ones. Reviewers decide which version to keep.

Mark as complete

Once you finish labeling, mark the project as complete by changing the Labeling in progress status to Project completed. This signals that the project is ready for review or export.

Personalization settings

This setting lets you customize your labeling experience. You can access it from File → Settings → Personalization.

Automatically jump to next document when marking as complete

When this setting is enabled, marking a document as complete automatically moves you to the next document. You can mark a document as complete from the List of files extension or by using a shortcut (Ctrl + M).

This setting eliminates the need to manually navigate between documents after marking one as complete.

Row-based with URL view

You can label images by adding image URLs in a column of a row-based file.

Prepare your file

• Store images in an accessible location.

• Create a row-based file that includes a URL column.

• Add the image links to the URL column.

• You can add more columns for additional image information. This data cannot be edited later.

Set the preview

Choose how images are shown in the labeling interface:

• Don't expand: No image preview is shown.

• Thumbnail: Shows a small image preview.

• Large: Shows a larger image preview.

Set the viewer to URL view

If the main focus of your labeling is the content from URLs, use URL view.

1. During project creation, in step 3, change the viewer setting from Tabular view to URL view.

2. Set the URL column to the column in your row-based file that contains the URLs.

Start labeling

Inside the project, image previews are shown from the URLs in your row-based file. You can start labeling from the Row labeling extension.

View other columns

Additional information from other columns in your row-based file is available in the Row labeling extension.

Apply answers for multiple rows

You can apply the same answer to multiple rows at once. This is useful when multiple rows share the same pattern.

There are two ways to select rows:

• Use the checkbox in each row.

• Hold Ctrl on your keyboard to select multiple rows.

After selecting the rows, navigate to the Row labeling extension to answer the questions. Click Submit to apply the answer to all selected rows.

Possible cases

• Select multiple rows with no answers, then answer all questions.

  • All selected rows will have the same answers.

• Select rows where some have answers and some do not, then answer all questions.

  • All selected rows will have the same answers.

• Select rows where some have answers and some do not, then only answer one question and leave the rest blank.

  • Only that question will be updated for all selected rows.

• If you select multiple rows, questions may show a Mixed value when answers differ across rows.

  

  • If you change the value and submit, it will override all answers for the selected rows.

  • A Reset button appears if you want to revert back to the Mixed value.

• This feature is only available in the labeler mode.

• It is not supported for row labeling projects with:

  • Number of rows per page: 1.

  • URL viewer enabled.

Auto-saved answers

Auto-save stores your answers as a draft before you submit them. The draft is kept even if you refresh or close the page. This is useful for projects with many questions.

Auto-saved answers apply to both labeler and reviewer. In reviewer mode, if another reviewer submits an answer in the extension, the current draft is replaced with the latest answers (based on the timestamps).

You can also discard drafts by clicking the three-dot menu in the extension.

Notes and limitations

• Auto-saved answers are only available for single row selection. This also applies when discarding drafts.

• In row labeling projects, drafts are shown only in the Row labeling extension, not in the table. Answers appear in the table only after they are submitted.

• Changing the question set will remove all auto-saved answers.