> For the complete documentation index, see [llms.txt](https://docs.datasaur.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.datasaur.ai/data-studio-projects/nlp-task-types/project-templates/test-project.md).

# Test Project

Set a test for your labelers!

Lets create a test project for your labelers to assess how well they understand the project guidelines.

In a **Test project**, all pre-applied labels or labels applied by reviewers are considered as ground truth tabels. To pass the test, labelers must match their labels to these ground truth labels.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-f0e7ed7ce74a001cc8313ff25a54d6e7c2e91f97%2FProjects%20-%20highlight%20-%20view%20all%20templates%20button.png?alt=media" alt=""><figcaption></figcaption></figure>

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-6bd51b28bba8db6c96585cdc3f3a51eeecf2a960%2FAll%20project%20templates%20dialog%20-%20test%20project.png?alt=media" alt=""><figcaption></figcaption></figure>

## Create a test project

The **Test project** template is only available for team projects and has 4 steps. Any pre-labeled file conforming to the [supported formats](/compatibility-and-updates/supported-formats.md) can be uploaded in step 1 of project creation.

### **Assign the appropriate labeler**

Assign the project to the labelers, then click **Next**.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-b259b3f2ef573c9cbd02093265862a6ecd0e3db9%2FPCW%20-%20step%204%20-%20test%20project%20template%20-%20labelers%20selected.png?alt=media" alt=""><figcaption></figcaption></figure>

### **Start labeling the spans**

As the project creator, you will start in reviewer mode by default.

* If you upload an **unlabeled file**, you can label spans yourself; these labels become the ground truth labels.
* If you upload a **pre-labeled file**, you save time, as the ground truth labels are already applied.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-d3408f6c05254bc19a36277dc481aa2188d573f8%2FProject%20-%20test%20project%20-%20span%20labeling%20-%20Reviewer%20mode%20-%20labeled%20by%20reviewers.png?alt=media" alt=""><figcaption><p>Reviewer Mode</p></figcaption></figure>

{% hint style="info" %}
If you upload a pre-labeled file for the **Test project**, the labels **will not** be displayed in the labeler mode.
{% endhint %}

### **Labeler has finished the project**

Once the labelers click **Mark as complete**, navigate to the reviewer mode. Any conflicts between the labelers' labels and the ground truth labels will be visible.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-159427471e0b918d34d67b98695ae11d9bec8992%2FProject%20-%20test%20project%20-%20span%20labeling%20-%20Reviewer%20mode%20-%20conflicted.png?alt=media" alt=""><figcaption><p>Reviewer Mode with All Labelers View</p></figcaption></figure>

By default, you will see all labelers' work. You can view each labeler’s work using the **Show work from** dropdown in the **Test project** extension.

When viewing **all labelers**’ work, the color coding is:

* **Gray:** Pre-labeled labels.
* **Violet:** Ground truth labels applied by the reviewer on reviewer mode.
* **Red:** Labels applied by the labelers.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-6ef8782be968872759dfb16eb6cb5873a486e173%2FProject%20-%20test%20project%20-%20span%20labeling%20-%20Reviewer%20mode%20-%20View%20member's%20work.png?alt=media" alt=""><figcaption><p>Reviewer Mode with Individual Labelers View</p></figcaption></figure>

When viewing **an individual labeler's** work, the color coding is:

1. **Gray:** Labels applied by the labeler that match the ground truth labels.
2. **Dark blue:** Labels applied by the labeler that **do** **not** **match** the ground truth labels.
3. **Violet:** Ground truth labels that were not answered by the labeler.

To assess labelers' performance, go to the **Test project** extension to see the detailed information about matched labels, incorrect labels, and total labeling time. You can download this information by clicking the triple-dot menu and selecting **Export summary** **(.csv)**.

<figure><img src="https://448889121-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MbjY0HseEqu7LtYAt4d%2Fuploads%2Fgit-blob-1fb9588dae191ff0b8bbfd5c8703101d2d10a394%2FProject%20-%20test%20project%20-%20span%20labeling%20-%20Reviewer%20mode%20-%20View%20member's%20work%20-%20highlight%20-%20analytics.png?alt=media" alt=""><figcaption></figcaption></figure>

{% file src="/files/efB4OyLe1ZN5GfZboRLe" %}

## Supported labeling types

A **Test project** is available for span labeling, row labeling, and document labeling projects.

## Upload pre-labeled files

In a **Test project**, you can upload pre-labeled files as well as unlabeled files. You can upload [pre-labeled files](/data-studio-projects/pre-labeled-project.md) with the formats listed below.

| Task type                          | Formats                                                                                                                                                                                                                                                                                                                                                                        |
| ---------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| Span labeling                      | [.tsv](https://docs.datasaur.ai/data-studio-projects/nlp-task-types/project-templates/pages/hnBPIPVkJZS5fLhyUjKO#iob-specialized-.tsv), [.tsv\_non\_iob](/compatibility-and-updates/supported-formats.md#tsv_non_iob), [.json](/compatibility-and-updates/supported-formats.md#json_tabular), [.json\_advanced](/compatibility-and-updates/supported-formats.md#json_advanced) |
| Span labeling with arrows          | [.tsv\_non\_iob](/compatibility-and-updates/supported-formats.md#tsv_non_iob), [.json\_advanced](/compatibility-and-updates/supported-formats.md#json_advanced), [.conllu](/compatibility-and-updates/supported-formats.md#conll-u)                                                                                                                                            |
| Span with character-based labeling | [.json\_advanced](/compatibility-and-updates/supported-formats.md#json_advanced)                                                                                                                                                                                                                                                                                               |
| Row labeling                       | [.csv](/compatibility-and-updates/supported-formats.md#csv), [.tsv](/compatibility-and-updates/supported-formats.md#tsv)., [.xlsx](/compatibility-and-updates/supported-formats.md#xlsx)                                                                                                                                                                                       |
| Document labeling                  | [.csv](/compatibility-and-updates/supported-formats.md#csv), [.tsv](/compatibility-and-updates/supported-formats.md#tsv)., [.xlsx](/compatibility-and-updates/supported-formats.md#xlsx)                                                                                                                                                                                       |
