Data Formats

Datasaur supports a wide variety of import data formats. The available formats depend on the task type, as described in the table below. Click on any format to see a detailed explanation of the file structure Datasaur expects.

Don't see your preferred file format below? Don't worry, we have a feature called file transformers which enables you to upload a custom format.

Available Formats

Span-based	.txt, .tsv, .json
Span-based with arrows	.txt, .tsv, .tsv-non-iob, .json, .conllu
Span-based with audio	Media: .mp3, .m4a, .aac, .flac, .wav Transcription: .srt, .txt, .vtt, .json
Span-based with document	Media: .bmp, .doc, .docx, .pdf, .ppt, .pptx, .jpeg, .jpg, .png, .tiff, .tif, .webp Transcription: .json, .txt, .tsv
Bounding box labeling	.bmp, .gif, .jpeg, .jpg, .pdf, .png, .svg, .tiff, .tif, .webp
Conversational labeling	.txt, .json
Row-based (text classification)	.csv, .json, .jsonl, .tsv, .txt, .xls, .xlsx
Document-based*	.bmp, .csv, .gif, .html, .jpeg, .jpg, .json, .md, .mp4, .pdf, .png, .svg, .tiff, .tif, .txt, .tsv, .uri, .url, .urls, .webp
LLM Evaluation (fine tuning)	.csv
LLM Ranking (RLHF)	.csv

Size limit

• Text-based File: 50 MB per file

  • Example: .txt, .tsv, .json, and .csv

• Multimedia & Image File: 500 MB per file

  • Example: Video, Image, Audio, and PDF

• Project size: 1.5 GB

If you would like to create projects with larger files, it can be achieved using Robosaur. Please reach out to us in [email protected] for further assistance.

Important Notes

Document-based formats only work if you import the files through Project Creation Wizard.

When uploading pairs of OCR documents, please make sure your image files and their corresponding transcription have the same file name. For example, unicef.jpg and unicef.txt.