6.101.0

February 20, 2025

What's new 💡

NLP

• Answer Validation Script in Row Labeling — Introduced support for custom validation scripts to automatically verify user inputs in answer fields, helping enforce consistency and accuracy during labeling.

• Script-Generated Question for Row Labeling — Added support for dynamically generating questions using scripts, allowing more flexible and automated question creation during labeling.

• Bounding Box Labeling — Attribute answers now factor into conflict detection, along with labels, bounding box positions, and captions, ensuring more accurate reviews.

• In-Review Document Indicator — Added confirmation dialogs to prevent accidental status overrides and allowed users to take over in-review documents for reassignment.

• Custom Report Builder — Add new filters to further customize the report through project, tags, members, and labeling type.

• Analytics Extension — Add an empty state when no labeler is assigned to the project.

• Advanced Search — Updated the cursor to "not-allowed” type to clearly indicate when hovering over disabled buttons.

LLM Labs

• Deployment — Added an embedding models icon to the deployment page.

• Custom model — Added a new capability to let users edit the hyperparameters of custom models directly from LLM Labs.

• Direct Access LLMs — Integrated the new Gemini 2.0 Flash Series into LLM Labs.

• Direct Access LLMs — Enabled streaming capability for OpenAI o1 models in Sandbox.

• Deployment — Added support for metadata filtering in our deployed applications.

• Models catalog — Added Vertex AI as our new model integration; users can now bring their own Vertex AI model directly into LLM Labs.

• Subscription — Updated our PAYGO subscription margin from 25% to 0%.

Bug fixes 🐞

NLP

• Fixed an issue in Bounding Box Labeling where the tooltip was not displaying on hover for multiple bounding boxes when “Show Resize Handles on Hover” was enabled.

• Fixed an issue in Search extension where the search results were not visible when using advanced search with the query settings accordion open.

LLM Labs

• Fixed an issue where empty space appeared in the column header after deleting a deployed application.

• Fixed an issue where the evaluation name remained truncated after resizing the column name.

• Fixed a typo in the application hyperparameter configuration reset-to-default dialog.

• Fixed an issue where the deployment application details page was becoming blank.

• Fixed an issue where a BAD_REQUEST error message appeared when performing the embedding process via external vector store.