Announcing Datasets in Mastra Studio

Define test cases, run experiments, and track response quality for every change you make.

Agents produce non-deterministic output. The same prompt can return different results depending on the model, temperature, or context window. That makes it hard to tell whether a prompt tweak, model swap, or code change actually improved performance or introduced a regression.

Datasets let you define versioned test cases for your agents and workflows to track, measure, and improve response quality across prompt, model, and code changes. Upload data in Mastra Studio or create datasets programmatically via the API.