Permissions and limits
Check organization roles, resource capacity, and evaluation scope.
Organization permissions
| Action | Access |
|---|---|
| Read and work with prompts, datasets, versions, and evaluations | Organization member with active workspace access |
| Manage members, roles, and invitations | Administrator |
| Connect or remove model providers | Administrator |
| Create or revoke retrieval keys | Administrator |
| Manage subscription and buy credits | Administrator |
| Join the organization's observability waitlist | Administrator |
| Revoke a public report | Report creator or administrator |
The server checks the current organization membership and role for each management request. A CLI flag or MCP tool annotation does not bypass these checks. A retrieval key grants read access to its prompt, not organization management access.
Plans and capacity
| Limit | Free | Pro |
|---|---|---|
| Members | 2 | Unlimited |
| Prompt registry capacity | 3 | 10 |
| Cases per prompt dataset | 10 | 500 |
| Quick scope | First 10 cases | First 10 cases |
| Comprehensive scope | Unavailable | Entire dataset |
| Evaluation rate limit | 50 per person per rolling 24 hours | 100 per person per rolling 24 hours |
The evaluation limit is not the number of test cases in a dataset. Request rate limits, provider capacity, usable model access, and credit availability can also affect whether an operation starts. CLI and MCP share a personal management request budget; switching clients does not reset it.
Import and selector limits
Dashboard import files may be up to 5 MB; a management import may contain up to 1,000 rows, subject to the lower dataset capacity. Input and reference strings may contain up to 100,000 characters each.
Custom labels use up to 64 lowercase letters, digits, and hyphens, starting and ending with a letter or digit. Retrieval accepts one label or one positive integer version, never both.
A Free organization exceeding its member limit is paused while retaining data. Administrators can resolve membership or billing to restore work. See plans and billing.