Skip to content

Fix illegal --output, free-tier dry-run scope, and API key login timeout - #322

Merged
hopelynd merged 3 commits into
mainfrom
fix/cli-eval-followups
Nov 13, 2026
Merged

hopelynd merged 3 commits into
mainfrom
fix/cli-eval-followups

Conversation

@hopelynd

Copy link
Copy Markdown
Collaborator

Summary

  • Reject illegal global --output values at parse time (text|json only) so agents no longer get a silent text fallback
  • Annotate usage free / usage freetier all-model dry-runs with scope=all and models_resolved=false when targets are not resolved offline
  • Let API key login validation honor settings.timeout instead of a hardcoded timeout

Description

Follow-ups from the CLI evaluation / agent-friendliness review: tighten output-format validation, make offline full-scope dry-run previews unambiguous, and align auth login validation with the resolved request timeout.

- Constrain global --output to text|json at parse time (USAGE on illegal values).
- Annotate usage free/freetier all-model dry-runs with scope=all and models_resolved=false.
@hopelynd
hopelynd merged commit e7c334f into main Nov 13, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant