AI test analysis

Use AI-powered analysis to understand test failures and improve test coverage.

AI analysis goes beyond a plain pass or fail. In Astra Scout, AI can check what a screen looks like, explain why a run failed, and propose a fix.

WARNING

AI output is probabilistic. Treat an AI check as a helpful signal, not a guarantee. This is why AI commands default to optional: true: a failed AI check is reported as a warning and does not stop the flow, unless you set optional: false.

Authentication

Astra Scout does not use Maestro Cloud for AI, so you do not need a Maestro account or MAESTRO_CLOUD_API_KEY. It uses an AI command-line tool that is already installed and signed in on your Mac: Claude Code, OpenAI Codex, or Gemini CLI. You need only one. After you install and sign in, open Settings > AI and click Rescan; a tool shows "Ready" when it is usable. The AI tool is only needed for AI features; plain flows run without it.

AI-powered assertions in your flows

You can use AI directly in the flow with these commands. Astra Scout runs them with your AI tool:

• assertWithAI: verify a complex UI state in natural language, for example "Verify the user is shown a success message in Spanish".
• assertNoDefectsWithAI: audit the current screen for common UI issues, such as clipped or overlapping text, a blank screen, or a broken layout.
• extractTextWithAI: read a piece of text from the screen into a variable.

- launchApp
- assertWithAI: "The screen shows a Sign in button"
- assertNoDefectsWithAI

Understand and fix failures

When a run fails, Fix with AI explains the failure and proposes a change to the flow, and Auto-fix repeats this until the flow passes. The verdict of a run is computed from structured facts, never decided by the AI. See Run flows.

Maestro's --analyze is not available

Maestro's maestro test --analyze flag, which produces an HTML insights report for spelling, grammar, and internationalization issues and relies on Maestro Cloud, does not exist in Astra Scout. Use assertNoDefectsWithAI on the screens you care about instead.

Next steps

Read the reference pages for assertWithAI and assertNoDefectsWithAI.