Getting Started

Testonaut Documentation

Testonaut is an end-to-end AI test agent that closes the loop from a Jira requirement to tested, reviewable automation code. A QA engineer or Jira automation rule starts with a story key. Testonaut gathers the story context, designs the test coverage, uploads the resulting test cases to Xray, implements the missing automation in the target repository, verifies it, and raises a pull request for human review.

The system can run locally from the testonaut CLI, but the intended operating model is unattended execution from Jira automation through a parameterized Azure pipeline. Jira rules pass the issue key, target repository, and run mode into the pipeline.

Run modes

ModePurpose
designResearch the ticket, design tests, and upload linked Xray tests.
implementReconstruct the design from Xray, implement missing automation, verify, and raise a PR.
bothRun design and implementation in one pipeline execution.
coverageAnalyse linked tests against the story, comment gaps, and optionally create missing Xray tests.

Agentic work with bounded artifacts

The core design principle: each stage can use LLM reasoning internally, but every hand-off is a Zod-validated artifact with schema version, provenance, and warnings. This keeps the agent auditable, reproducible, and safe to operate in CI.

ArtifactProduced byUsed for
ContextPackResearcherThe validated evidence set for the ticket.
TestDesignPackTest ArchitectScenario design, coverage matrix, Xray upload, and implementation input.
ImplementationPackCode agent / verifier / healerChanged files, verification result, PR metadata, and run outcome.
LearningRecordSetLearning engineDurable lessons proposed through human-reviewed guideline PRs.

End-to-end flow

Testonaut end-to-end flow from a Jira ticket to verified, tested code
From a Jira ticket to verified, tested code — four agent phases plus the cross-cutting governance layer.
  • Xray is the hand-off point between design and implementation. After design, implementation can run statelessly from --issue <KEY> by reading the linked Xray tests.
  • Design is repository-aware. Testonaut scans existing .feature files and reuses established Gherkin step phrasings instead of creating near-duplicate steps.
  • Implementation is environment-aware. A configured Docker setup command lets Testonaut start the app, explore real UI locators or API contracts, verify against the running system, and self-heal failing tests.
  • Every mutating action is governed — Xray uploads, PR creation, learning proposals, and budget breaches are written to a redacted audit log.
  • Every run is observable — LLM calls and agentic phases are traced with OpenTelemetry and grouped into one session per Jira issue in Langfuse.

New here?

Start with the Quick Start to scaffold a repository, then follow the Jira Integration guide to run Testonaut unattended from Jira automation.

Explore the documentation