ArtemisKit Documentation
ArtemisKit is an open-source AI assurance toolkit by Vorbtech Innovative Solutions. Define scenarios, evaluate responses, probe security boundaries, run controlled agent workflows and inspect saved evidence.
Start here
Section titled “Start here”- Installation — the CLI requires Bun, including with npm installation.
- Getting started — configure a provider and run a small scenario.
- Core concepts — scenarios, expectations, providers and evaluators.
- CLI reference and SDK reference — source-backed interfaces.
Test models and applications
Section titled “Test models and applications”- Scenario format
- Evaluators
- Provider setup
- Red teaming
- Stress testing
- CI/CD
- Storage
- SDK and framework adapters
Evaluate tool-using workflows
Section titled “Evaluate tool-using workflows”- Declare the workflow contract.
- Configure controlled execution and preflight.
- Check outcomes independently.
- Handle faults and recovery.
- Generate offline reports.
Understand the evidence
Section titled “Understand the evidence”Read the reproducibility guide and current release record. Invalid and unavailable workflow measurements remain distinct from eligible passed/failed outcomes. A passing test does not certify legal compliance or guarantee safety.
Versions and source
Section titled “Versions and source”The source-backed workflow and package references identify their exact core-repository snapshot. The current recorded release milestone is 0.6.4, with independent package versions (CLI/SDK 0.6.3). Consult its package map rather than treating a milestone number as every package’s version.