Agent Device AI Testing Features: What the AI Actually Does
Part of AI Testing Tools · Full Agent Device profile
This view shows the accepted facts for this property. Editorial guidance for it has not been approved yet, so the page is not indexed.
Overview
Agent Device is Callstack's open-source command-line tool and MCP server that lets AI coding agents inspect, control, and verify mobile, TV, desktop, and web applications.
Uses AI
Limitations
- iOS 'Allow Paste' dialog suppressed under XCUITest
- Android non-ASCII text on real devices without the test IME helper
- Android first helper install can wait on an OEM install dialog
- Android no clipboard access over adb on Android 16
Pricing
Free
Not yet verified
Other tools in AI Testing Tools
Sources
- 1The mobile verification for AI Agents · Official website · Callstack · retrieved 2026-09-26
Supports 43 claims · Vendor documented, high confidence · verified 2026-09-26
- Accessibility checks
- Adapts to UI changes
- API assertions
- Browser engines
- Browser extension testing
- Browsers
- Canvas testing
- Cross-browser testing
- Cross-platform testing
- Dark and light mode testing
- Database assertions
- Deployment
- Email testing
- Failure grouping
- File download testing
- File upload testing
- Free tier
- Headed execution
- Headless execution
- iframe testing
- Local execution
- Multi-tab testing
- Native desktop testing
- Native mobile testing
- Network mocking
- OAuth testing
- On-premises deployment
- PDF validation
- Pricing
- Pricing models
- Private network access
- Product status
- Secrets injection
- Self-healing
- Spelling and grammar checks
- Support SLA
- Targets
- Test data generation
- Test sharding
- Tool
- Trial
- Vendor
- Video content validation
The mobile verificationfor AI Agents: Device automation CLI for AI agents. Real apps on iOS, Android, TV, and desktop.
Built for agents. Anywhere.: We believe all agents should have access to agent-device running real simulators and devices regardless whether they operate within your desktop or from a cloud sandbox.
The mobile verificationfor AI Agents: $npm install -g agent-device
The mobile verificationfor AI Agents: Device automation CLI for AI agents.
The mobile verificationfor AI Agents: Real apps on iOS, Android, TV, and desktop.
The mobile verificationfor AI Agents: The mobile verification for AI Agents. Device automation CLI for AI agents.
Clean-State Testing: agent-deviceMade by Callstack - React and React Native development experts
- 2GitHub - callstack/agent-device: Mobile app automation and verification for AI coding agents. CLI, MCP server, and typed Node.js API for iOS, Android, HarmonyOS, TV, web, macOS, and Linux. · GitHub · Official repository · Callstack · retrieved 2026-09-26
Supports 24 claims · Vendor documented, high confidence · verified 2026-09-26
- Audience
- Autonomous PR validation
- CI execution
- Company size
- Device modes
- Execution model
- GitHub PR checks
- License
- License identifiers
- Max concurrency
- Merge gating
- Parallel execution
- PR comments
- PR-aware test selection
- Preview deployment testing
- Product kind
- Real device testing
- Runner OS
- Scheduled execution
- Summary
- Support channels
- Target OS
- Testing types
- Use cases
Folders and files: Let your coding agent verify its changes in the running app.
Folders and files: agent-device is a command-line tool and MCP server that lets AI coding agents inspect, control, and verify mobile apps.
Folders and files: simulators, emulators, and physical devices
Folders and files: MIT license
Folders and files: It also coordinates device access across parallel agent worktrees
Folders and files: macOS, and Linux.
Folders and files: Docs
Folders and files: iOS, Android, and HarmonyOS (simulators, emulators, and physical devices), TV (tvOS, Android TV, Vega OS Virtual Device), web, macOS, and Linux.
Folders and files: Automated pull request and merge validation with replay scripts and captured artifacts.
- 3Node.js API - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 6 claims · Vendor documented, high confidence · verified 2026-09-26
- Code authoring
- Code samples
- Integrations
- Interfaces
- Languages
- SDK
#Node.js API: Use createAgentDeviceClient() for typed, deterministic device automation from Node.js instead of shelling out to the CLI.
#Device cloud sessions: See the BrowserStack, AWS Device Farm, and Limrun guides for provider-specific setup.
- 4Replay & E2E Testing - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 11 claims · Vendor documented, high confidence · verified 2026-09-26
- Authoring method
- Auto-waiting
- Automatic retries
- Maintenance approach
- Parameterized tests
- Recorder
- Reliability mechanisms
- Replay
- Reusable steps
- Semantic visual assertions
- Test import
#Run Maestro compatibility flows: Agent Device can run a supported subset of Maestro YAML through its typed Maestro runner.
#Run Maestro compatibility flows: extendedWaitUntil
- 5AI Agent Setup - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 14 claims · Vendor documented, high confidence · verified 2026-09-26
- AI executes the app
- AI failure analysis
- AI generates code only
- AI test generation
- Autonomous exploration
- Console logs
- Debug artifacts
- Execution traces
- Interactive debugging
- MCP server
- Natural language authoring
- Network logs
- Uses AI
- VS Code extension
#Recommended agent rule: For logs, network, audio, traces, or runtime failures, read `agent-device help debugging`.
- 6Snapshots - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 1 claim · verified 2026-09-26
- Vision-based interaction
- 7Selectors - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 1 claim · verified 2026-09-26
- Selector-free execution
- 8Commands - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 6 claims · verified 2026-09-26
- GitHub
- Notification testing
- Performance measurement
- Screenshots
- Video recording
- Visual regression
- 9Installation - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 1 claim · Editorial inference, high confidence · verified 2026-09-26
- Setup difficulty
#Installation: #Global install
- 10Security & Trust - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 13 claims · Vendor documented, high confidence · verified 2026-09-26
- Audit logs
- Certifications
- Configurable retention
- Customer data used for training
- Data regions
- Data residency
- Private runners
- RBAC
- SCIM
- Secrets management
- SSO (OIDC)
- SSO (SAML)
- Training opt-out
#Security & Trust: #Security & Trust
#Local control: #Local control
- 11Known Limitations - agent-device · Official docs · Callstack · retrieved 2026-09-26
Supports 1 claim · Vendor documented, high confidence · verified 2026-09-26
- Editorial · Limitations
#Known Limitations: #iOS: "Allow Paste" dialog suppressed under XCUITest