Every agent working on a pull request can test the app on its own cloud Android phone: it starts the phone, installs that PR’s build, walks the flow that has to work, posts a proof comment with screenshots on the PR and stops the phone. A 10-minute run costs about 10 cents at $0.01 a phone-minute, billed per second (prices as of November 13, 2026).
Reviewers read one comment instead of trusting "tested locally". There are two ways in: a GitHub Action for the same check on every push, or your coding agent over MCP for the flow it just changed.
What the comment looks like
One line says passed (✅) or failed (❌), what was tested, the device, the time and the cost, then up to three screenshots and a link to Mobilebox. Time and cost come from the phone’s own session, never from the agent. This is the Markdown of a real proof comment on the Action’s self-test PR, posted on November 11, 2026: Fossify Calculator, 8 s, $0.01.
✅ org.fossify.math launch tested on a Mobilebox cloud phone · Android 14 · 8 s · $0.01
<img src="https://mobilebox.dev/proof/prf_ph3edhbirjekp45cs7xc/1.png" width="200" alt="Screenshot 1">
Tested on [Mobilebox](https://mobilebox.dev/?via=proof-prf_ph3edhbirjekp45cs7xc)Way 1: the GitHub Action
mobilebox-dev/android-smoke-action puts your APK on a fresh phone, opens it, waits for one text and deletes the phone. On a pull request it posts the proof as one comment and updates it on every push.
name: android-smoke
on:
pull_request:
push:
branches: [main]
permissions:
contents: read
pull-requests: write # lets the Action post the proof comment
jobs:
smoke:
runs-on: ubuntu-latest
timeout-minutes: 15
steps:
- uses: actions/checkout@v7
- uses: actions/setup-java@v6
with:
distribution: temurin
java-version: 21
- run: ./gradlew assembleDebug
- uses: mobilebox-dev/android-smoke-action@v1
with:
apk: app/build/outputs/apk/debug/app-debug.apk
wait-for: Welcome
api-key: ${{ secrets.MOBILESANDBOX_API_KEY }}comment: true is the default. Set comment: false to turn it off: then nothing is posted and nothing is stored. Without pull-requests: write no comment is posted either, and the job still passes or fails on the app alone. Pushes never comment. GitHub withholds secrets from fork pull requests, so the check runs on PRs from branches in your repository. In the Action’s own runs on November 6, 2026, a fresh phone reached its verdict in about 23 s. The script behind it is in APK smoke tests from CI.
Way 2: your coding agent over MCP
A smoke test checks the first screen. Your coding agent can walk the flow it just changed. Add https://mobilebox.dev/mcp to Claude Code, Cursor, Codex or ChatGPT and sign in; no key needed (setup per tool). Then ask:
Test PR #42 on a Mobilebox phone. Start a phone, install the APK from
https://github.com/acme/app/releases/download/pr-42/app-debug.apk, sign up
as test@example.com and check that the home screen greets the new user.
When you're done, call publish_proof with title "Sign-up flow" and passed
or failed, post the Markdown it returns as a comment on PR #42 with
gh pr comment, then delete the phone.publish_proof takes the phone, a title, passed or failed, optional screenshots ("current", an image URL from an earlier proof, or base64 PNGs; left out, one of the screen now) and optional labels. It returns the comment’s Markdown; your agent posts it, and Mobilebox shows proofs nowhere else. Call it before deleting the phone. Over REST it is POST /v1/phones/{id}/proofs, in the API reference. The agent guide covers the screen-reading and tapping in between.
Before and after
One "it works" screenshot doesn’t show what a pull request changed. Reviewers asked for the screen before and after, side by side. Name the screen in the prompt, and your agent shows it on main’s build and on the PR’s build:
Show what PR #42 changes on the Settings screen, before and after, on a
Mobilebox phone. Start a phone, install main's APK from
https://github.com/acme/app/releases/download/main/app-debug.apk, open
Settings and call publish_proof with title "Before" (don't post that one);
keep its image URL. Install the PR's APK from
https://github.com/acme/app/releases/download/pr-42/app-debug.apk, open
Settings again and call publish_proof with title "Settings screen",
screenshots [the Before image URL, "current"] and labels
["Before", "After"]. Post that Markdown as a comment on PR #42 with
gh pr comment, then delete the phone.The comment keeps its first line; below it, both screenshots sit in one row under Before and After:
| Before | After |
| :-: | :-: |
| <img src="https://mobilebox.dev/proof/prf_…/1.png" width="200" alt="Before"> | <img src="https://mobilebox.dev/proof/prf_…/2.png" width="200" alt="After"> |An image URL from an earlier proof pins that screen: its screenshot is copied into the new proof, so the Before shot stays when the PR’s build replaces main’s. labels takes one short name per screenshot, for up to three, such as Before, After and Error. Without labels the comment looks as above.
A video of the run
Screenshots show where a run ended. For a bug report, or a flow where the steps matter, add a video. Put this before the flow in either prompt:
Before you open the app, call record_screen with action "start".record_screen records the phone’s screen as an MP4, up to 180 s. publish_proof stops the recording and adds one line under the screenshots, a link to the MP4:
▶️ [Screen recording · 8 s](https://mobilebox.dev/proof/prf_…/screen.mp4)A frame is recorded only when the screen changes, so a short run stays small: 8 s through Android’s Settings was 0.8 MB. record_screen with action "stop" ends the recording sooner. Parking or deleting the phone ends it too, so publish before you delete. In the before-and-after run, start recording after the Before proof, or that proof takes the video. Over REST it is POST /v1/phones/{id}/recording/start and /stop, in the API reference.
What is stored, and for how long
- Nothing is stored unless a proof is published. With
comment: false, or an agent that never callspublish_proof, no screenshot or recording leaves the run. - Each screenshot is an image file at an unguessable address on mobilebox.dev, not indexed and not linked from anywhere but your comment, and so is the recording’s MP4. Anyone with the link can open it, like the comment itself, so use test accounts.
- Screenshots and recordings are deleted 30 days after publishing.
DELETE /v1/proofs/{id}deletes them sooner.
A ✅ is evidence about one build, one flow and one phone at one moment. Keep it next to your unit tests, not instead of them.