Test the whole task on the device, not just the page

An AI skill is usable on a reader’s phone only if they can reach it, supply the needed information, follow the conversation, correct a mistake, and keep the result. Test those steps on the actual app and account route you plan to support. A page that looks good in a narrow desktop window is useful evidence about layout, but it does not establish that a phone user can finish the work.

You do not need to promise identical experiences everywhere. You need an honest account of which tasks work in which environments, where help is required, and what alternative a reader has when a step is awkward or unavailable.

The script below is an original testing plan. No phone, desktop, or assistive-technology session was conducted for this article. The sample observations are explicitly hypothetical and must not be presented as measured limitations of Skillfully or another platform.

Choose the task and the result first

Start with one task your reader is likely to attempt away from a desk. A short planning exercise might fit a phone. Editing a large spreadsheet may need a different route. Let the task determine what to inspect.

Imagine Simone, a fictional author whose method helps people prepare for a museum visit. Her skill should turn a visitor’s interests, available time, and accessibility preferences into a short visit plan. For the test, use a fictional museum description supplied by the author rather than assuming current opening hours or facilities.

The sample visitor has ninety minutes, wants to see the photography collection, and would like a seated break. The supplied museum description lists the available galleries and seating areas but does not give walking times. The expected result is a short plan that preserves those limits and marks travel-time uncertainty. The skill should not invent a step-free route or guarantee that a seat will be available.

This task exercises several parts of the experience without requiring sensitive personal information or a complicated upload. The finished plan should be easy to read while moving through a building and easy to reopen later.

Record the environment you actually used

“Tested on mobile” is too vague to support a reader-facing promise. Record the phone model, operating-system version, app or browser, account type, and relevant access route. Do the same for desktop.

Include the start state. Was the tester already signed in? Was the service already connected? Had they used the skill before? A returning author account can skip obstacles a new buyer will encounter.

For a small initial check, choose environments that match your audience. If most interested readers tell you they use an iPhone app and a laptop browser, begin there. That does not establish Android support. Mark untested combinations as untested rather than assuming that similar screens behave identically.

Provider documentation can identify differences before testing. For example, Claude’s documentation for opening its mobile app through links says some desktop-only file and folder parameters are ignored on mobile. That is a specific distinction in its Code-link behavior, not a general verdict on mobile skills. Claude’s mobile-link documentation.

Use such documentation to choose checks. Do not replace the checks with a broad compatibility claim.

Run the same reader journey on each device

Give the tester a task, not a demonstration of which buttons to press. GOV.UK’s usability guidance describes observing people attempt specific tasks and asking them to explain what they are doing. That approach can expose confusion that an author’s walkthrough conceals. GOV.UK’s moderated usability-testing guide.

For Simone’s fictional museum-planning skill, use this script:

StepAsk the tester to do thisRecord this evidence
ReachOpen the invitation and get to the skill using the supported route.Where the link lands, any login loop, and whether the next step is clear.
SupplyEnter the ninety-minute visit and photography preference; provide the short museum description.Whether text entry, selection, paste, or attachment causes trouble.
UnderstandRead the first response and explain what the assistant is asking.Whether the question is visible and understandable without hunting through a long answer.
CorrectChange the available time to sixty minutes.Whether the new plan reflects sixty minutes rather than preserving the old assumption.
KeepSave or copy the final plan using the supported option.Whether the tester can find the saved result outside the conversation.
ReturnLeave the app, then reopen the plan.Whether the reader can resume without relying on the author to find it.

Keep the source description and success criteria the same on phone and desktop. Otherwise, a difference in the result might come from different inputs rather than the device experience.

Record help when you provide it. “Completed after I explained how to attach the description” is a useful finding. “Completed” alone hides the part you need to improve.

Watch the mechanics of supplying context

A method may need only a few facts, but your instructions can accidentally make supplying them difficult. A reader might have to switch between an email, a file app, and the AI conversation before answering the first question.

In a public discussion of a developer’s web-content tool, u/buildingstuff_daily described:

“fighting selection handles on my phone”

The comment was made in a promotional product thread; it is a personal report of copy-and-paste friction, not an endorsement we have verified or evidence that the advertised tool solves it. Original mobile text-selection comment.

Test the task with the input method you actually recommend. If the guide says to paste a paragraph, ask the tester to copy that paragraph from the place a reader would receive it. Do not preload it for them and then call the input step successful.

Where a typed summary is sufficient, offer it as an alternative to an attachment. If an image or document is essential, explain why and verify the upload path. Do not ask for an entire private folder when the method only needs three facts from it.

Make the answer readable while it is being used

Inspect the output as a working document. A wide comparison table may be useful on desktop and awkward on a phone. If the reader must repeatedly swipe sideways to connect a row label with its advice, consider a short section for each option instead.

W3C’s reflow guidance addresses preserving information and functionality when content is presented at narrow widths, while recognizing exceptions for material that needs a two-dimensional layout. It is a useful reference for your own pages and documents. A quick author check is not a full accessibility audit. W3C’s explanation of reflow.

For the museum plan, a compact sequence could be easier to use than a six-column table: first gallery, reason for choosing it, estimated allocation, and the uncertainty to confirm. The reader should be able to find the next action without rereading the whole conversation.

Check enlarged text, portrait and landscape where relevant, and whether headings remain informative. For pages you control, include meaningful link labels and a structure that assistive technologies can navigate. W3C’s development tips cover those foundations. W3C’s accessibility development guidance.

When the AI app controls the display, you may not be able to fix its interface. You can still improve the format you request and document the limitation. Do not promise universal accessibility based on a visual inspection.

Test saving and returning, not just generating

The reader’s useful result may need to leave the chat. Test the exact export, copy, or save option you tell them to use. Then open the saved material and check that essential information remains present.

For Simone’s plan, the sixty-minute correction and the uncertain walking times must survive the handoff. If a copied excerpt omits the warning, the reader may use a more confident plan than the method intended.

If switching devices is part of your offer, test that transition separately. Begin on the phone and attempt to continue on desktop using the supported account route. Do not assume that a saved file, conversation, connection, and skill state all move together.

A reader who cannot save a plan still needs a next step: perhaps a shorter plain-text version they can copy. Verify that alternative before recommending it as the standard recovery path.

Turn observations into honest support wording

Use a finding record with the task, environment, expected behavior, observed behavior, assistance, and next action. Avoid a single green check for an entire device family.

For example, a hypothetical finding could be: “The tester completed the plan in the phone browser but needed help locating the copied text in their notes app.” That would support improving the save instructions. It would not support saying that all phone workflows are broken or that the AI method failed.

Another hypothetical finding could be: “The desktop task completed, but the phone route was not tested.” The correct public statement would remain limited to the tested route. These examples illustrate reporting; they are not observations made for this article.

Prioritize failures that prevent access, change the meaning of the result, or lose the reader’s work. Then improve avoidable friction. Repeat the affected task after a change, keeping the earlier evidence so you can tell what improved.

For judging the method’s output alongside device usability, see measuring agent skill quality. To plan a reader experience around your book, visit Skillfully and choose Book onboarding. Bring the task and the devices your audience actually uses.