A paywall can convert well and still confuse people. Those buyers become refund requests and one-star reviews. A comprehension test asks a different question from an A/B test: not "who bought?" but "did they understand what they were buying?" It needs five people and half an hour. Part of Testing monetization.
What you are checking
After a short look, can a person say:
- what they get,
- what it costs and for how long,
- whether it renews by itself,
- how to cancel or close the screen without paying?
Setup
- Five people who have not seen the screen. More of the same mistake adds little; fewer miss things. Mix ages and phone habits if you can. Five is a practical start, not a statistical claim.
- A screenshot or the real build, full screen, on a phone.
- A notes sheet with the four questions above and a column per person.
- No explaining, no hints. Your job is to be quiet.
Script
- "Imagine you opened this app for the first time. I will show you a screen for five seconds. Then I will ask you some questions."
- Show the paywall for five seconds, then hide it.
- Ask, in this order, and write down the answer in their words: - "What is this screen offering?" - "What would it cost you?" - "Is there a free period? How long?" - "What happens after that?" - "If you did not want it, what would you do?"
- Show the screen again with no time limit. Ask: "Is there anything here you did not notice the first time?" and "What would you change?"
- Ask, without leading: "What would you do next?"
Reading the results
- Count how many of the five answered each question correctly. Wrong answers matter more than missing ones: a wrong belief about price or renewal is the dangerous kind.
- If two or more people share the same wrong idea, the screen is the problem, not the people.
- Fix one thing, then repeat with five new people. Do not reuse participants; they remember.
- Do not turn this into a conversion forecast. Five people tell you what is unclear, not how many will buy. For rate questions use a proper test, see Test your paywall.
Typical findings
Examples of what shows up: the price in small grey text, the renewal hidden below the fold, a trial button that does not mention the price afterwards, a close icon nobody finds. Compare against the dark patterns audit and the copy testing guide. For layout basics see Paywall design.
With AppReviewX
You can ask testers the same questions as part of private, structured feedback and compare their words with what you intended. One feedback you write earns one credit. Start free.