How to Tell If a Learning Claim Is Legit: A 6-Question Check
Learning advice arrives from everywhere: short videos, course landing pages, podcast guests, product boxes. Some of it rests on decent research, some on a single small study stretched too far, and some on nothing at all. The goal of this guide is simple. By the end, the reader should be able to take any learning claim, run it through six questions in a few minutes, and land on one of three verdicts: probably sound, uncertain, or probably hype.
None of this requires a science degree. It requires slowing down long enough to ask what the claim actually says, and noticing which parts are missing.
Why learning claims are easy to get wrong
Learning is unusually easy to fake for a simple reason: practice that feels smooth is not the same as learning that lasts. Rereading, highlighting and watching a fluent explanation all produce a sense of familiarity. Research on study strategies has repeatedly found that this familiarity can be a poor guide to what will be remembered a week later. So a method can genuinely feel better, attract glowing reviews, and still do little for long-term memory.
A second problem is the jump from a narrow finding to a broad promise. A study might show a small effect on word lists among university students tested ten minutes later. By the time it reaches an advertisement, it has become a method that “transforms how you learn anything.” Each step of retelling drops a limit. The learning pyramid and learning styles are two well-known examples of ideas that spread far beyond the evidence behind them.
Finally, many claims are unfalsifiable. “Unlock your brain’s potential” cannot be wrong because it never says what will change, by how much, or how anyone would check.
The six-question check
Use these questions in order. Each one takes under a minute once it becomes familiar.
- What exactly is claimed? Rewrite the claim as one plain sentence with a measurable outcome. “Remember more” becomes “score higher on a recall test a week later.” If it cannot be rewritten this way, note that.
- Measured on whom? Students, older adults, experts, children, a handful of volunteers? Results in one group do not automatically transfer to another.
- Compared with what? Better than doing nothing is a low bar. A useful claim says it beats a sensible alternative, such as normal review or self-testing.
- When was learning measured? Immediately after practice, or after a delay? Delayed tests matter more for real learning.
- How big and how consistent? One study or many? Did independent groups find the same thing? Large effects from a single small study are common and often shrink.
- Who benefits if it is believed? A seller is not automatically wrong, but a financial stake raises the bar for evidence.
The check does not decide truth on its own. It shows where the gaps are, and gaps are the information needed for a sensible decision.
Printable claim scorecard
Copy this table into a notebook or print it. Give each question 0, 1 or 2 points. A total of 9 to 12 suggests probably sound, 5 to 8 uncertain, 0 to 4 probably hype.
| Question | 0 points | 1 point | 2 points |
|---|---|---|---|
| What is claimed? | Vague or unmeasurable | Partly specific | Clear, measurable outcome |
| Measured on whom? | Not stated | Stated but very different from you | Similar learners |
| Compared with what? | No comparison | Compared with doing nothing | Compared with a fair alternative |
| When measured? | Not stated or only feelings | Immediately after | After a delay of days or more |
| Size and consistency? | Anecdote or testimonial | One study | Several independent studies |
| Who benefits? | Seller, no sources given | Seller with sources | No strong stake, or open sources |
Write the claim at the top of the sheet in the original wording, then the rewritten one-sentence version beneath it. The gap between the two is often the most revealing part.
Example: Dana and the memory supplement
Dana, a 44-year-old accountant studying for a tax specialty exam, sees an advertisement for a supplement that promises to “boost memory and focus by up to 40 percent.” The site shows testimonials and a reference to a clinical trial.
Running the check, Dana rewrites the claim: “People taking this score up to 40 percent higher on some memory measure.” The phrase “up to” means the best single result, not a typical one. The trial link leads to a summary of a small study in older adults with memory complaints, compared with a placebo, measured on a short attention task. There is no mention of whether anyone else found the same result. The seller funded the study.
Dana scores it 4 out of 12. The verdict is probably hype for this purpose. The more useful move, Dana decides, is to keep using active recall on practice questions, a method with a long record across many groups and delayed tests.
Guided exercise: check three claims in 15 minutes
- Collect three learning claims seen this week: one from social media, one from a product or course, one from a friend or colleague.
- For each, spend two minutes rewriting it into one measurable sentence.
- Spend two minutes looking for the source. If none is linked, search for the claim plus words like “study” or “review.” Note what turns up.
- Score each claim with the scorecard.
- Write one line per claim: what would change the verdict? For example, “a second independent study with a delayed test.”
The last step matters. It turns a verdict into a question that can be revisited, rather than a fixed opinion.
Common mistakes
- Treating “studies show” as a source. A claim with no named study, journal or organisation scores zero on consistency.
- Dismissing everything a seller says. Some commercial tools are built on well-supported methods; the check judges evidence, not motive alone.
- Accepting a claim because it fits personal experience. One person’s improvement may come from more time spent, not the method.
- Confusing “in the brain” language with evidence. Brain scan images and neuroscience words can make weak claims look stronger.
- Stopping at the first search result. Look for at least one review or critique as well as the original source.
For deeper source work, verifying what you learn and reading academic papers cover the next steps.
A 15-minutes-a-day version
Keep a running “claims log” page. Each day, pick one claim encountered and give it five minutes: rewrite, find the source, score it. Use the next five minutes to look for a critique or a second study. Spend the final five minutes writing the verdict and what would change it. Over a month this builds a personal reference of thirty checked claims, and the questions become automatic.
How to measure progress
- Time per check: it should fall from around fifteen minutes to five as the questions become habit.
- Revisit rate: once a month, revisit five old verdicts. Count how many still hold after any new information.
- Spending changes: note any course, app or product skipped or bought because of a check.
- Rewrite quality: compare early and recent rewritten claims. Recent ones should be shorter and more measurable.
The aim is not to become cynical. It is to spend limited study time on methods with the best chance of working.
Frequently asked questions
What makes a learning claim trustworthy?
A trustworthy claim says what improves, for whom, compared with what, and when it was measured. It is supported by more than one independent study, ideally with a delayed test rather than a test given straight after practice. Clear limits are a good sign rather than a weakness.
Are testimonials useless?
Testimonials show that some people liked a product or method. They cannot show that it caused better learning, because those people may also have studied more or been unusually motivated. Treat them as a reason to look for evidence, not as evidence.
How can someone check a claim without access to research papers?
Search for the claim with words like "review" or "evidence," and look for summaries from universities, research groups or educational organisations. Many study abstracts are free and list the sample, comparison and outcome, which covers most of the six questions.
Does a large percentage improvement mean a method works well?
Not necessarily. Phrases like "up to" describe the best case. Percentages can also be calculated from a very low starting point. Ask what the typical change was and what the comparison group did.
Is neuroscience language a red flag?
Not always, but it is often used to make claims sound more solid than they are. A brain scan showing activity does not show that someone learned more. Look for a behavioural outcome, such as test scores after a delay.
What if the evidence is mixed?
Mixed evidence usually means the effect depends on conditions such as the type of material or learner. Mark the claim as uncertain, try it cheaply if the cost is low, and measure the result with your own delayed self-test.
Should a claim be rejected if the seller funded the research?
Not automatically. Funding raises the bar, so look for independent replication. If only the seller has found the effect, the verdict should stay uncertain at best.
Continue in this guideStudy Methods That Actually Work for Busy Adults →
This article was drafted with AI assistance and reviewed by the Life Learning Journey editorial team. Read our editorial standards.