Reading a study abstract takes a couple of minutes and answers most questions a product page raises. A short checklist covers what matters.
What was the design?
Randomised controlled trials with a placebo and blinding provide the strongest evidence for whether something works.
Observational studies show associations and cannot establish cause, since people who take supplements differ from those who do not in many ways.
Laboratory and animal studies do not establish human effects, however striking the findings appear.
How many participants?
Small studies produce unreliable results, with findings that frequently fail to replicate.
Trials of a few dozen participants are common in supplement research and should be read as preliminary rather than conclusive.
Who was studied?
Results in deficient, unwell or elderly participants do not transfer to healthy people.
Correcting a deficiency is the most reliable way to produce a positive supplement result, and it says nothing about people who are not deficient.
What was measured?
Distinguish outcomes that matter from markers that stand in for them.
A change in a blood marker is not the same as feeling better, living longer or avoiding an event.
Who funded it?
Industry funded nutrition research produces systematically more favourable results than independent work.
Funding is usually disclosed at the end of a paper and is worth checking.
What else is worth noticing?
- Whether the study was pre-registered before it began
- How long it ran, since short trials miss both benefits and harms
- How many participants dropped out
- Whether the conclusion matches the results or overstates them
- Whether anyone has replicated it independently
Where do you find studies?
Abstracts are freely available on public databases, and searching the title from a product page usually finds it in seconds.
What is the summary?
Design, size, population, outcome and funding. Five questions, two minutes, and a considerably better basis for deciding than the product page.
This article is general information and not medical advice.
What about conflicting studies?
Individual studies disagree routinely, which is normal rather than a sign that nothing can be known.
The weight of evidence across multiple good quality studies is what matters, not any single result.
What is publication bias?
The tendency for studies finding an effect to be published while those finding nothing are not.
This makes the published literature systematically more favourable than the underlying reality.
Is this too much work?
For most purchases, yes, and the checks are worth doing for anything expensive, anything taken long term, or anything making strong claims.
What is the summary?
Design, size, population, outcome and funding. Five questions, two minutes, and a considerably better basis for deciding than any product page.
What about the conclusion section?
Conclusions frequently overstate what the results showed, particularly in industry funded work.
Reading the results rather than the conclusion is worth the extra minute.
What about press coverage?
News reports of single studies routinely overstate findings, and headlines rarely reflect the size or certainty of a result.
Reading the study rather than the coverage is a considerable improvement.
What about study registries?
Pre-registration records what a study intended to measure before it began, which prevents selective reporting afterwards.
Registries are public and searchable.
Absence of registration for a recent trial is worth noticing.
What about systematic reviews?
Well conducted systematic reviews assess all available studies against explicit criteria and are among the more useful sources for a general reader.
They also state their limitations clearly, which individual papers often do not.
Cochrane reviews are a reasonable starting point where one exists.
Is this worth doing every time?
No. It is worth doing for anything expensive, anything taken long term, or anything making unusually strong claims.
For a basic vitamin D supplement it would be disproportionate.
Judgement about when to check is part of the skill.
The skill transfers well beyond supplements once developed.
Two minutes of checking the source beats any amount of marketing copy on a product page.