Reading note / Coverage
Ask who
is represented.
Research often describes a selected set of people, events, or records. Understanding how that set was selected helps you judge where the findings may apply.
Identify the group of interest.
Separate the group a study wants to understand from the group it actually reached. A survey of newsletter readers, for example, may describe engaged readers more directly than everyone who could use a service.
Look for the selection method, the invitation route, and the criteria for inclusion. The number of responses matters, but a large response total does not remove a gap in who was invited or who was able to take part.
Notice who may be absent.
A collection method can make participation easier for some people than others. An online invitation may miss people who rarely use that channel. A daytime interview schedule can exclude people who are unavailable during working hours.
These are reasons to examine coverage, not to assume every study is unusable. Ask whether the researchers identified those limitations, offered other routes where appropriate, and explained the group their results actually describe.
Keep individual accounts in proportion.
Detailed accounts can explain experiences, motivations, and problems that a total cannot capture. They should not automatically be used to estimate how common an experience is across a much larger group.
Imagine a hypothetical discussion with people who recently stopped using a community noticeboard. Their accounts might identify confusing categories or outdated information. They would not, on their own, show what proportion of all local residents share those concerns. A useful summary keeps the depth of those accounts while making the limits of the selection clear.