Prerequisites
Close reading of methods, variables, indicators, and research claims.
Identify the construct, the measurement rule, and the interpretation connecting them. Reproducible coding supports consistency, but a consistently measured proxy may still miss important aspects of the intended construct.
Worked example
A count of words written measures output volume directly. It does not by itself establish argument quality, originality, or comprehension, even when the counting procedure is perfectly repeatable.
Model and Assumptions
Fictional report: a reading platform calls a student 'engaged' if the lesson tab is open for at least ten minutes. It records neither focus nor responses. Two coders reproduce the open-tab labels exactly. The report concludes that labeled students understood the text deeply.
Further inquiry
Rewrite the report's claim, then propose two complementary indicators of comprehension. Specify how each could fail and how you would examine the validity of the combined interpretation without treating any one score as a complete definition.
Review criteria
- Separate the construct, indicator, and decision threshold.
- Discuss both consistent measurement and justified interpretation.
- Name plausible alternative explanations for each proposed indicator.