Check Whether the Method Supports the Conclusion - Practice 1

Read a study description for who was included, what was measured and how comparison conditions were assigned.

All worksheets

5 questions0m 0s

Learn the skill

Read a study description for who was included, what was measured and how comparison conditions were assigned. A conclusion should not silently exceed those design limits. All data here are invented for reading practice.

Worked example

A one-day trial with one volunteer group can describe that trial. It cannot alone prove a method works for every learner all year.

Would you believe it?

A study of experienced users on one task does not automatically describe beginners on every task.

Original fiction: The Revised Instruction Card

In a fictional pilot, twelve volunteers used an old instruction card on Monday and a revised card on Tuesday. Errors were fewer on Tuesday. Everyone encountered the same task in the same order, and there was no separate comparison group. Familiarity with the task may therefore have contributed. The report proposes testing order effects before claiming that the new wording caused the improvement.

Question 1 Which feature creates an order concern? Everyone used old then revised cards. The task was never repeated. Different random groups used each card.

Question 2 What result was observed? proof of a universal benefit equal familiarity on both days fewer errors on Tuesday

Question 3 Which alternative influence is identified? an unreported year of training familiarity with the repeated task the volunteers' shoe sizes

Question 4 What would overstate the pilot? The revised wording alone caused the improvement. Errors were fewer on the second day. Twelve volunteers participated.

Question 5 What next step does the report propose? declare the conclusion final remove all recordkeeping test order effects

Review your work

0correct

Complete the questions to review each answer.

View dashboard