EduKG
← Back

Judging evidence against a hypothesis

Learning objectives

  • Outcome

    Compute the discrepancy Δ=xmeas−xtheor\Delta = x_{\text{meas}} - x_{\text{theor}} and the ratio ∣Δ∣/u|\Delta|/u from a given hypothesis prediction and a measurement with uncertainty.

  • Outcome

    Classify the comparison result as consistent (∣Δ∣≲u|\Delta| \lesssim u) or conflicting (∣Δ∣>3u|\Delta| > 3u) and state the conclusion in words.

  • Outcome

    Process a series of measurements: find the mean and the standard uncertainty of the mean u=s/nu = s/\sqrt{n}, then compare them with the hypothesis prediction.

  • Outcome

    Choose between two competing hypotheses using the same data and explain why agreement is not proof.

Understand the idea

Judging Evidence Against a Hypothesis: Does the Model Match the Measurements?

Text

A hypothesis is a statement from which testable numerical predictions follow; the scientific question fixes exactly which prediction we compare with the data.

To judge consistency, compare the prediction xtheorx_{\text{theor}} with the measurement result xmeas±ux_{\text{meas}} \pm u, where uu is the standard uncertainty of the measurement. The key quantities are the discrepancy (residual) Δ=xmeas−xtheor\Delta = x_{\text{meas}} - x_{\text{theor}} and its ratio to the uncertainty, ∣Δ∣/u|\Delta|/u. If ∣Δ∣≲u|\Delta| \lesssim u, the data are consistent with the hypothesis; if ∣Δ∣>3u|\Delta| > 3u, the hypothesis is under serious tension. For several measurements, first find the mean and the standard uncertainty of the mean u=sn,u = \frac{s}{\sqrt{n}}, and then compare it with the prediction. Agreement between data and hypothesis never proves it: agreement only means the hypothesis has not yet been refuted, whereas a large discrepancy is a strong argument against it. Before concluding that a hypothesis is refuted, check systematic effects and whether the uncertainty itself is correct.

Worked examples

Direct

Problem

A hypothesis predicts a pendulum period Ttheor=2.00T_{\text{theor}} = 2.00 s. One measurement gives Tmeas=2.04T_{\text{meas}} = 2.04 s with standard uncertainty u=0.01u = 0.01 s. Are the data consistent with the hypothesis?

Solution

Discrepancy: Δ=2.04−2.00=0.04 s.\Delta = 2.04 - 2.00 = 0.04 \text{ s}. Compare with the uncertainty: ∣Δ∣u=0.040.01=4.\frac{|\Delta|}{u} = \frac{0.04}{0.01} = 4. This is larger than 3u3u: the discrepancy is too large to be explained by the random scatter of a single measurement. Conclusion: the data agree poorly with the hypothesis. Before discarding the hypothesis, check systematic effects — the pendulum length, the number of counted oscillations, and the start/stop timing of the stopwatch.

Application

Problem

Three independent measurements of the fall time from height h=5.00h = 5.00 m gave 1.011.01, 0.990.99 and 1.001.00 s. The hypothesis states free fall with no initial velocity: ttheor=2h/gt_{\text{theor}} = \sqrt{2h/g} with g=9.81g = 9.81 m/s$^2$. Are the data consistent with the hypothesis?

Solution

Prediction: ttheor=2⋅5.009.81=1.019=1.01 s.t_{\text{theor}} = \sqrt{\frac{2 \cdot 5.00}{9.81}} = \sqrt{1.019} = 1.01 \text{ s}.

Mean: tˉ=1.00\bar{t} = 1.00 s. Standard deviation s≈0.010s \approx 0.010 s, standard uncertainty of the mean: u=sn=0.0103≈0.006 s.u = \frac{s}{\sqrt{n}} = \frac{0.010}{\sqrt{3}} \approx 0.006 \text{ s}.

Discrepancy Δ=1.00−1.01=−0.01\Delta = 1.00 - 1.01 = -0.01 s, ratio ∣Δ∣u≈0.010.006≈1.7.\frac{|\Delta|}{u} \approx \frac{0.01}{0.006} \approx 1.7. This is less than 2u2u, so the data are consistent with the hypothesis. But the discrepancy is borderline: increase the number of measurements and check systematic effects (accuracy of the height, reaction time at start and stop).

Transfer

Problem

There are two competing hypotheses about the pendulum period: A) T∝LT \propto L; B) T∝LT \propto \sqrt{L}. Measurements: at L=1.00L = 1.00 m, T=2.00±0.02T = 2.00 \pm 0.02 s; at L=4.00L = 4.00 m, T=4.01±0.04T = 4.01 \pm 0.04 s. Which hypothesis agrees better with the data?

Solution

Hypothesis A: T∝LT \propto L, so TA(4.00)=4⋅T(1.00)=8.00 s.T_A(4.00) = 4 \cdot T(1.00) = 8.00 \text{ s}. The discrepancy is ΔA=4.01−8.00=−3.99\Delta_A = 4.01 - 8.00 = -3.99 s with u≈0.04u \approx 0.04 s, that is ∣ΔA∣u≈100≫3.\frac{|\Delta_A|}{u} \approx 100 \gg 3. Hypothesis A decisively conflicts with the data.

Hypothesis B: T∝LT \propto \sqrt{L}, so TB(4.00)=2⋅T(1.00)=4.00 s.T_B(4.00) = 2 \cdot T(1.00) = 4.00 \text{ s}. The prediction carries uncertainty upred=2⋅0.02=0.04u_{\text{pred}} = 2 \cdot 0.02 = 0.04 s, giving a combined uncertainty u=0.042+0.042≈0.06 s.u = \sqrt{0.04^2 + 0.04^2} \approx 0.06 \text{ s}. The discrepancy is ΔB=4.01−4.00=0.01\Delta_B = 4.01 - 4.00 = 0.01 s, ratio ∣ΔB∣u≈0.2≪1.\frac{|\Delta_B|}{u} \approx 0.2 \ll 1. The data agree fully with B.

Conclusion: the measurements support B and reject A. This does not prove B definitively: B is merely not refuted, and it should be tested at other lengths and with better precision.

Practice

Text

Self-check of a hypothesis in a pendulum simulation (for example, the PhET Pendulum Lab).

  1. State the hypothesis: T=2πL/gT = 2\pi\sqrt{L/g} with g=9.81g = 9.81 m/s$^2$, and the question: "Are the data consistent with this formula?"
  2. Choose three lengths, for example 0.500.50, 1.001.00 and 1.501.50 m.
  3. For each length, measure the time of 10 full oscillations and divide by 10 — this reduces random error; repeat the measurement 3 times and find the mean and u=s/nu = s/\sqrt{n}.
  4. Compute the prediction, the discrepancy Δ\Delta and the ratio ∣Δ∣/u|\Delta|/u for each length.
  5. Write the conclusion in words: where the data agree, where the discrepancy exceeds 3u3u; explain why agreement does not prove the hypothesis.

Use the simulation rather than household measurements: a hand-held stopwatch is imprecise, while the simulation lets you separate random scatter from a systematic discrepancy.

Visual reference

Purpose

Show that judging a hypothesis depends not only on the size of the discrepancy but also on the measurement uncertainty: the same Δ\Delta can be either "agreement" or "conflict".

Representation

A diagram on a number line: the prediction xtheorx_{\text{theor}} is marked as a vertical line (with no uncertainty band of its own), and three measurement results are drawn as points with ±u\pm u bars. Case 1: the bar comfortably covers xtheorx_{\text{theor}}, ∣Δ∣≪u|\Delta| \ll u — agreement, ∣Δ∣/u≪1|\Delta|/u \ll 1. Case 2: the bar only just touches xtheorx_{\text{theor}} with its edge, ∣Δ∣≈u|\Delta| \approx u — borderline agreement, ∣Δ∣/u≈1|\Delta|/u \approx 1. Case 3: the bar is far from xtheorx_{\text{theor}}, ∣Δ∣>3u|\Delta| > 3u — conflict, ∣Δ∣/u>3|\Delta|/u > 3. Beside it, the formula ∣Δ∣/u|\Delta|/u with labelled values for each case.

Real-world examples

Sprint timing: is $8.0\ \text{m/s}$ supported?

Scenario

A coach claims the runner averages 8.0 m/s8.0\ \text{m/s} over 100 m100\ \text{m}. Three electronic timings give 12.6 s12.6\ \text{s}, 12.8 s12.8\ \text{s}, and 12.7 s12.7\ \text{s}. The mean is 12.7 s12.7\ \text{s}, so the mean speed is 100/12.7=7.87 m/s100/12.7 = 7.87\ \text{m/s}. Repeated runs scatter by about ±0.1 s\pm 0.1\ \text{s}.

Connection

The judgement rule: the discrepancy 8.0−7.87=0.13 m/s8.0-7.87=0.13\ \text{m/s} must be compared with the uncertainty. A timing spread of ±0.1 s\pm 0.1\ \text{s} at 12.7 s12.7\ \text{s} corresponds to roughly ±0.06 m/s\pm 0.06\ \text{m/s} in speed. The discrepancy is about twice the uncertainty, so the claim is not clearly supported and more trials are needed.

Phone pendulum: checking $g$ against $9.81\ \text{m/s}^2$

Scenario

A phone times 10 swings of a 0.50 m0.50\ \text{m} pendulum: T=1.42 sT=1.42\ \text{s} per swing. The model T=2πL/gT=2\pi\sqrt{L/g} with g=9.81 m/s2g=9.81\ \text{m/s}^2 predicts T=1.42 sT=1.42\ \text{s}. Rearranging gives g=4π2L/T2=9.8 m/s2g=4\pi^2 L/T^2 = 9.8\ \text{m/s}^2. Reaction-time scatter in timing gives ±0.02 s\pm 0.02\ \text{s} in TT.

Connection

Judging evidence here uses the model prediction versus measurement and uncertainty propagation. The measured g=9.8 m/s2g=9.8\ \text{m/s}^2 differs from 9.81 m/s29.81\ \text{m/s}^2 by 0.01 m/s20.01\ \text{m/s}^2. A ±0.02 s\pm 0.02\ \text{s} uncertainty in TT gives about ±0.3 m/s2\pm 0.3\ \text{m/s}^2 in gg; the discrepancy is far smaller, so the hypothesis is consistent with the data. If TT were 1.60 s1.60\ \text{s}, gg would be 7.7 m/s27.7\ \text{m/s}^2, a discrepancy of 2.1 m/s22.1\ \text{m/s}^2 that would force rejection or search for a systematic error.

Kettle boiling point: testing $100\ ^\circ\text{C}$

Scenario

A kitchen thermometer reads the boiling water as 98.2 ∘C98.2\ ^\circ\text{C}, 98.5 ∘C98.5\ ^\circ\text{C}, and 98.1 ∘C98.1\ ^\circ\text{C}; mean 98.3 ∘C98.3\ ^\circ\text{C}. The thermometer's stated accuracy is ±0.5 ∘C\pm 0.5\ ^\circ\text{C}. The local altitude is about 500 m500\ \text{m}.

Connection

Judging evidence against the hypothesis T=100 ∘CT=100\ ^\circ\text{C}: the discrepancy is 100−98.3=1.7 ∘C100-98.3=1.7\ ^\circ\text{C}, which is 3.43.4 times the ±0.5 ∘C\pm 0.5\ ^\circ\text{C} uncertainty, so the simple hypothesis is rejected. Because altitude is about 500 m500\ \text{m}, the expected boiling point is near 98.3 ∘C98.3\ ^\circ\text{C}; the evidence supports the revised hypothesis that pressure, not just heat, sets the boiling temperature.