← All technology pathways
FROM A CLAIM TO CHECKABLE EVIDENCE

Data & responsible AI

Investigate a dataset, compare a simple rule with an AI approach and produce an honest evidence card.

Look closer. Ask a better question.What can you observe, and what are you only assuming?Illustrated learning characters · fictional scene
STARTER MATERIAL / FICTIONAL SCENARIO

Make a first version.

day,litres,attendance,period
1,1000,100,before
2,950,95,before
3,1080,108,before
4,750,60,after
5,800,64,after
6,875,70,after
7,820,,after
8,900,0,after

Copy this into your chosen tool or trace it on paper. Do not enter passwords, private learner data or API keys.

STAGE 1 / 6

Define the question and the rows

A dataset needs a unit of observation. Here each row is a day, not an individual. A data dictionary records what a column means, its unit and possible missing values.

Build & try

Copy the CSV starter into a spreadsheet or a paper table. Define every column and write one question the table can answer. Label the dataset fictional.

Show that it works

Your question fits the data. You do not claim to know any individual’s water use.

STAGE 2 / 6

Clean without hiding decisions

Missing and zero are different. A zero denominator makes litres per learner undefined. Keep raw data intact and record each cleaning decision so another person can reproduce it.

Build & try

Make a working copy. Flag rows 7 and 8, then exclude their ratios with a reason. Calculate litres/attendance for rows 1–6. Use the foundation data lab to check.

Show that it works

The six valid ratios are 10,10,10,12.5,12.5,12.5. Excluded rows remain visible in a cleaning log.

STAGE 3 / 6

Visualise and qualify a claim

An axis, unit and scale influence how a chart is read. A before/after difference is not proof that an intervention caused it. Confounders could change both timing and outcome.

Build & try

Draw total litres and litres/learner as separate labelled charts. Calculate the 25% increase in the latter. Name one confounder and revise the original ‘water saving’ claim.

Show that it works

Your chart is traceable to the table; your conclusion does not assert unsupported causation.

STAGE 4 / 6

Start with a rule baseline

A baseline is a simple method against which complexity is compared. A fixed FAQ lookup may outperform a generative answer on a small factual pack. Unknown should remain unknown.

Build & try

Use the fictional River Club pack in mission 7. Write a lookup rule for time, cost and joining. Test known, missing and conflicting questions. Compare it with supplied AI outputs; live AI is optional.

Show that it works

Your comparison scores correctness, source support and uncertainty separately, including a case where no answer is available.

STAGE 5 / 6

Separate development from evaluation

If you tune a rule using every test question, the score can overstate performance on unfamiliar questions. Reserve fresh cases before revising. Small samples cannot prove fairness or universal accuracy.

Build & try

Prepare ten fictional questions. Use six to improve your method and reserve four. Report the two scores separately. Include varied phrasing and a question that the source cannot answer.

Show that it works

You disclose which questions influenced your changes, report errors, and avoid claiming a small sample proves fairness.

STAGE 6 / 6

Build an evidence card

An evidence card describes intended use, data, method, evaluation and limitations. It helps another person decide whether the result fits a new context.

Build & try

Choose a new public aggregate or fictional dataset. Produce the question, dictionary, cleaning log, chart, rule baseline, fresh-case test and human-review boundary. Python is an optional extension after you can explain the table method.

Show that it works

A reviewer can reproduce your analysis without a paid model, and can identify at least one situation where your method should not be used.

A DIFFERENT WAY TO TRY IT

Make the idea your own.

Choose a twist. Use paper, a sketch or a conversation.

Optional practice. Copy useful observations into your workbook; choosing a twist does not record completion.

Compare ideas with someone you know. Sharing is optional.