← Open the interactive adventure

AI Learning Adventure II

A complete study guide with 18 chapters, six realistic missions and practical exercises for learning with AI while keeping your own thinking visible.

Use your browser’s Print command to print this guide or save a PDF. All mission situations and data are fictional. Work through decisions before reading their consequences. Written work is self-assessed; completion is not an externally assessed qualification.

Field guide contents

  1. Define a question that evidence can answer
  2. Build a source comparison table
  3. Write conclusions with calibrated language
  4. Describe a failure reproducibly
  5. Choose a test that separates explanations
  6. Check the fix beyond the original case
  7. Separate constraints from preferences
  8. Test whether the recommendation is stable
  9. Design a reversible pilot
  10. Explain a concept at two levels
  11. Use a question that reveals a misconception
  12. Give feedback that creates a next action
  13. Integrate AI feedback without surrendering judgment
  14. Check for omitted cases
  15. Make a handoff another person can use
  16. Compare performance with support made visible
  17. Challenge your favourite explanation
  18. Plan a transfer portfolio

Research / CHAPTER 1

Define a question that evidence can answer

Separate the decision you need to make from the evidence that would inform it.

A broad question such as “Which programme works best?” hides the outcome, audience and conditions. Name what success means and what comparison would matter. Then distinguish an answerable question from an assumption or preference. AI can help generate questions, but it cannot supply missing observations by writing confidently. If the evidence you need does not exist, plan a small way to collect it or make a more limited decision.

Worked example

A club wants to choose a workshop format. The useful question is not whether online learning is universally better, but whether its own beginners can complete a defined task with the available support.

Practice task

Write your decision, one measurable outcome and the evidence that could change your mind.

A common trap

Gathering a large pile of interesting information that does not answer the decision question.

Research / CHAPTER 2

Build a source comparison table

Compare sources by what they measured, not only by which conclusion sounds strongest.

Record the population, task, outcome, collection method and limitation for each source. Sources can disagree because they asked different questions. Before resolving a conflict, check whether there is a conflict at all. A source may be credible yet irrelevant to your precise claim. Keep your table short enough that you can explain why each source is included.

Worked example

One fictional report counts attendance, while another tests independent performance. A high attendance rate does not contradict a low completion rate; they describe different outcomes.

Practice task

Compare two supplied or independently verified sources using population, task, outcome and limitation.

A common trap

Treating two percentages as directly comparable without checking their denominators or definitions.

Research / CHAPTER 3

Write conclusions with calibrated language

Make the strength of your wording match the strength and scope of your evidence.

Distinguish observed results, possible explanations and recommendations. “In this group” is different from “for everyone.” “Associated with” is different from “caused by.” Specific limits make a statement more useful, not necessarily weaker. If evidence is missing, name the missing piece and explain whether it prevents a decision or merely suggests a reversible next step.

Worked example

Eight of ten volunteers finished a task after receiving support. You can report completion in that group. You cannot infer that every future learner will finish, or that the support alone caused the result.

Practice task

Write a conclusion in three sentences: observation, limitation and next step.

A common trap

Using cautious-sounding words while keeping an unsupported universal claim underneath.

Diagnose / CHAPTER 4

Describe a failure reproducibly

A useful problem report states the input, expected result, actual result and conditions.

Replace “it does not work” with a small example someone else can repeat. Remove unrelated details, but keep conditions that might affect the failure. If AI suggests a cause, treat it as a hypothesis until a test distinguishes it from alternatives. Reproducibility turns troubleshooting from a stream of guesses into a sequence of informative checks.

Worked example

A training handout works for facilitators but not new learners. The report identifies the exact step where beginners stop, the instruction they see and the action they think is expected.

Practice task

Write a failure report with one concrete input, an expected outcome and what happened instead.

A common trap

Changing several things before recording the original failure, then losing the ability to explain the fix.

Diagnose / CHAPTER 5

Choose a test that separates explanations

The best next test is one whose result would help you distinguish plausible causes.

List two or three hypotheses and predict what you would observe if each were true. Prefer a small, reversible test. A test that produces the same result under every hypothesis may be easy but uninformative. After the test, update your explanation rather than collecting only confirmations. Keep uncertainty where the result cannot separate the remaining causes.

Worked example

If learners fail either because instructions are unclear or because a prerequisite is missing, ask them to explain the instructions before solving the task. This checks interpretation separately from performance.

Practice task

Write two possible causes and a test with different predicted outcomes for each.

A common trap

Running a familiar test repeatedly even though it cannot discriminate between your explanations.

Diagnose / CHAPTER 6

Check the fix beyond the original case

A repair should solve the original failure without introducing a new one nearby.

Use a small test set: the original case, a normal case and a boundary case. Explain what the change affects and what remains untested. Do not mistake one successful run for a general guarantee. If a new failure appears, inspect whether the fix changed a hidden assumption. Keep a simple fallback when the cost of a failed rollout is high.

Worked example

A revised checklist handles missing answers, but it also rejects a valid answer of zero. A boundary test reveals that “blank” and “zero” were treated as the same value.

Practice task

Name an original, normal and boundary case for a repair you propose. State the expected result of each.

A common trap

Testing only the example that motivated the change and overlooking adjacent cases.

Decide / CHAPTER 7

Separate constraints from preferences

A constraint determines whether an option is feasible. A preference helps compare feasible options.

Check non-negotiable requirements first. Only then compare convenience, appearance or other preferences. If every option fails a constraint, make the conflict visible instead of inventing a winner. Ask which requirement, resource or deadline can change. A decision can be useful even when its conclusion is “we need one more answer before proceeding.”

Worked example

A venue with excellent equipment cannot meet a workshop requirement if it is unavailable at the required time. Its attractive features do not offset the feasibility failure.

Practice task

List two constraints and three preferences for a real decision. Check whether you have accidentally mixed the categories.

A common trap

Adding up preference points until an infeasible option appears to win.

Decide / CHAPTER 8

Test whether the recommendation is stable

A recommendation is more useful when you know what would make it change.

Identify the uncertain input that matters most. Compare the options under a plausible alternative value. If the preferred option changes easily, the decision is sensitive: seek better evidence, use a pilot or make a reversible choice. Do not report invented precision as certainty. Explain which assumptions carry the recommendation.

Worked example

A team prefers a longer session only if most learners can attend the full slot. If attendance availability is unknown, a short availability check may be more valuable than refining the slide deck.

Practice task

Name one uncertain assumption and rewrite your recommendation under the opposite plausible condition.

A common trap

Keeping the same recommendation after changing the assumption that originally justified it.

Decide / CHAPTER 9

Design a reversible pilot

When evidence is limited, choose a small trial with a learning question and an exit rule.

A pilot is not simply a small launch. Specify what it will test, who will participate, how you will judge the result and what happens next. Include a stopping or revision condition. Keep the trial’s size proportional to the decision it can inform. A successful pilot may justify a larger test, not necessarily immediate full adoption.

Worked example

A club trials one new workshop format with a small group, checks an independent task and asks about accessibility before scheduling the rest of the series.

Practice task

Write a pilot question, success criterion, revision trigger and next decision.

A common trap

Calling a trial successful because it ran, without measuring the outcome that motivated it.

Teach / CHAPTER 10

Explain a concept at two levels

A clear explanation connects a concrete example to the general principle without confusing them.

Begin with a situation the learner can inspect. Then name the rule that explains it. Check which details belong to the example and which are essential to the principle. Ask the learner to explain the rule using a different example. AI can propose analogies, but you should test where the analogy stops matching the concept.

Worked example

A recipe analogy can illustrate a procedure, but it may hide cases where a process requires feedback and revision. State that limitation rather than forcing every detail to fit.

Practice task

Explain a concept first with a small example, then in two general sentences. Add one limitation of the example.

A common trap

Assuming an entertaining analogy is automatically accurate or sufficient.

Teach / CHAPTER 11

Use a question that reveals a misconception

A diagnostic question should expose reasoning, not only whether someone can recognise a familiar phrase.

Choose a tempting wrong answer that reflects a specific misconception. Ask for the reason, not just the option. A correct selection with an incorrect explanation may indicate guessing. Feedback should address the underlying rule and lead to a fresh attempt. Avoid trick wording that measures reading endurance rather than the concept.

Worked example

To test understanding of percentage change, ask whether a 20% rise followed by a 20% fall returns to the start, and require an example. The reasoning reveals whether the learner tracks the base.

Practice task

Write a diagnostic question, a plausible misconception and feedback that targets it.

A common trap

Writing distractors so absurd that learners can select the right answer without understanding the topic.

Teach / CHAPTER 12

Give feedback that creates a next action

Feedback becomes useful when the learner knows what to change and gets another chance to try.

Identify one consequential gap, connect it to a criterion and suggest a small action. Preserve accurate parts of the attempt. Ask the learner to make the revision rather than simply accepting your replacement. Then use a new example to see whether the correction transferred. Tone matters, but encouragement without information cannot explain how to improve.

Worked example

Instead of “unclear summary,” say “your conclusion names all attendees, but only respondents supplied views; revise the population phrase and explain the denominator.”

Practice task

Write feedback on an imperfect example: one strength, one specific gap and one next attempt.

A common trap

Correcting everything at once or rewriting the entire artifact so the learner cannot see the key change.

Review / CHAPTER 13

Integrate AI feedback without surrendering judgment

Treat feedback as proposals to inspect against your goal, evidence and constraints.

AI may improve wording while changing facts, removing uncertainty or adding requirements. Compare each important suggestion with the original brief. Adopt, adapt or reject it with a reason. If you cannot evaluate a technical suggestion, create a small test or consult a suitable original reference before relying on it. Record one rejected suggestion as evidence of your judgment.

Worked example

An assistant changes “we recommend” to “we have approved.” The revised sentence is smoother but factually different, so the learner restores the decision status.

Practice task

Take three feedback suggestions and label them adopt, adapt or reject, with a reason for each.

A common trap

Assuming a more polished version is always a more accurate one.

Review / CHAPTER 14

Check for omitted cases

Ask who or what is missing from your examples, data and proposed workflow.

A process can work for the typical case while failing for a legitimate variation. Identify cases that matter to the outcome: absent information, changed circumstances, different access needs or repeated requests. You do not need every imaginable exception, but you should explain the boundaries of your test set. Use fictional data for early checks where it is sufficient.

Worked example

An exercise assumes every learner has a personal device. A paper option preserves the core task when that assumption does not hold.

Practice task

List three relevant cases absent from your first draft and add a test or fallback for each.

A common trap

Confusing a large set of similar examples with broad coverage of different failure modes.

Review / CHAPTER 15

Make a handoff another person can use

A handoff needs enough context for someone to operate the result without guessing your intentions.

Include purpose, inputs, essential steps, expected outputs and known limits. Distinguish instructions from background explanation. Ask a reader to perform a small task using only the handoff, then observe where they hesitate. Those gaps are more informative than a vague request to say whether the document looks clear.

Worked example

A checklist says “confirm the result” but does not define confirmation. A better version names the expected total, how to calculate it and where to record a discrepancy.

Practice task

Write a five-line handoff and ask what a new user could misunderstand in each line.

A common trap

Leaving crucial decisions in your head because the workflow feels obvious to its creator.

Independence / CHAPTER 16

Compare performance with support made visible

An improvement claim needs to distinguish your own ability from the help you received.

Record task difficulty, time, hints and access to reference material. A faster result with extensive assistance may be useful productivity evidence, but it is not the same as unaided skill. Choose a comparable fresh task for an independent check. Report both what you can do and where support still helps. This gives a more actionable picture than a single completion score.

Worked example

A learner produces a strong report with AI editing, then writes a shorter report on new data without editing support. The two attempts answer different questions about productivity and independence.

Practice task

Compare two attempts and list the support available in each. State one conclusion the comparison does and does not justify.

A common trap

Calling every improvement in an assisted artifact an equal improvement in independent capability.

Independence / CHAPTER 17

Challenge your favourite explanation

Look for evidence that could change your current view, not only examples that reinforce it.

Write your best explanation and one plausible alternative. Identify an observation that would be difficult for your favourite explanation to account for. Try to obtain that observation through a relevant test or source. If the result is mixed, narrow your claim. This is an ongoing habit of revision, not a requirement to distrust every useful conclusion.

Worked example

A facilitator thinks shorter instructions caused better task completion, but the second group also had more prior experience. A new comparison should consider both explanations.

Practice task

Write your preferred explanation, a rival explanation and a discriminating observation.

A common trap

Collecting more examples from the same narrow situation and calling the repetition independent confirmation.

Independence / CHAPTER 18

Plan a transfer portfolio

Demonstrate the skill across a small set of meaningful variations and explain its limits.

Choose a near example, a changed constraint and a case where the usual method should not be applied directly. Record your reasoning and any help you needed. The portfolio should show decisions, corrections and boundaries, not just finished outputs. Use it to choose the next practice target rather than to claim expertise across an entire field.

Worked example

A learner interprets one survey, compares two surveys with different response rates and declines an unsupported claim about people who never responded. The boundary case is part of the evidence.

Practice task

Choose three variations for your capstone and define what a sound response would include.

A common trap

Treating one successful familiar task as proof that every harder or different task will be easy.

Mission workbook

MISSION 1 / Research synthesiser

The reports that appear to disagree

Two fictional reports inform a training decision. One measures attendance and the other measures task completion. Build a conclusion without pretending they answer the same question.

Deliverable

A comparison table and a three-sentence recommendation.

Quality criteria

Name each outcome and population. Avoid a causal or universal claim. Identify the next useful evidence.

Decision 1: Compare like with like

Report A: 24 of 30 invitees attended an online session. Report B: 12 of 20 attendees at a separate in-person session completed an independent task.

Which comparison is valid?

  1. Online is better because 80% exceeds 60%.
  2. The reports measure different outcomes and cannot directly rank learning effectiveness.
  3. Neither report contains any useful information.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Your ranking mixes attendance with performance. The next step is to align the outcome before comparing formats.
  2. You preserve both observations while avoiding a misleading ranking. Now identify the evidence needed for the actual decision.
  3. Each report still answers a limited question. Rejecting both loses information that can help design a better comparison.

Practice: Calculate both percentages and write what each does and does not measure.

Hint ladder

  1. Name the denominator and the outcome separately.
  2. 24/30 measures attendance among invitees; 12/20 measures task completion among attendees.
  3. The rates are 80% attendance and 60% task completion. They cannot establish which format produces better learning.

Decision 2: Ask the missing question

The organiser wants beginners to complete a specific task without help. Time and access conditions differ between the two sessions.

What should you seek next?

  1. A longer promotional description of the online session.
  2. A ranking based on whichever number is larger.
  3. Comparable independent-task results, with audience and support conditions recorded.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Promotion may describe features but does not supply the missing performance evidence.
  2. A ranking still hides the mismatch in outcomes and conditions.
  3. You now have an evidence request aligned with the real learning goal. Differences in participants and support still need consideration.

Practice: Write a fair comparison plan with one outcome and three conditions to record.

Hint ladder

  1. Start with the task learners must perform.
  2. Record prior experience, support available and time as well as the common task.
  3. Use comparable fresh tasks and a shared scoring rule; record participants, time and support. A simple comparison still may not isolate the cause of a difference.

Decision 3: Recommend under uncertainty

Only one small pilot can be run before the next planning meeting.

What is the strongest recommendation?

  1. Run a feasible pilot, measure the intended skill and state that format superiority is unresolved.
  2. Commit to a year of one format because the original numbers look decisive.
  3. Refuse to make any small decision until all uncertainty disappears.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. A limited pilot can inform the next decision without claiming to settle every comparison.
  2. The size of the commitment exceeds what the supplied evidence supports.
  3. Complete certainty is not necessary for a reversible learning step.

Practice: Write the observation, limitation and pilot recommendation in three sentences.

Hint ladder

  1. Separate what was observed from what you propose.
  2. State that attendance and task completion are different measures.
  3. Report the two limited observations, explain the mismatch and recommend a pilot with a common independent task and recorded support conditions.

Independent variation

A pilot reports 9 completions out of 12 beginners, but four used extra hints. What additional breakdown would help interpret independent performance?

Review criteria

Report 75% total completion without labelling it fully independent. Ask which completions used hints; total hints and total completions alone do not identify the unaided completion count.

Record your final artifact, your independent variation and what you can now explain. Note any support you used.

MISSION 2 / Troubleshooting partner

The instructions that worked only for the author

A fictional worksheet works for its designer, but new learners stop at the first calculation. Diagnose the difficulty before rewriting everything.

Deliverable

A reproducible failure report, a discriminating test and a revised instruction.

Quality criteria

Distinguish understanding the instruction from knowing the calculation. Test more than one case.

Decision 1: State the failure

The worksheet says “normalise the values” without defining the operation. Beginners interpret that phrase differently.

What should you record first?

  1. The exact instruction, a sample input, the expected operation and the learners’ interpretations.
  2. That beginners are not trying hard enough.
  3. An entirely new worksheet without retaining the failure example.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. You make the ambiguity inspectable. A small test can now separate wording confusion from a prerequisite gap.
  2. A judgment about effort does not explain the observed interpretations.
  3. A rewrite may help by accident but hides what caused the failure.

Practice: Write a failure report for fictional values 2, 3 and 5, where the intended operation is dividing each by their total.

Hint ladder

  1. State the operation instead of relying on the undefined term.
  2. The total is 10; the intended outputs are fractions of that total.
  3. Input: 2, 3, 5. Expected: 0.2, 0.3, 0.5. Actual: learners use different operations because “normalise” is unspecified.

Decision 2: Separate two causes

You suspect either unclear wording or unfamiliarity with division.

Which test is most informative?

  1. Repeat the same undefined instruction louder.
  2. Ask learners to explain the instruction, then try a clearly worded division example.
  3. Change wording, numbers and task all at once.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Volume does not resolve the definition or reveal the prerequisite skill.
  2. You can inspect interpretation and arithmetic separately, although one test may not settle every cause.
  3. If performance changes, you will not know which change mattered.

Practice: Predict what you would see under each of the two explanations.

Hint ladder

  1. A wording problem and a calculation problem can produce different responses.
  2. Correct division with clearer wording suggests interpretation mattered.
  3. If learners explain the old wording differently but divide correctly when told the operation, wording is implicated. If they still cannot divide, prerequisite practice may also be needed.

Decision 3: Test the boundary

Your new instruction says to divide every value by the total. A new test uses 0, 0 and 0.

What should the worksheet do?

  1. Display three invented fractions so the worksheet looks complete.
  2. Ignore the case because the original numbers worked.
  3. Flag the zero total and explain that this operation is undefined there.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Invented fractions hide a mathematical boundary.
  2. The boundary reveals a condition your instruction needs to state.
  3. The repair now includes the condition under which the operation is valid.

Practice: Write the revised instruction and expected results for a normal and zero-total case.

Hint ladder

  1. Check whether division by the total is possible.
  2. The total must be nonzero for this operation.
  3. “Add the values. If the total is nonzero, divide each value by it; if the total is zero, stop and inspect the input.” For 2,3,5 expect 0.2,0.3,0.5; for 0,0,0 flag the undefined operation.

Independent variation

A later input is -2, 1 and 1. Its total is zero although not every value is zero. Revise any check that looked only for all-zero inputs.

Review criteria

Test the actual total, not merely whether every value equals zero. Also ask whether negative values are meaningful in the intended application.

Record your final artifact, your independent variation and what you can now explain. Note any support you used.

MISSION 3 / Decision designer

The attractive option that cannot work

A fictional team must choose a venue for a 20-person workshop on Tuesday. Compare feasibility, preferences and uncertain demand.

Deliverable

An options brief with constraints, a conditional recommendation and a pilot question.

Quality criteria

Check feasibility before preferences. Make assumptions explicit. Avoid inventing availability.

Decision 1: Check feasibility first

Room A seats 24 and is available Tuesday but lacks a projector. Room B seats 30 and has a projector but is available only Wednesday. Tuesday is fixed; paper activities can meet the goal.

Which conclusion follows?

  1. Room B wins because its equipment is better.
  2. Room A is the feasible option under the stated constraints; adapt the activity to paper.
  3. Both rooms are equally feasible because both seat twenty.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Equipment does not offset the fixed-date conflict. Ask whether the date can change before treating B as feasible.
  2. You preserve the fixed date and learning goal without inventing equipment.
  3. Capacity is only one constraint. Availability also determines feasibility.

Practice: Separate the fixed constraints from preferences and write a provisional recommendation.

Hint ladder

  1. A preference cannot cancel a non-negotiable requirement.
  2. Tuesday and capacity are constraints; a projector is not required if paper preserves the goal.
  3. Recommend A for Tuesday with paper activities. State that B would need a date change and confirm any other essential access requirements before booking.

Decision 2: Expose a sensitive assumption

The team now expects between 18 and 28 people. Room A seats 24.

What must change in your reasoning?

  1. Keep recommending A without mentioning capacity.
  2. Assume only eighteen will arrive.
  3. Check demand or use a capacity-limited plan before confirming the venue.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. The recommendation depended on a smaller group. Capacity uncertainty is now material.
  2. Choosing the convenient end of an uncertain range does not resolve it.
  3. The decision becomes conditional on capacity or a revised delivery plan.

Practice: Write the condition under which A works and one fallback if demand exceeds it.

Hint ladder

  1. The relevant boundary is 24, not the average of the range.
  2. You could cap registration, offer a second slot or find another venue, if those options are acceptable.
  3. A works only if the confirmed group fits within 24 and other requirements hold. If demand exceeds that, agree a registration cap or a feasible alternative rather than assuming the room can expand.

Decision 3: Test before expanding

The team wants to repeat the workshop monthly but has not measured learning or demand.

What should the first session test?

  1. A defined learner outcome and evidence of demand, with a revision rule.
  2. Only whether the room looked attractive.
  3. Nothing; one completed event proves the whole series will succeed.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. The pilot can inform a proportionate next decision.
  2. Appearance may matter, but it does not answer the learning or demand questions.
  3. Running an event is not the same as establishing that repeated delivery serves the goal.

Practice: Write a pilot success criterion and a reason you would revise rather than repeat the same plan.

Hint ladder

  1. Measure something linked to the purpose.
  2. Include an independent learner task and actual attendance or registration evidence.
  3. Check whether learners complete a specified task without help and whether demand fits the delivery plan. Revise if participation barriers or task failures show the format needs changes.

Independent variation

The pilot fills all 24 seats but only 10 learners attempt the exit task. Explain what the attendance result establishes and what remains unknown about learning.

Review criteria

A full room supports a demand observation for that event. It does not establish skill acquisition for all attendees; investigate why only ten attempted the check.

Record your final artifact, your independent variation and what you can now explain. Note any support you used.

MISSION 4 / Peer teacher

The explanation everyone nodded at

A fictional peer session looks successful because everyone agrees with the explanation. Design a check that reveals reasoning and supports another attempt.

Deliverable

A two-level explanation, a diagnostic question and targeted feedback.

Quality criteria

Use an accurate example. Ask for reasoning. Follow feedback with a fresh task.

Decision 1: Check beyond agreement

You explain that increasing and then decreasing by the same percentage need not return to the starting value. Learners nod.

What is the useful next action?

  1. Treat nodding as proof that the idea can be applied.
  2. Repeat the explanation with more confident wording.
  3. Ask learners to predict and calculate a fresh example, then explain the base.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Agreement does not reveal whether learners can use the rule.
  2. Repetition may help but still leaves performance unobserved.
  3. A prediction and calculation expose whether learners track the changing base.

Practice: Calculate a 10% rise and then a 10% fall from 200. Explain the result.

Hint ladder

  1. The second percentage applies to the new amount.
  2. 200 becomes 220; ten percent of 220 is 22.
  3. The final value is 198. Equal rates act on different bases, so they do not cancel.

Decision 2: Diagnose the wrong rule

A learner says the result must be 200 because “plus ten minus ten is zero.”

What feedback targets the misconception?

  1. Explain that the percentages refer to different bases and ask for the second change in units.
  2. Say “wrong” and reveal only the final number.
  3. Praise the answer to keep the learner comfortable.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. The feedback identifies the mistaken assumption and prompts a concrete correction.
  2. A final number alone may leave the same rule intact.
  3. Encouragement should not preserve a known misconception.

Practice: Write a short feedback response that preserves the learner’s correct first step and targets the second step.

Hint ladder

  1. Identify what the learner did correctly.
  2. Ask what ten percent of 220 equals.
  3. “Your first increase to 220 is right. The decrease is ten percent of 220, not 200. What is that decrease in units, and what remains?”

Decision 3: Check the correction

The learner now repeats your explanation accurately.

Which follow-up provides stronger evidence?

  1. Ask them to repeat it once more.
  2. Use a different starting value and rate, and ask for reasoning without the example open.
  3. Mark every percentage skill mastered.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Further repetition mainly checks memory of the explanation.
  2. A changed example tests whether the corrected rule is usable.
  3. This task covers one principle, not every percentage concept.

Practice: Create and solve a fresh rise-then-fall example; state what the check can and cannot show.

Hint ladder

  1. Change the starting amount and the percentage.
  2. For example, use 100 with a 20% rise and a 20% fall.
  3. 100 becomes 120 and then 96. This supports application of the changing-base idea in a near example, not broad mastery of all percentage problems.

Independent variation

A learner asks whether a 10% decrease followed by a 10% increase also ends at 198 when starting from 200. Check the claim and distinguish final value from intermediate values.

Review criteria

200 becomes 180 and then 198. Multiplying by 0.9 and 1.1 gives the same final factor here, although the intermediate amounts differ.

Record your final artifact, your independent variation and what you can now explain. Note any support you used.

MISSION 5 / Critical reviewer

The polished revision with a hidden change

An AI assistant improves a fictional team handoff but introduces unsupported facts and overlooks an edge case. Review the revision rather than accepting its polish.

Deliverable

A reviewed handoff, a feedback decision log and a small case checklist.

Quality criteria

Preserve factual status. Explain adopted and rejected changes. Make instructions usable for a new reader.

Decision 1: Review the factual change

Original: “We recommend testing the new checklist with three volunteers.” AI revision: “The new checklist has been validated by the team.”

What should you do?

  1. Keep the new sentence because it sounds professional.
  2. Restore the proposal status and explain that testing has not happened.
  3. Delete all mention of evaluation.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. The revision invents completed validation.
  2. You preserve the difference between a planned test and a completed one.
  3. Removing evaluation hides the next useful step instead of correcting the claim.

Practice: Write the corrected sentence and a reason for rejecting the AI change.

Hint ladder

  1. Check whether the verb changes the event status.
  2. Recommending a test is not the same as having completed it.
  3. “We recommend testing the checklist with three volunteers before adoption.” Reject the revision because no completed validation was supplied.

Decision 2: Find the omitted case

The checklist says “reject any entry without a score.” In this exercise zero is a valid score and an empty field means not yet assessed.

Which test matters?

  1. Only test a score of five.
  2. Treat zero and blank as identical.
  3. Test zero, a positive score and a blank field separately.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. The ordinary case will not reveal the ambiguity.
  2. A valid zero would be lost and missing data would be misrepresented.
  3. Separate cases expose whether the instruction preserves the intended distinction.

Practice: Write the expected handling of zero, five and blank.

Hint ladder

  1. Missing information is not the same as a measured zero.
  2. Zero and five are recorded scores; blank is unassessed.
  3. Accept and retain zero; accept five; flag blank as not yet assessed rather than converting it to zero.

Decision 3: Make the instruction operational

The handoff ends with “check everything carefully.” A new volunteer asks what to do.

What is a useful replacement?

  1. Name the checks, expected outcomes and what to do when a check fails.
  2. Keep the phrase because everyone knows what careful means.
  3. Add more adjectives about quality.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. The reader can now perform and report the check without guessing the author’s intentions.
  2. The question shows that the instruction is not operational for this reader.
  3. Adjectives do not specify an action or expected result.

Practice: Write a short handoff for entering and reviewing scores.

Hint ladder

  1. Name input, action, expected output and escalation.
  2. Include the zero-versus-blank distinction.
  3. “Record numeric scores including zero. Leave unassessed entries blank and flag them for follow-up. Compare each entry with its source record. If they differ, keep the source visible and ask the reviewer before finalising.”

Independent variation

A new field allows the text “not applicable.” Adapt the instructions without silently treating it as zero or as an unassessed blank.

Review criteria

Keep measured zero, unassessed blank and not-applicable status distinct. Define whether and how each belongs in any summary calculation before calculating averages.

Record your final artifact, your independent variation and what you can now explain. Note any support you used.

MISSION 6 / Independent practitioner

The result you need to defend

A fictional team sees better performance after changing instructions, but the second group had more experience. Build a defensible interpretation and a transfer plan.

Deliverable

A bounded conclusion, a rival explanation and a three-case independent portfolio plan.

Quality criteria

Record support and task conditions. Consider a rival explanation. Demonstrate boundaries as well as success.

Decision 1: Compare the conditions

Group A: 6 of 10 complete a task after the old instructions. Group B: 9 of 10 complete after revised instructions, but B has more prior experience.

What follows?

  1. The revision certainly caused a 30-point improvement.
  2. The observed completion rates differ, but experience is a plausible alternative explanation.
  3. The counts cannot be reported at all.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. The difference is observed, but the causal attribution is not isolated.
  2. You can report 60% versus 90% while keeping the cause unresolved.
  3. The observations are still useful if their limits are stated.

Practice: Write the rates, their difference in percentage points and a causal limitation.

Hint ladder

  1. Separate the arithmetic from the explanation.
  2. 60% versus 90% is a difference of 30 percentage points.
  3. Completion was 60% in A and 90% in B, a 30-point difference. Prior experience differs, so the comparison alone does not establish the effect of revised instructions.

Decision 2: Challenge the preferred story

The facilitator believes the instructions explain the whole difference.

What would improve the investigation?

  1. Collect only compliments about the new instructions.
  2. Repeat the claim in the report title.
  3. Compare more similar learners or record prior experience and support in another relevant check.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Compliments do not separate the competing explanations.
  2. Stronger wording adds no evidence.
  3. A better comparison can reduce uncertainty, though a small informal check still has limits.

Practice: State the preferred and rival explanations, then propose an informative next observation.

Hint ladder

  1. The rival explanation is already visible in the brief.
  2. Instruction clarity and experience could both contribute.
  3. Compare performance on a common task among learners with similar recorded experience and support, or examine patterns by experience. Report remaining limitations instead of promising perfect causal isolation.

Decision 3: Define independent evidence

You want to demonstrate your own skill in evaluating comparisons.

Which portfolio is most informative?

  1. A near comparison, a changed-condition case and a boundary case where you decline an unsupported conclusion.
  2. Three copies of the same worked answer.
  3. A count of how many AI prompts you used.

Write your choice and reason before reading the consequences below.

Consequences by choice

  1. Your portfolio can reveal whether the reasoning transfers and whether you recognise its limits.
  2. Repeated copies add little evidence of flexible application.
  3. Prompt count measures activity rather than independent evaluation.

Practice: Design three short assessment cases and the criteria for a sound answer to each.

Hint ladder

  1. Vary the condition, not just the wording.
  2. Include one case where the data does not support the requested conclusion.
  3. Use matched outcomes with a simple rate comparison, different support conditions requiring qualification, and missing outcome definitions requiring clarification before ranking. Require denominators and limitations in every response.

Independent variation

One group has a higher completion rate but received unlimited hints. The other had no hints. Write a conclusion that recognises useful assisted performance without equating it with unaided capability.

Review criteria

Report the measured results and the difference in support. Explain that the comparison does not directly rank independent skill; propose a comparable unaided check if that is the intended outcome.

Record your final artifact, your independent variation and what you can now explain. Note any support you used.

Your independent capstone

Choose a useful artifact from your own work, study or hobby. Record these nine parts:

  1. Outcome and audience
  2. Two or three visible quality criteria
  3. A first unaided attempt
  4. The artifact or a detailed description
  5. An independent check, its result and limitation
  6. A revision and its reason
  7. Three variations tackled without copying: a near example, a changed constraint and a boundary case
  8. An explanation of a choice, evidence and boundary
  9. A next independent task, review date and fallback practice

Review purpose, accuracy, reasoning, transfer and ownership. The interactive tool can save this evidence and export a portfolio.