Skip to content

MODULE 7 · LESSON 39 · AI-assisted analysis

Verifying AI-generated calculations

Reproduce a generated result independently and trace discrepancies to data, definitions or arithmetic.

By Laurence Svekis · Self-paced · All worked data is synthetic unless you supply your own source.

Try the practice ↓

PredictInspectCalculateCheckExplainTransfer

Your starting point

Prerequisites: Use the ideas and vocabulary from lesson 38; revisit its worked examples if needed.

Definition: Calculation verification compares a claimed result with an independently computed value from the stated inputs and rules. Agreement with a second narrative is weaker than reproducing the operation from the actual data and checking its scope.

Trace the inputs before the formula

A correct formula using the wrong rows still produces a wrong answer to your question. Check filters, time periods, units, missing-value policies and denominator definitions. Ask which exact observations contribute. If the assistant cannot identify the inputs, treat the number as unverified rather than accepting a plausible magnitude.

Use a small hand-checkable case

Recalculate one row, one group and an overall total. Compare a ratio of totals with an average of row ratios when rates are involved. Test zero denominators and missing inputs. The workbench makes calculations inspectable, but you still need to ensure that its settings match the intended analysis. Independent checking means more than repeating the same prompt to the same system.

Record the disagreement and repair

Classify a discrepancy as arithmetic, selection, definition, rounding or unsupported inference. Preserve the original claim and your correction so the learning is visible. A corrected number may require revising the chart, headline and recommendation. Do not leave the original narrative unchanged after fixing the calculation that supported it.

Two worked examples

Averaging rates incorrectly

An AI averages 10% from 1/10 and 90% from 90/100 to report an overall rate of 50%. The pooled rate is 91/110, about 82.73%. The issue is weighting, not division skill. If the question actually asked for an equally weighted average group rate, 50% would have a different, valid interpretation.

A missed zero denominator

A generated report assigns cost per conversion of 0 to a campaign with spend 50 and conversions 0. The ratio 50/0 is undefined. The correct report states the spend and absence of recorded conversions separately. A zero ratio would falsely suggest that conversions were obtained for no cost.

Where this becomes useful

A team uses an assistant to draft a weekly summary. Before circulating it, one reviewer should reconcile key totals and rates with the source export, while another checks whether the wording exceeds those verified facts.

Make an attempt

Complete AI Analysis Verification Challenge. Write the calculation before opening the reference notes. Reproduce one claimed rate in the Formula Builder, then identify whether a discrepancy came from a denominator, aggregation or unsupported conclusion.

Open the accompanying interactive lab →

Misconception check

Claim: Asking AI to check its own answer is independent verification.

Inspect the correction

Self-checking may help, but reproduce the calculation from the source using a separate method or a hand-checkable example.

Independent application

Write an intentionally flawed numerical claim about a synthetic table. Verify it independently, classify the error, correct the number and rewrite the associated interpretation. Preserve both versions to demonstrate what changed and why.

Completion records practice and self-review. It is not certification of statistical competence.