Instruments · 01 · Signals from the Curve

The Rendering Audit

Seven questions to ask of any dashboard or recurring report before you trust a number in it. Tool agnostic on purpose. It is not about your vendor. It is about whether the surface in front of you has a way to tell you it does not know.

1. Does absence render differently from zero?

   Find a cell that reads 0. Ask the owner: is that a real zero, or a "we do not know" wearing a zero's clothes? "We measured and found none" and "we never measured" should not share a glyph.

   Yes No Don't know

2. Is "withheld" distinguishable from "measured and empty"?

   Suppressed cells, redacted rows, and small-count masking are findings about the data, not the data. If they collapse into a blank or a zero, the report is confidently wrong on purpose.

   Yes No Don't know

3. Does a stale number look different from a current one?

   Every figure has an "as of." If it is not on the surface, the reader assumes "now." Check the oldest number on the page and ask when it last changed.

   Yes No Don't know

4. Is an estimate labeled as an estimate at the point of reading, not in a footnote?

   A modeled figure, an extrapolation, a forecast: each is an honest object with a label on it. The label has to sit where the eye lands, not two scrolls down in eight-point type.

   Yes No Don't know

5. When the underlying data is missing, does the surface say so, or does it fill in?

   Defaults, carry-forwards, interpolation, "last known value." Each one turns a gap into a fact. Ask what the surface does on a day the feed does not arrive.

   Yes No Don't know

6. Does every caution on this surface have a state in which it switches off, and has anyone ever seen it off?

   A warning that cannot be satisfied and a warning that never fires train the reader to do the same thing: stop looking. A caution that is always on is furniture.

   Yes No Don't know

7. When someone corrects this report, does the correction land in the thing that generates it, or only in the thing you read?

   A correction written down is a correction you are hoping someone reads. A correction the system cannot skip is a fix. Ask where the last correction went.

   Yes No Don't know

The audit practices what it checks. Blind is worse than red, and it is the one no one escalates. A red number tells you something is wrong. A blind number tells you nothing at all while looking exactly like a red one.