Help

Why a finding was not surfaced

A report withholds a finding when the evidence does not support it. The three usual reasons are that a serious finding needs two concurring signals and only one was seen, that a change between scans is smaller than the measurement noise, or that the attempt stopped before the stage in question. Each is a deliberate choice to under-report rather than to guess.

A report will sometimes not tell you something you can see with your own eyes. That is usually deliberate, and there are three reasons for it.

One signal is not two

A serious finding needs two concurring signals before it is stated. One observation can be a coincidence: a slow response, a transient error, a page that behaved differently once. Publishing it as fact would make the report less trustworthy in exactly the cases where trust matters.

The change was inside the noise floor

Agents are not deterministic, so two runs of the same store differ slightly even when nothing changed. A movement smaller than that measured noise is not reported as a movement.

The alternative is an alert every time the weather changes, which is how monitoring gets ignored.

The attempt never got there

The commonest reason by far. If the agent stalled at discovery, nothing about your checkout was observed, so nothing about your checkout is reported. That is not the report missing something, it is the report refusing to invent it.

Clear the earliest stall and run again. See reading your report.

If you think something is genuinely missing

Send the run and what you expected to [email protected]. A finding that should have fired and did not is a defect worth knowing about.

Questions

I can see the problem myself. Why is it not in the report?

Most often because the agent stopped earlier and never reached it, or because one observation is not enough to state it as fact. Fix the first stall and run again; findings below it usually appear once the journey gets that far.

My score moved a little. Why does the report not mention it?

Because a difference smaller than the measurement noise is not a change, it is noise. Reporting it would train you to react to nothing.

Scan your store