Why did my score change without an alert?
A change of 5 points or less, or one inside the run to run variation, is recorded in your score history without an alert. Only a drop beyond the noise floor is announced.
Alerts, and when each one is sent
A monitored store is sent four kinds of alert: a score drop, a new Critical finding, a confirmed fix and a weekly digest. This page says what triggers each one, who receives it, how Slack fits in, and which of them you can switch off.
Alerts come with scheduled monitoring, which Coverage, Monitor, Defend, Patrol and Enterprise include. A free scan or a one-off report sends its report and nothing after it.
The alerts
- Score dropped
Your score fell compared with the previous scan of the same kind, by more than the noise floor: more than 5 points and more than twice the run to run variation. Scans scored by different scoring versions are never compared.
- New Critical finding
A Critical finding the previous scan did not report, once two signals agree on it: two agent journeys, or one journey backed by a retrieval check. A Critical that was already there last time is not announced again.
- Fix confirmed
A finding the scan before used to report has been absent from two completed scans in a row, and both scans reached the stage where it lives. Sent once, when the fix is first confirmed.
- Weekly digest
Once a week: what was measured on the store over the last seven days, including open Critical findings that two signals agree on. It reports only what was measured, so a quiet week says so.
Who receives them
Alert emails go to the person who subscribed the store and to every verified member of a workspace that manages it, owners, admins and followers alike. Membership is read when the alert is sent, so somebody removed from a workspace stops receiving them at once.
Slack
A store can also post its alerts to Slack. Paste a Slack incoming webhook address on the store page in your dashboard, one for each channel you want them in. Slack receives the same alerts as email.
Switching them off
The weekly digest can be switched off in your email preferences. The other alerts are the monitoring you pay for, so they carry no unsubscribe link and no marketing.
Questions
Do I get told when my score goes up?
Not as a score alert. You get a fix confirmed alert when a specific finding has been gone for two scans in a row, which is a stronger statement than a number going up.
Does a free scan send alerts?
No. Alerts come from scheduled monitoring, which a plan includes. A free scan or a one-off report sends the report, and nothing after it.
What decides a score change and a Critical is on the scoring page. How often each plan scans is on the plans page.