Alerts

Alerts tell you about specific conditions within SiteSpect such as a winning Campaign, a disabled Campaign, or a number of other conditions. When the Alerts feature is turned on, you can see Alerts in a few places within SiteSpect:

  • They are displayed on the Dashboard.
  • They are displayed on the Campaign List page when the Campaign meets the specifications for an Alert.
  • They appear in email messages related to Alert conditions.

The following is an image of the Alerts area on the Dashboard. These same Alert icons are also displayed on the Campaign List page.

Alerts
There are four categories of alerts:

  • Hurting – The red flame icon appears when these Campaigns are hurting a Metric's performance and the Metric is the KPI. This alert is meant to let you know about a Campaign that is having a negative impact early in the Campaign life cycle. To be considered Hurting, a Campaign must reach at least 80% significance for 2 consecutive days and have a minimum of 1,000 visits per Variation Group. 
  • Disabled or not receiving traffic – The red exclamation point appears when these Campaigns have a Disabled Status or are not receiving any traffic. SiteSpect alerts you so that you can change the Audience, discover why the Campaign is Disabled, or make some other change to the Campaign.
  • Winning – The green victory cup appears when these Campaigns have reached 90% significance for 2 consecutive days with at least 1,000 visits per Variation Group AND have a positive change when compared to the Control.
  • Underperforming – The trending-down arrow appears when these Campaign have reached 90% significance for a specified period of time with at least 1,000 visits per Variation Group AND has a negative change when compared to the Control.

Setting Alerts

SiteSpect allows you to specify settings for a Hurting KPI Alert; the others are not currently configurable. To specify settings for the Hurting KPI Alert, use the Metrics page.

  1. Select Metrics from the left nav.
  2. Locate the Metric you want to edit and select it.
  3. Click On to turn on the Hurting KPI Alert. It is Off by default.
  4. In the Raise Alert When area of the page, click the edit icon (the little pencil) in the upper right corner.

Alerts - Hurting KPI Alert

SiteSpect displays the Hurting KPI Alert dialog that lets you specify when an alert should be displayed.
 

Alerts - Hurting KPI Alert II

  1. Use the visits field to determine how many visits have been exposed to the Variation Group before SiteSpect evaluates the Metric’s performance against the Control.
  2. In the % below the Control field, enter the percentage difference that triggers the alert.
  3. In the % significance field, enter the percentage significance that you want to use for the alert.
  4. Finally, enter the number of days to examine for the alert.
  5. Click Apply. When all of the conditions are met, SiteSpect displays an alert.