Experiment Performance Alerts

Ask AI

Copied as markdown!

Get notified by email when an experiment variant is significantly underperforming compared to the control group, so you can take action before a bad experiment causes lasting revenue impact.

Performance alerts apply to both price (A/B) experiments and funnel experiments.

How can I manage Experiment Performance Alerts?

Performance alerts are enabled by default for every project you have access to. You can opt out on a per-project basis:

1. Click on Account from the RevenueCat Dashboard.
2. Open the Notifications section and find Experiment Performance Alerts.
3. Deselect any Projects you do not want to receive performance alerts for.
4. Click Update to save your changes.

📘Verify your email address

You must first verify your email address with us in order to receive Experiment Performance Alerts.

When is an alert triggered?

An alert is sent when a treatment variant's revenue is significantly lower than the control group, based on both the absolute and relative revenue difference between the two. This two-condition requirement prevents alerts on experiments with a large percentage drop but negligible absolute impact, and vice versa.

📘Grace period

No alert is sent during the first 7 days of active experiment run time, even if revenue is down. This avoids noise from early variance before enough data has accumulated.

FAQs

Question	Answer
How often are alerts checked?	Performance is evaluated daily.
Do I get one email per experiment or one per variant?	One email per underperforming variant. If your experiment has multiple treatment variants and more than one is underperforming, you will receive a separate alert for each.
Are alerts sent for stopped experiments?	Yes, for up to 7 calendar days after an experiment is stopped, so you can still be alerted about a recently stopped experiment.
Can I re-enable alerts after opting out?	Yes, return to the Experiment Performance Alerts section in Notifications and re-select the project.
I don't have permission to stop the experiment — why am I receiving alerts?	Alerts are sent to all account members with access to view experiment metrics for a project, except for read_only collaborators who cannot modify experiments. If you believe you are receiving alerts in error, reach out through Support.