May 26, 2026Enhanced Message A/B Test Reporting
Identify the winning variant in your message A/B tests at a glance, with the statistical confidence to act on the result.
Today’s release adds the following to the Performance view in your test results:
A summary helps you quickly see whether Airship declared a winner, what happened during the experiment, or whether results were inconclusive and need more data.
Charts visualize the value your winning variant generated and the confidence behind the results:
- Probability of Being the Best Variant — The likelihood that each variant is the top-performing option
- Conversion Lift Compared to Others — The potential uplift of each variant compared to the top performer
- Likelihood of Variant Success — The likely conversion rate range for each variant
After a test starts, an Overview section appears with the test status, audience summary, and the Probability of Being the Best Variant chart from the Performance view.
Documentation
For full details, see View results in Message A/B tests.