Experiment types
Compare experiment types available at the project, message, and content levels.
Compare experiment types available in Airship:
| Experiment type | Scope | Description | Channels |
|---|---|---|---|
| Holdout Experiment | Project | Exclude a group of users from all messages, or from messages with specific Campaign CategoriesAn optional delivery feature used to group messages of similar types or messaging strategies for aggregate reporting. Campaigns help you track the efficacy of both your individual messages and a messaging campaign as a whole., to measure the overall impact of your messaging program. | App, Web, Email, SMS, Open channel |
| Feature Flag rollout | App or web content | Release a feature to a targeted audience and/or percentage, then monitor interaction. | App, Web |
| Feature Flag A/B test | App or web content | Compare audience behaviors when a feature is hidden or present, or experiment with different feature experiences. | App, Web |
| A/B test | Message | Compare message variants to identify the best-performing option. | App, Web, Email, SMS, Open channel |
| Intelligent Rollout | Message | Maximize conversions by automatically optimizing message campaign performance in real time. | App, Web, Email, SMS, Open channel |
| Sequence Control Group | Message | Exclude a percentage of a SequenceA series of messages that is initiated by a trigger. Airship sends messages in the series based on your timing settings, and you can also set conditions that determine its audience and continuation. Sequences can be connected to each other and to other messaging components to create continuous user experiences in a Journey. audience from receiving messages to measure performance or pace a controlled rollout. | App, Web, Email, SMS, Open channel |