# A/B test types

Airship provides multiple A/B testing options for various metrics and channels.

Types of A/B tests available in Airship:

<div class="table-scroll-wrapper">
<table width="100%" class="reference-table">
  <col style="width:15%">
  <col style="width:15%">
  <col style="width:15%">
  <col style="width:55%">
<thead>
  <tr>
    <th>A/B test type</th>
    <th>Metric</th>
    <th>Channels</th>
    <th>Description</th>
  </tr>
</thead>
<tbody>
  <tr>
    <td>Message</td>
    <td>Engagement</td>
    <td>
      <ul>
        <li>App (push notification, in-app message, Message)</li>
        <li>Web</li>
        <li>Email</li>
        <li>SMS</li>
        <li>Open channel</li>
      </ul>
    </td>
    <td><p>Create variants of message content by duplicating the initial variant or from scratch. Each variant returns analytic data to help you determine the most effective way to engage your audience. Audience allocation is automatically evenly distributed between variants and a control group, but you can change the percentages.</p><p><ul><li>Maximum variants: 26</li><li>Resource: <a href='https://www.airship.com/docs/guides/experimentation/a-b-tests/messages/'>Message A/B tests</a></li></ul></td>
  </tr>
  <tr>
    <td>Sequence</td>
    <td>Conversion or engagement</td>
    <td>
      <ul>
        <li>App (push notification, in-app message, Message Center)</li>
        <li>Web</li>
        <li>Email</li>
        <li>SMS</li>
        <li>Open channel</li>
      </ul>
    </td>
    <td><p>Create a variant for any message in a [Sequence](https://www.airship.com/docs/reference/glossary/#sequence). The variant is a duplicate of the original message that you can then edit, changing its content, delivery settings, or [Channel Coordination](https://www.airship.com/docs/reference/glossary/#channel_coordination) settings. Audience allocation is set to 50% for each variant by default, but you can change the percentages. After starting the test, you will wait till the Confidence level meets or exceeds 95% and then select the winning message. The Sequence is then republished with the winning message. Audience members who receive the variant message are randomly selected on entry to the Sequence.<p>Related events and conversions are recorded for both audiences, providing data you can use to evaluate Sequence performance based on your selected metric.</p><p>You can run Sequence A/B tests and <a href='https://www.airship.com/docs/guides/experimentation/control-groups/'>control groups</a> concurrently.<p><ul><li>Maximum variants: 2</li><li>Resource: <a href='https://www.airship.com/docs/guides/experimentation/a-b-tests/sequences/'>Sequence A/B tests</a></li></ul></td>
  </tr>
  <tr>
    <td>Scene</td>
    <td>
      <ul>
        <li>Scene Completion</li>
        <li>Push Opt-in</li>
        <li>Adaptive Link</li>
        <li>App Rating</li>
        <li>Deep Link</li>
        <li>Preference Center</li>
        <li>App Settings</li>
        <li>Share</li>
        <li>Web Page</li>
        <li>Submit Responses</li>
      </ul>
    </td>
    <td>App (Scene)</td>
    <td><p>Create variations of [Scene](https://www.airship.com/docs/reference/glossary/#scene) content by duplicating an existing Scene or creating screens from scratch. You can make a single change, such as changing a button label in a screen, or provide entirely different content.<p>Audience members are randomly selected and split equally to receive your control Scene (Variant A) and your variant Scene (Variant B) for the targeted audience.<p>Related events and conversions are recorded for both audiences, providing data you can use to evaluate Scene performance based on your selected metric.</p><p><ul><li>Maximum variants: 2</li><li>Resource: <a href='https://www.airship.com/docs/guides/experimentation/a-b-tests/scenes/'>Scene A/B tests</a></li></ul></td>
  </tr>
  <tr>
    <td>Feature Flag</td>
    <td>[Goals](https://www.airship.com/docs/reference/glossary/#goals)</td>
    <td>App or Web content</td>
    <td>Compare audience behaviors when a feature is hidden or present, or experiment with distinct feature experiences, such as new home screen designs, by setting different property values for each variant.<p>Reports provide detailed data for evaluating engagement and the overall success of a feature based on your Goals.<p><ul><li>Maximum variants: 26</li><li>Resource: <a href='https://www.airship.com/docs/guides/experimentation/feature-flags/'>Feature Flags</a></li></ul></td>
  </tr>
</tbody>
</table>
</div>
