A/B tests

Test versions of a message or an invite, see the results per version, and know when a winner is picked for you and when it isn’t.

An A/B test sends different versions of a step, so you can see which works better. Each person gets one version. Results show on the step itself.

There are two kinds, and they behave differently.

	Versions of your own text	AI versions
What differs	The text people read	The instructions AI writes from
Where you set it	Versions, on the step	A/B test (AI prompt variants), on the Canvas
How a version is chosen	At random	At random, or in turn
Is a winner picked for you?	No. You keep the text you prefer.	Yes, when the numbers allow it

Both are judged on the same number: accepted invites for an invite step, and replies for any other step. As the step says: “You see how each version does. We pick a winner only for AI versions, never for your own text.”

Test your own text

1. Pause if it's running

   Steps can’t change while a campaign runs. Click Pause & edit.

2. Open More options on the step

   The step has to use Write it myself.

3. Add a version

   Under Versions, click Add version and write it. You can have up to five.

4. Resume or launch

   Each person gets one version, picked at random.

Versions isn’t offered on an invite with no note, because there’s nothing to compare, or on a comment step. It opens after your first launched campaign, or earlier with Show all options in My account.

Test AI instructions

1. Pause the campaign and open the Canvas

   On a campaign that has launched, the Canvas opens only while it is paused.

2. Turn on the test

   On a message step that uses AI, turn on A/B test (AI prompt variants).

3. Write the instructions

   Under Variant prompts, write one per version, such as “Lead with their hiring signal”. Under Variant strategy, choose Random or Round-robin.

Once it’s set up, the step form shows “This step tests different instructions, set up on the Canvas”.

How a winner is picked

We check AI tests once a day. Counts are across all versions of the step.

Sends so far	What happens
Fewer than 100	Still testing. Nothing is picked.
100 or more, and the leader is clearly ahead of the runner-up	The leader wins.
300 or more	The leader wins, even if it’s only slightly ahead.

When a version wins, it goes to everyone new. People who already have a version keep it. If you change the instructions after a win, the win is cleared, because the old numbers belong to the old text, and the test can pick again.

Read the results

Under So far, each version shows its sent, replied and accepted counts.

Versions of your own text on a message step, with So far.

What you see	What it means
”Nothing has gone out yet”	There’s nothing to compare.
”Too early to tell which is better”	Fewer than 100 sends across the versions. Look again after more people have received each one.
”Keep the text you prefer”	Your own text, with enough sends to compare. We never pick one for your own text.
”more sends before one can be picked”	An AI test past 100 sends with no clear leader. It says how many are left until the leader wins at 300.
”Still testing”	An AI test, with nothing picked yet.
”Version A won and now goes to everyone new”	An AI test with a winner.

Differences on small numbers can be chance. Wait for the counts before you change anything.

Related

Steps and messages

AI text, your own text and step options.

Safety pauses

What happens when few people accept.

Reports

Results across campaigns.