A/B testing personas allows you to take measured steps toward improving your Sales Agents with CloseBot. You can A/B test personas with the paid analytics add-on, optimizing for lead score or sentiment.

To start a split test, open a Job Flow that you would like to test different personas for.

Next, click on the Persona sidebar option where you will see your active persona and list of all personas.

Hover over the "+" where you can start an A/B Test

Once you select the Persona to test your primary persona against, you will choose what percent of contact communication traffic you would like to route to each persona. Contacts continue to communicate with your selected persona until the split test ends and the winner is chosen.

Next, you'll select whether you would like to pick the winner based on which results in contacts with higher average sentiment or lead score.

Choose how long you would like your split test to run. Having a split test run for a longer duration with more chats will get you a better result, but then it will take longer for you to make iterative changes.

For accounts doing extremely high volume, 1 day may be plenty of time for a split test, while accounts with smaller message volume may require up to 30 days to get enough results for a meaningful split test.

Once your A/B test is active, you can see the live results in the persona tab. You can choose to end a split test early at any time by clicking Cancel Split Test and then clicking the "x" on the persona you would like to remove from the test.

Running split tests allows you to check things like different AI Providers (Anthropic, OpenAI) or different tone styles and how they relate to your chose lead conversion metric(s).