YouTube is giving creators a new tool that makes A/B testing titles for their videos easy. This means any creators with access to advanced features will be able to guarantee they are using the most engaging titles that drive the most clicks using real-world data.
YouTube announced that the feature, previously only available to a select number of channels, would be getting widely released in a video on its Creator Insider channel this week.
In the announcement, YouTube also took time to share more details about how their A/B testing works and address some questions from the community.
How It Works
The new A/B testing feature is available in YouTube’s “Test and Compare” section, alongside the tool that allows channels to test thumbnails. With the tool, you’ll be able to test up to three different titles on a single video.
Once selected, the tool will show users the video using one of the three titles and gather performance data across a period of up to two weeks.
Once the test is complete, you will get a notification with the results. If one title drives significantly more engagement than the others, it will become the default choice for viewers. If not, YouTube will default to the first title you provided.
Of course, creators can always choose to override the tool and select one specific title to display.
Why YouTube’s A/B Testing Prioritizes Watch Time
While the feature has largely been positively received, many have questioned why the A/B testing tool measures and optimizes titles based on watch time rather than click-through rate.
The company addressed this in the announcement video:
“We want to ensure that your A/B test experiment gets the highest viewer engagement, so we’re optimizing for overall watch time over other metrics like CTR. We believe that this metric will best inform our creators’ content strategy decisions and support their chances of success.”
Understanding A/B Test Results
When the test is complete, YouTube will deliver one of three results.r
If there is one title that clearly outperforms the others, it will be declared the “Winner”.
“Performed the same” means that all of your titles drove similar amounts of watch time. One may have slightly performed better, but not by a wide-enough margin for it to be statistically meaningful.
In some cases, YouTube may declare the test “Inconclusive” if there were not enough impressions to deliver proper results within the time period.
For more, watch the full announcement from the Creator Insider channel below:







