When Google Optimize was discontinued in 2023, a lot of e-commerce teams lost their go-to testing tool overnight. And what replaced it was mostly expensive, complex, or both.
Shoplift. A/B Tasty. Optimizely. All solid tools — but all came with a monthly bill, external scripts slowing down your storefront, and a setup process that required developer involvement before you could even run your first test.
For a long time, simple A/B testing on Shopify just wasn’t that simple.
That changed with Shopify Winter ’26.
What is Shopify Rollouts?
Rollouts is Shopify’s new native testing and theme deployment system, built directly into the admin. No app install. No external scripts. No extra monthly cost on top of your existing Shopify subscription.
The core idea is straightforward: you create a variant of your live theme, decide what percentage of visitors sees it, and let it run. Shopify tracks the results — conversion rate, add-to-cart rate, bounce rate, average order value — and shows you which version performs better.
You find it under Markets > Rollouts and on Online store > Themes, where a Rollouts button appears next to your published theme. From there, you create a rollout, give it a name, set your traffic split, and jump into the theme editor to make your changes. Everything you modify applies only to the rollout — your live store stays exactly as it is until you decide to apply the winner.
It’s clean. It’s fast. And it finally removes the barrier to entry for teams that weren’t running any formal testing at all.
Why this matters more than it might seem
Most Shopify stores were making design decisions based on gut feel, or launching a new theme and hoping for the best. The tooling that existed was either too expensive, too technical, or too heavy for teams that just wanted to try something and see what happened.
Rollouts changes that dynamic.
You don’t need a developer to set up a test. You don’t need a third-party app configured with tag manager events. You don’t need a data analyst to interpret the results. You just make a change in the theme editor, set a traffic percentage, and let it run.
For teams doing iterative optimisation — testing a new hero banner, adjusting the product page layout, restructuring navigation — this is exactly the kind of tool that speeds things up. You stop debating which version is better and start finding out.
How it works in practice
Step 1: Go to Online Store > Themes and click Rollouts
You’ll see a button next to your published theme. Click it, then click Create rollout.
Step 2: Name your test and set your traffic split
Give it a descriptive name — not “Test 1” but something like “Homepage hero — video vs static — May 2026”. Set your traffic percentage. Start small: 10% to 25% is a sensible starting point. This limits your exposure if the variant underperforms.
Step 3: Make your changes in the theme editor
Click into the theme editor. You’ll see a clear indicator that you’re editing the rollout variant, not your live store. Make your changes — update sections, adjust layout, swap images, rewrite headlines. Everything stays contained to the rollout.
Step 4: Let it run
Run tests for a minimum of seven days to account for weekly traffic patterns. If your store has fewer than 1,000 daily visitors, extend to 14 days to gather enough data to make a confident decision.
Step 5: Review results and decide
Shopify shows you conversion rate, add-to-cart rate, bounce rate, and revenue impact compared to your control. If the variant wins, apply it. If it doesn’t, revert. No emergency late-night rollbacks needed — Shopify handles it cleanly.
What you can and can’t test
Rollouts is genuinely useful for a wide range of everyday optimisation work — but it’s worth being clear about where it stops.
What you can test:
- Homepage sections and hero content
- Product detail page layout
- Navigation structure and menu design
- Collection page organisation
- Calls to action and button copy
- Trust elements and social proof placement
- Promotional banners and seasonal content
What you can’t test (yet):
- Product pricing and discount logic
- Checkout flow
- App embeds and third-party widgets
- Liquid template changes
- Audience segmentation (you can’t show version A to new visitors only, for example)
- Custom conversion goals beyond Shopify’s standard metrics
For pricing tests, Intelligems is still the tool to use. For complex checkout experiments or deep audience segmentation, Convert or Shoplift remain the stronger options. Rollouts is not trying to replace those tools — it’s filling the gap for the large majority of teams who weren’t running any formal testing at all.
The plan requirement you need to know about
Rollouts is available on all Shopify plans, including Basic. But the full A/B testing and analytics functionality — the part where you split traffic and compare results — requires an Advanced plan or higher.
On Basic and standard Shopify plans, you can create and schedule rollouts, but you won’t get the experiment results and analytics. If you’re on Shopify Plus, you have full access including market-level targeting — which means you can run a test in your US market without affecting your UK store at the same time. Useful for international brands doing localisation work.
A smarter way to use Rollouts: the two-stage approach
The most effective way to use Rollouts isn’t to jump straight to a 50/50 split. A more confident workflow looks like this:
Stage one — simulate before you test. Shopify introduced SimGym alongside Rollouts: an AI tool that simulates shopper behaviour on your store before real visitors see it. Use it to catch obvious friction points and validate your direction before committing to a live test.
Stage two — graduate carefully. Start your rollout at 10%. Hold for a week. Check your core metrics. If results are positive, scale to 25%, then 50%, then 100%. This gradual approach limits risk and builds confidence in the result before you commit.
It’s a clean, low-risk deployment pattern that experienced teams will recognise immediately — and that newer teams can now access natively without any setup overhead.
The bigger picture
Rollouts is part of a broader shift in how Shopify is building the platform. Winter ’26 was full of features designed to reduce friction and give merchants more confidence before launching — SimGym, improved theme tooling, AI-assisted store creation. The direction is clear: Shopify wants more brands experimenting more often, with less guesswork and less dependency on external tools.
For the brands that were already running mature CRO programmes, Rollouts adds a useful native layer — especially for large theme deployments where you want to graduate changes gradually rather than push to 100% all at once.
For the brands that weren’t running any formal testing at all, it removes the biggest barrier: the cost and complexity of getting started.
And for those of us who have been waiting for a simple, practical, built-in way to test things since Google Optimize disappeared — it’s a genuinely welcome addition.
Getting started
If you’re on Shopify 2.0, you can access Rollouts today. Go to Online Store > Themes, click the Rollouts button next to your published theme, and create your first test.
Start with one high-impact change. A new hero section. A different product page layout. One clear hypothesis. Let it run for at least a week and make a decision based on what the data tells you.
That’s it. No app. No developer. No monthly subscription.
Just test, learn, and improve.
