01How Should You Compare A/B Testing Software in 2026?
Most comparisons of A/B testing software are grids of tools against features. Those grids stopped helping once nearly every tool shipped a visual editor, targeting, goals and an AI assistant. The differences that change your results sit underneath: which tests run on your shop, how a result is calculated, where visitor data goes and how the bill grows.
Each section below takes one criterion, explains what to look for and names which of the fifteen tools document what: Apex by DRIP, Intelligems, Shoplift, Varify.io, VWO, Optimizely, Kameleoon, ABlyft, Shopify Rollouts, ABConvert, Convert Experiences, GrowthBook, Visually.io, Elevate and AB Tasty. VWO and AB Tasty merged in January 2026 and are now product brands of one company, Wingify.
| Criterion | The question to ask | Where tools differ most |
|---|---|---|
| What you can test | Which tests run on our shop and plan? | Prices, shipping, offers and checkout |
| How tests get built | Who on our team can build alone? | Theme editor, code, AI, MCP |
| Statistics and metrics | How is a winner called, and on what? | Method, threshold, revenue versus profit |
| Prediction before launch | What evidence ranks a test idea? | Own data, models, observed test databases |
| Data and compliance | Where is visitor data processed? | Hosting region, certifications, DPA |
| Shop system fit | Does it install on our setup? | Shopify app, snippet, SDK, headless |
| Pricing model | What drives the bill in peak months? | Visitors, orders, seats, domain, quote |
| Reviews | What do users criticise, and where? | Directory, count, recurring complaints |
Three phrases recur below. Documented means the vendor describes it on its own pages. Not published means the vendor does not say. None found means we did not find it in the pages we read, which does not prove it is missing. For Apex, we use the product description on drip-apex.com and nothing beyond it.
02What Can Each Tool Test on Your Shop?
What to look for
Start from the tests you plan to run in the next six months, not from the feature list. A price, shipping or checkout test changes what the shop charges or how the order is completed, so it needs deeper access to the shop system, and vendors gate it behind higher plans, Shopify Plus or an integration built with their team.
- Which test types are on the plan you would buy, not on the top plan.
- Whether price tests duplicate products or change prices directly, and whether multi-currency stores are covered.
- Whether checkout tests need Shopify Plus.
- How many variants a test can have, and whether parallel tests are kept apart.
| Test type | Tools that document it | Condition to check |
|---|---|---|
| Prices | Intelligems, Shoplift, ABConvert, Convert, Visually.io, Elevate | Plan tier, order volume, currency |
| Shipping rates or thresholds | Intelligems, ABConvert, Elevate, Visually.io, Shoplift, Convert | Shoplift and Convert via JavaScript |
| Offers, discounts, bundles | Intelligems, ABConvert, Elevate, Visually.io, Shopify Rollouts | Rollouts: discount activation, not prices |
| Checkout | Intelligems, ABConvert, Elevate, Visually.io, Varify.io, Shopify Rollouts | Often Shopify Plus; check each vendor |
| Feature flags and staged rollouts | Apex by DRIP, Optimizely, Kameleoon, GrowthBook, Convert | Kameleoon add-on; Convert from Pro |
| Server-side test delivery | Optimizely, Kameleoon, GrowthBook, Convert, Varify.io | Varify.io Enterprise; Convert from Pro |
| More than two variants | Optimizely, Convert, Intelligems (five groups) | Shoplift: two groups per test |
Apex by DRIP documents pages and page elements, parallel tests on the same traffic with optional exclusion groups, A/A tests, redirect tests, a global holdout, feature flags and staged rollouts. Prices, shipping, offers and checkout are not among Apex’s documented test types. If commercial tests fill your next six months, the tools in the top four rows of the table document them.
Page and theme tests are common ground, but the routes differ. Shoplift and Shopify Rollouts edit variants in Shopify’s own Theme Editor. Script-based tools such as Varify.io, ABlyft, Kameleoon, Optimizely and GrowthBook work on any shop that loads JavaScript, but Shopify’s checkout is hard to reach that way: Optimizely states “You cannot inject the Optimizely snippet directly into Shopify's checkout flow”.
Price tests carry the most conditions (checked October 2026). Intelligems builds the integration with your team, and its pricing plans have a 3-month minimum. Shoplift needs Advanced or Pro and a single-currency store. ABConvert starts price tests on Growth at $199 a month, Elevate on Standard, and Visually.io on Scale with at least 600 monthly orders. Convert uses Cart Transform Functions. Shopify Rollouts does not offer price tests, and VWO lists them as “coming soon” (October 6).
03How Do Tests Get Built, and by Whom?
What to look for
Ask who builds the next test on your team: a marketer, a developer, an agency, or nobody yet. Then check three things in the trial: what that person can build alone, how variants are checked on every device before launch, and what still needs a developer. A demo shows the easy case; your own theme shows the real one.
| Build path | Tools that document it | What to check |
|---|---|---|
| Shopify’s own Theme Editor | Shoplift, Shopify Rollouts | Liquid and theme limits |
| Visual editor of its own | Most tools; Apex calls it Operator | How edits survive theme changes |
| Code-based workflow | Apex by DRIP, ABlyft, Optimizely, GrowthBook | Version history, CLI, preview links |
| AI builds from a prompt | Intelligems, Optimizely, Kameleoon, Wingify, Varify.io, Visually.io, GrowthBook | Which test types the AI covers |
| MCP server for AI assistants | Nearly all; see the list below | Read-only, or can start tests |
| Built by the vendor’s team | Apex by DRIP; Visually.io from 7,500 orders | Who owns QA and the result |
AI builders differ in scope. Intelligems’ Atlas agent builds content, theme, template, redirect and code tests, and states that offer, checkout, post-purchase, price and shipping types “are not yet supported”. Optimizely’s Build agent “turns a saved or draft idea into a complete A/B test”. Kameleoon builds from prompts or Figma designs, and Wingify’s Wingz from text, Figma, a screenshot or a PDF. Varify.io’s AI uses paid credits, and GrowthBook’s AI Visual Editor needs Pro.
MCP servers that document creating or changing tests (checked October 2026): Intelligems, Varify.io, Kameleoon, ABlyft, Convert, ABConvert (from Growth) and GrowthBook. Optimizely and Wingify connect Claude and other assistants to their platforms. Visually.io’s MCP server answers reporting questions, Elevate’s “cannot create, start, pause, or end an experiment”, and Shoplift uses an HTTP API instead. For Shopify Rollouts, none was found.
Apex by DRIP offers several build paths: experiment config as code, a code editor, a visual builder called Operator, CLI preview links and QA via preview. The CLI is the developer path. An MCP connection lets a shop owner build and read tests from ChatGPT or Claude without a terminal. Clients see four QA checks: all devices, tracking and targeting, responsive, and matches design. With managed execution, tests are built, checked, launched and read together with the DRIP team.
04Which Statistics and Metrics Does Each Tool Use?
What to look for
The statistics method decides when a tool calls a winner, and that changes which variants you ship. No method suits every team, but every method should be published. Check four things: the method and its default threshold, the minimum sample before a call, whether the tool warns about a sample ratio mismatch (traffic not split as planned), and whether it guards against stopping a test early.
Then check the metric. For a shop, a variant that lifts clicks and lowers order value is a loss, so look for revenue or, closer to what the shop keeps, profit per visitor. Industry data puts the share of experiments that win at 10 to 20 percent, per Ronny Kohavi; a tool that calls far more winners deserves a look at its threshold.
| Tool | Method | Revenue or profit metric | Safeguards documented |
|---|---|---|---|
| Apex by DRIP | Fixed-horizon with confidence | Profit per test on Shopify | Guardian auto-stop; global holdout; A/A tests |
| Intelligems | Bayesian model, Monte Carlo simulations | Revenue, profit and COGS per test | Not published |
| Shoplift | Bayesian, Probability to Win | Revenue per visitor; profit none found | None found |
| Varify.io | One-sided frequentist; Bayesian on Pro | Revenue significance and ARPU | Auto-stop on Enterprise |
| VWO (Wingify) | Bayesian SmartStats | Revenue projections with confidence intervals | Guardrail Agent, permanent holdout |
| Optimizely | Sequential Stats Engine, FDR control | Not covered in our research | Automatic sample ratio mismatch detection |
| Kameleoon | Frequentist, Bayesian or sequential | Not covered in our research | Real-time SRM detection; holdout groups |
| ABlyft | Frequentist default; Bayesian option | Revenue goals with outlier capping | Sample ratio warning referenced |
| Shopify Rollouts | Not published | None; conversion-type metrics in experiments | Not published |
| ABConvert | Not published; 95 percent threshold | Profit per visitor from own costs | Sample ratio check |
| Convert Experiences | Frequentist, Bayesian or sequential | Revenue goals with outlier capping | SRM check on every plan |
| GrowthBook | Bayesian default; frequentist, sequential | Defined in your data warehouse | SRM check, guardrails, auto-rollback (Pro) |
| Visually.io | Bayesian; Odds to Win above 80% | AOV and per-session value | Global Control Group holdout |
| Elevate | Bayesian; four rules call a winner | Profit per visitor with COGS | Outlier capping, bot filtering |
| AB Tasty (Wingify) | Not covered separately | Not covered separately | Wingz Guardrail Agent (platform) |
Defaults vary as much as methods (checked October 2026). Intelligems recommends “300+ orders per test group” and “7+ days”, Shoplift “at least 10,000 visitors per variant and 14 days”. ABlyft’s threshold is configurable from 50 to 99.9 percent; Varify.io and Convert use 95 percent, Elevate 90 percent and Visually.io “Odds to Win >80%”. Elevate calls a winner when four rules hold together (threshold, visitor minimum, conversion minimum, three-day runtime) and reports power and minimum detectable effect.
Stopping early is the common failure, and ABConvert warns against acting the moment confidence crosses 95 percent. Sequential methods are built for continuous monitoring: Optimizely’s default Stats Engine, and options at Kameleoon, Convert (Pro) and GrowthBook (Pro). Varify.io marks sequential testing “SOON”, and Shopify Rollouts does not publish how it calls a winner.
Heat maps per variant explain why a result happened. Convert includes heat maps and session recordings on all plans; most other tools tag variants in Hotjar, Clarity, Heatmap.com or Contentsquare. For Shopify Rollouts, WeltPixel found no documented way to see variant assignment outside the results card (July 2026).
Apex by DRIP reads results with fixed-horizon statistics and confidence. Each test shows the main metric, the lift and the revenue during its runtime, and on Shopify the profit per test, so a shop can optimise for profit: discount share, refund share and profit per sale. Guardian stops a test automatically at a revenue loss threshold. Heat maps and behaviour are shown per variant (clicks, scroll depth, average fold and funnel steps), and integrations with Clarity and Hotjar are in beta.
05Which Tools Help You Choose Tests Before Launch?
What to look for
Building faster does not help if tests keep coming back flat; it ships more flat tests. The step before the build decides that. When a vendor says its AI suggests or ranks ideas, ask what evidence ranks the idea, how many tests stand behind it, whether that figure is published, and whether there is a measured record of how ranked ideas performed.
| Evidence behind the idea | Tools | Published size or caveat |
|---|---|---|
| Observed A/B tests from many shops | Apex by DRIP | 4.3 million tests, 151,000 shops |
| Model trained on past experiments | Kameleoon (PBX Ideate) | “20,000+”; launch post says 25,000 |
| Patterns from real experiments | Varify.io | “10,000+ test patterns” |
| Test ideas from other brands | Shoplift (Lift Assist) | “hundreds of top brands”; no count |
| Proprietary data and user insights | VWO and AB Tasty (Wingify) | No corpus size found |
| Your shop’s own performance | Intelligems; ABConvert Autopilot (beta) | No size; Atlas ranks by profit impact |
| Your page, goals or URL | Optimizely (Idea Builder), ABlyft (Lumen) | No training figure published |
| Basis not stated | Elevate, Visually.io | AI suggestions; no figure published |
| Simulated shoppers | Shopify SimGym; Wingify Synthetic Testing Agent | Shopify: results “might differ” |
| No idea ranking found | GrowthBook, Convert, Shopify Rollouts | SimGym is a separate app |
Kameleoon publishes the nearest comparable claim. Its Ideate agent returns “up to eight test ideas for each page” and is “Trained on 20,000+ experiments” according to the Ideate page; the launch post says “over 25,000”. Kameleoon also states “63% accuracy on high-confidence predictions, compared to an industry average of around 20%”. The method behind the accuracy figure is not published, so treat it as vendor-stated.
Simulation is a different approach. Shopify’s SimGym, a separate app in “AI Research Preview”, uses AI shoppers trained on “real commerce sessions across our platform”, with the caveat that “results might differ from actual buyer behavior”. Wingify’s Synthetic Testing Agent tests a change “on synthetic visitors built from your real segments”. We found no published record of either predicting which A/B tests won.
Idea generators fill a backlog: Optimizely’s Idea Builder works from “your page, goals, and research”, ABlyft’s Lumen returns “five AI-generated experiment ideas with hypotheses”, Intelligems’ Atlas “ranks them by estimated profit impact”, and Elevate and Visually.io offer AI suggestions. We found no published win record for any of them.
How Apex by DRIP approaches it
Apex by DRIP is an A/B testing platform for companies selling online that predicts which tests will win before they go live, built on one of the largest A/B test databases in e-commerce. DRIP calls the method Prediction-Based Experimentation. The plain version: we know what shops like yours tested and which tests won. The test memory holds 4.3 million A/B tests from 151,000 shops, collected since 2011, and every test idea gets a Likelihood to Win before launch: one percent figure per test idea, shown with how many tests back it.
Apex scores each idea against 4.3 million observed A/B tests from 151,000 shops and shows how many tests back each score. The nearest published figure in this comparison is Kameleoon’s Ideate, trained on more than 20,000 experiments; Varify cites 10,000 or more test patterns; no other vendor in this comparison publishes a count of tests behind its recommendations (vendor pages checked October 2026).
In a holdout check within a shop, the top third of ideas won 1.4 to 1.6 times as often (press release, September 29, 2026). DRIP also scored and froze predictions for 33 brands in early September 2026; the results are published from the launch on. Both figures are vendor-stated, like the other vendors’ figures in this section.
06Where Is Your Data Processed, and What Is Certified?
What to look for
- The hosting region for visitor and event data, and where the application itself runs: GrowthBook Cloud keeps event data in Ireland while the application stays in the US.
- A signed DPA with Standard Contractual Clauses where data leaves the EU, and a subprocessor list.
- Certifications as reports, not badges. ISO 27001 and SOC 2 Type 2 are the common ones.
- Consent: what happens to tests and tracking when a visitor declines.
- Cookies and storage: whether the tool sets cookies, uses local storage or offers a cookieless mode.
| Tool | Data location | Certifications | DPA |
|---|---|---|---|
| Apex by DRIP | EU plus UK | ISO 27001 and SOC 2 in progress | GDPR in place; DPAs for US tools |
| Intelligems | Transfers to Canada and US | None found | None found |
| Shoplift | United States | None found | Yes, with EEA SCCs, UK IDTA |
| Varify.io | AWS Frankfurt plus Cloudflare | SOC 2 marked “SOON” | Downloadable |
| VWO (Wingify) | Not covered | Not covered | Not covered |
| Optimizely | EU data centers available | ISO 27001, 27017, 27018; SOC 2 Type 2 | Yes, SCCs, UK and Swiss addendums |
| Kameleoon | Region not stated | ISO 27001, SOC 2 Type 2, PCI DSS | No public DPA found |
| ABlyft | Germany | Not published | No public DPA found |
| Shopify Rollouts | Not published | PCI DSS Level 1; SOC 2 Type II | Not published for Rollouts |
| ABConvert | Region not published | None found | On request by email |
| Convert Experiences | Frankfurt, Germany | ISO 27001, SOC 2 Type 2 | Free signed DPA with SCCs |
| GrowthBook | EU region for events, or self-hosted | SOC 2 Type II | Yes, with SCCs |
| Visually.io | Transfers to Canada and US | SOC 2, GDPR “in the process” | None found |
| Elevate | Not published | None found | Not published |
| AB Tasty (Wingify) | Not covered | Not covered | Not covered |
Consent and storage differ too. ABlyft states “We do not store any personal data. Nothing.” and uses localStorage by default. Varify.io says “In principle, no cookies are set”. Convert uses first-party cookies and offers two consent modes. Kameleoon supports IAB TCF 2.3. Shoplift and Visually.io use Shopify’s Customer Privacy API; in opt-in mode “Visually remains completely inactive until consent is granted”.
Apex by DRIP has GDPR in place and hosts in the EU plus UK, with DPAs for US tools. ISO 27001 and SOC 2 are in progress, with no certification yet. Consent is supported for most Shopify GDPR apps, and tracking runs server-side with first-party data.
07Which Shop Systems Does Each Tool Fit?
What to look for
- The install path: an App Store app, a snippet in the theme, a tag manager or an SDK. App Store apps show reviews and, for some, a Built for Shopify badge.
- Plan requirements on your shop system. On Shopify, checkout tests usually need Plus, and some vendors document their integration for Plus alone.
- Headless storefronts, which several Shopify tools do not cover.
- Domains and markets: Varify.io, for example, covers one domain per plan, and Shopify Rollouts offers market-specific targeting on Advanced and Plus.
- Script weight and flicker: ask for the script size and how it loads.
| Tool | How it installs | Shop systems and limits |
|---|---|---|
| Apex by DRIP | Shopify app, two-click install via link | Installs as a Shopify app |
| Intelligems | Shopify app plus theme script | Shopify; headless via npm package |
| Shoplift | App Store app, script added automatically | Shopify, Plus; headless “not currently supported” |
| Varify.io | One snippet, via GTM or directly | Any shop that loads JavaScript |
| VWO (Wingify) | Shopify app since March 2024 | Other systems not covered in our research |
| Optimizely | Snippet in page head; 20+ SDKs | Any site; no Shopify testing app |
| Kameleoon | Async snippet, SDKs, Shopify app | Shopify guide applies to Plus |
| ABlyft | Snippet in head, GTM or self-hosted | Any site; no Shopify App Store app |
| Shopify Rollouts | Built into the Shopify admin | Online Store; no headless; experiments from Grow |
| ABConvert | Shopify app with Shopify Functions | Shopify; headless not supported |
| Convert Experiences | Shopify app; script on other platforms | Shopify, WooCommerce, BigCommerce, Magento and others |
| GrowthBook | Script or SDK; snippet in theme.liquid | Any site; no Shopify App Store app |
| Visually.io | Shopify app with theme snippet | Shopify, Plus; headless via Hydrogen |
| Elevate | Shopify app, theme extension, Web Pixel | Shopify; headless via SDK on Premium |
| AB Tasty (Wingify) | Not covered in our research | Not covered in our research |
Script weight is vendor-stated where published: Varify.io 11.5 KB, ABlyft 13 KB, Visually.io 16 KB, Kameleoon 29 KB with Brotli. Optimizely’s snippet grows with every running experiment and is recommended synchronous in the head; Elevate’s script is “render-blocking by design to prevent flicker”.
On the Shopify App Store, ABConvert and Elevate showed the Built for Shopify badge on October 10, 2026. The Kameleoon and Convert apps had no reviews that day, and VWO’s had none on September 3, 2026.
Apex by DRIP installs as a Shopify app, with a two-click install via link, server-side tracking and first-party data.
08How Do the Pricing Models Differ?
What to look for
An entry price says little about year two. Visitor-based plans grow with every campaign, order-based plans with sales, and a flat price per domain not at all. Shoplift bills on site-wide visitors, “not tested visitors”, and pauses tests above the plan limit. ABConvert bills on test orders, Varify.io charges “Same price, unlimited traffic” per domain, and Intelligems prices per store by order volume with “no per-visitor charges and no overages”.
| Tool | Billing basis | Entry price | Free option or trial |
|---|---|---|---|
| Apex by DRIP | Not published | Not published; book a call | Card-free free tier, one store |
| Intelligems | Monthly orders per store | $69 a month (Smart Content) | 14-day trial; none on pricing plans |
| Shoplift | Site-wide unique visitors | $99 a month; $74 billed annually | 14-day trial |
| Varify.io | Flat per domain | €199 a month billed annually | 15-day trial, no card |
| VWO (Wingify) | Monthly tracked users | Not published | 30-day trial without card |
| Optimizely | Not published | On quote; Vendr median $81,447 a year | Free Feature Experimentation plan |
| Kameleoon | Tracked users and prompt credits | From $495 a month (PBX Starter) | 30-day trial without card |
| ABlyft | Not published | Paid plans on quote | Free plan; limits not published |
| Shopify Rollouts | Included in Shopify plans | Experiments from Grow, €79 a month yearly | No separate fee listed |
| ABConvert | Test orders | $99 a month; $74 billed yearly | 14-day trial |
| Convert Experiences | Monthly tested users | $299 a month billed annually | 15-day trial, no card |
| GrowthBook | Per seat, plus usage add-ons | Pro $40 per seat a month | Free Starter; free self-hosting |
| Visually.io | Monthly orders | $19 a month, up to 200 orders | 14-day trial, no card |
| Elevate | Sitewide monthly orders | $49 a month (Basic) | 14-day trial |
| AB Tasty (Wingify) | Wingify plans | Not published | Not covered separately |
The conditions sit in the small print (checked October 2026). Intelligems’ pricing plans and its Unlimited plan carry a 3-month minimum and no trial. Convert’s annual plans “don’t auto-renew”. Kameleoon’s code editor, CUPED and bandits are add-ons on PBX Starter. Varify.io’s AI credits cost extra, and Optimizely’s Opal agents run on credits whose price is not published. Price tests often sit on a higher tier: ABConvert from Growth at $199 a month, Elevate from Standard at $99, Shoplift from Advanced, and Visually.io from Scale with at least 600 monthly orders.
Check the exit too: Elevate removes data 48 hours after uninstall, and Intelligems offers a $9 a month Pause Plan that keeps data.
The price of Apex by DRIP is not published. A card-free free tier for one store exists, and beyond it the route to a price is to book a call. If your buying process needs a price list before any conversation, that is a real cost of choosing Apex.
09What Do Reviews Say, and How Should You Read Them?
What to look for
- Compare ratings within one directory. Shopify App Store, G2 and OMR Reviews have different reviewer pools.
- Look at the count and the dates: how many reviews arrived in the last twelve months.
- Read the one- to three-star reviews. Complaints that repeat (price, support, developer needs, reliability) say more than the average.
- Check how the figures were read. Some G2 counts below come from search snippets, because the pages blocked automated reading.
| Tool | Directory | Rating | Reviews |
|---|---|---|---|
| Apex by DRIP | No public review profile yet | None | None |
| Intelligems | Shopify App Store | 4.8 | 198 |
| Shoplift | Shopify App Store | 4.9 | 133 |
| Varify.io | OMR Reviews | 4.8 | 113 |
| VWO (Wingify) | G2 (VWO Testing) | 4.4 | 929 |
| Optimizely | G2 (Web Experimentation) | 4.2 | 411 |
| Kameleoon | OMR Reviews | 4.5 | 192 |
| ABlyft | OMR Reviews | 4.9 | 129 |
| Shopify Rollouts | No listing; SimGym app shown | 2.8 (SimGym) | 40 (SimGym) |
| ABConvert | Shopify App Store | 4.7 | 83 |
| Convert Experiences | G2 | 4.6 | 98 |
| GrowthBook | G2 | 4.6 | 25 |
| Visually.io | Shopify App Store | 4.8 | 147 |
| Elevate | Shopify App Store | 4.9 | 143 |
| AB Tasty (Wingify) | G2 | 4.4 | Not recorded |
Other directories add to the picture: Varify.io holds 4.9 from 57 on G2 and Optimizely 8.7 of 10 from 599 on TrustRadius. On Trustpilot, VWO holds 2.2 from 93 reviews, with complaints about renewal pricing and billing (reported September 4, 2026).
The complaints repeat across tools. Price comes up for Shoplift (“the session-based cost gets very expensive very quickly”), Kameleoon and Optimizely (“robust but expensive, suited for larger organizations”). Developer needs come up for ABlyft and Kameleoon, where reviewers say complex tests need programming skills. Support is praised for Varify.io, ABlyft, Convert and Elevate, and criticised in low reviews of Intelligems and ABConvert. Visually.io’s low reviews mention leftover code after uninstall and billing by order volume.
Apex by DRIP has no public review profile yet. DRIP has run over 4,000 own tests and has served over 250 online shops, among them SNOCKS, AG1, Hornbach and KoRo, and SNOCKS runs on Apex.
10Where Does Apex by DRIP Fit, and Where Does It Not?
Across the eight criteria, Apex by DRIP is built around the fourth: prediction before launch. Its three layers are a test memory of 4.3 million A/B tests from 151,000 shops, a testing tool with heat maps per variant, profit per test and the chat, and managed execution with the DRIP team.
Its main strength is the memory of millions of observed tests behind every idea, so selection improves before anything is built. Its main limitation is that the price is not published.
Where Apex is not the right choice:
- A team that already picks winning tests well gets less from the prediction layer.
- A shop that cannot ship a test a week yet should build that habit on a lighter tool beforehand; buying prediction before you can execute is the wrong order.
- Anyone who needs a published price list before a conversation.
11How Do You Build a Shortlist?
Use this checklist in order. Each step removes tools, so the demos you sit through are the ones that can work for you.
- Name the constraint. Tests come back flat: choosing. Good ideas wait for months: building. The bill grows faster than the wins: budget. Legal holds up the contract: compliance.
- List the next ten tests. Mark which are page tests and which change prices, shipping, offers or checkout.
- Cut on shop system and plan. Remove tools that do not install on your setup or need a plan you do not have.
- Cut on data. Ask for the hosting region, the DPA and the subprocessor list. Remove tools your legal team cannot sign.
- Ask for the statistics in writing. Method, default threshold, minimum sample, sample ratio check, and the metric a winner is called on: revenue or profit per visitor.
- Ask where ideas come from. What evidence ranks an idea, how many tests stand behind it, and whether the figure is published.
- Match the build path to the builder. Have the person who will build tests build one in the trial, on your own theme, without vendor help.
- Model the bill on your peak month. Include add-ons, AI credits, the plan that unlocks your test types, the minimum term and the renewal rule.
- Read the low reviews. In one directory, for the last twelve months, looking for complaints that repeat.
- Run an A/A test in the trial. Two identical versions should come out even. If they do not, check the setup before you trust a winner.
12Where Should You Go Next?
The criteria on this page come from the same research as A/B Testing Tools for Online Shops in 2026: 15 Platforms Compared, which profiles each tool with an at-a-glance box, its capabilities, its limitations and where it is not the right choice.
If two or three tools are left on your shortlist and Apex by DRIP is one of them, the head-to-head pages compare them criterion by criterion:
- Apex vs Intelligems: price, shipping and offer tests with profit reporting on Shopify
- Apex vs Shoplift: theme and template tests in the Shopify Theme Editor
- Apex vs Shoplift vs Intelligems: the three side by side
- Apex vs Varify: no-code tests at a flat price per domain
- Apex vs VWO: agents across the testing lifecycle
- Apex vs Optimizely: sequential statistics and server-side testing
- Apex vs Kameleoon: prompt-based agents, feature flags and certifications
- Apex vs ABlyft: developer-led testing with hosting in Germany
- Apex vs ABConvert: nine Shopify test types, billed on test orders
- Apex vs Convert: Frankfurt hosting and three statistics engines
- Apex vs GrowthBook: open source, warehouse-native testing
- Apex vs Visually: testing, personalisation and upsells in one Shopify app
- Apex vs Shopify Rollouts: Shopify’s built-in scheduling and A/B tests
Elevate and AB Tasty have no separate page; their profiles are in the deep dive.
