Winner ⭐️ Yankee Global Carousel Stripe (ABT-119 cxp.019)

Owned by Alex Alesio (Deactivated)
Last updated: Jan 06, 2023
3 min read

This wiki page captures our AB experiment’s hypothesis, goals, supporting data/findings, test screenshot previews, and results once available.

Test Design

 

v0 Control

v1 Static

v2 Removed
(winner)

v0 Control

v1 Static

v2 Removed
(winner)

 

 

 

 

Hypothesis / Findings / Test Goals

Hypothesis:  

  • By making the Global Carousel Stripe static with one consistent message or by removing it entirely, we will reduce friction, thus increasing carousel engagement and purchases.

Goals & Success Metrics:

  • ↗️ Engagement

  • ↗️ Carousel promotion clicks

  • ↗️ Purchases

Target:  

Results, Recs, & Next Steps

  • Results:
    After 22 days of runtime, v2 (Carousel Removed) is a Winner! 

  • Engagement:
    Control saw more clicks to the carousel with stat sig. v1 saw 22% fewer clicks and v2 saw virtually no clicks due to the carousel element being removed. PDP page views are seeing small stat sig improvements under the two variations with a 0.46% lift for v1 and 0.83% increase for v2 (both with stat sig.).

  • Conversions:
    Transaction rate is showing great improvements for v1 and v2. v1 shows a 0.58% lift in transaction rate at 86% stat sig and v2 is showing a 1.18% lift with 99% stat sig.


  • Recommendations & Next Steps:
    Simplify site stripe banner or consider using the static version as the v2 variant (removed banner) outperformed the control and alternative variants. This indicates there are gains to be had through enhancing the banner’s display and functionality.

By The Numbers: ABTasty Data & Insights

Appendix & Notes

Related Info & Links  

Need more info?

For questions or if you’d like to discuss this ticket further please contact @Alex Alesio (Deactivated)
cc @benjamin.good / @john.morrison (Unlicensed)