This wiki page captures our AB experiment’s hypothesis, goals, supporting data/findings, test screenshot previews, and results once available.
...
Test Design
v0 Control | v1 Static | v2 Removed |
|---|---|---|
 |  |  |
...
Hypothesis / Findings / Test Goals
...
Results, Recs, & Next Steps
Results:
After 22 days of runtime, v2 (Carousel Removed) is a Winner!
...
Engagement:
Control saw more clicks to the carousel with stat sig. v1 saw 22% fewer clicks and v2 saw virtually no clicks due to the carousel element being removed. PDP page views are seeing small stat sig improvements under the two variations with a 0.46% lift for v1 and 0.83% increase for v2 (both with stat sig.).Conversions:
Transaction rate is showing great improvements for v1 and v2. v1 shows a 0.58% lift in transaction rate at 86% stat sig and v2 is showing a 1.18% lift with 99% stat sig.
Recommendations & Next Steps:
. (original CXperts Dec8 Rec: implement Winning variant (v2) and remove the carousel)
Simplify site stripe banner or consider using the static version as the v2 variant (removed banner) outperformed the control and alternative variants. This indicates there are gains to be had through enhancing the banner’s display and functionality.
...
By The Numbers: ABTasty Data & Insights
...
VOC Ticket Logged: ODYI-1806 to drive Odyssey platform enhancements.
Wiki Page: Winner ⭐️ Yankee Global Carousel Stripe (ABT-119 CXPcxp.019)
ABT Jira Ticket: ABT-119
Test Variants:
...
...
Need more info?
For questions or if you’d like to discuss this ticket further please contact Alex Alesio (Deactivated)
cc benjamin.good / john.morrison (Unlicensed)