Recommendation & Results:

Test Results
- Results: this ran for 22 days and v2 (Carousel Removed) is a Winner!

Engagement: Control saw more clicks to the carousel with stat sig. v1 saw 22% fewer clicks and v2 saw virtually no clicks due to the carousel element being removed. PDP page views are seeing small stat sig improvements under the two variations with a 0.46% lift for v1 and 0.83% increase for v2 (both with stat sig.).
Conversions: Transaction rate is showing great improvements for v1 and v2. v1 shows a 0.58% lift in transaction rate at 86% stat sig and v2 is showing a 1.18% lift with 99% stat sig.

Recommendations:
- Simplify site stripe banner -OR- use static version as the v2 variant (removed banner outperformed the control and alternative variants indicating there are gains to be had through enhancing the banner’s display and functionality.
- (original CXperts Dec8 Rec: implement Winning variant (v2) and remove the carousel.

Related Info & Links

For questions or if you’d like to discuss this ticket further please contact Alex Alesio (Deactivated)
cc benjamin.good / john.morrison (Unlicensed)

This wiki page captures our AB experiment’s hypothesis, goals, supporting data/findings, test screenshot previews, and results once available.

[ Test Design Image ]