Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Recommendation & Results:

  • Test Results

    • Results: this ran for 22 days and v2 (Carousel Removed) is a Winner! 

...

  • Engagement: Control saw more clicks to the carousel with stat sig. v1 saw 22% fewer clicks and v2 saw virtually no clicks due to the carousel element being removed. PDP page views are seeing small stat sig improvements under the two variations with a 0.46% lift for v1 and 0.83% increase for v2 (both with stat sig.).

  • Conversions: Transaction rate is showing great improvements for v1 and v2. v1 shows a 0.58% lift in transaction rate at 86% stat sig and v2 is showing a 1.18% lift with 99% stat sig.

...

  • Recommendations:

    • Simplify site stripe banner -OR- use static version as the v2 variant (removed banner outperformed the control and alternative variants indicating there are gains to be had through enhancing the banner’s display and functionality.

    • (original CXperts Dec8 Rec: implement Winning variant (v2) and remove the carousel.

...

...

Need more info?

For questions or if you’d like to discuss this ticket further please contact Alex Alesio (Deactivated)
cc benjamin.good / john.morrison (Unlicensed)

...

⚠️ ( WIP / update in progress ) ⚠️

This wiki page captures our AB experiment’s hypothesis, goals, supporting data/findings, test screenshot previews, and results once available.

[ Test Design Image ]

...

Hypothesis / Findings / Test Goals

Hypothesis:  

Findings:

Goals:

Target:  

...

Results, Recs, & Next Steps

  • Results:

    • xxxxxxx

  • Recommendations & Next Steps:

    • xxxxxx   

...

By The Numbers: ABTasty Data & Insights

...

Appendix & Notes

Related Links:

  • ABT Jira ticket:
    xxxxxx

  • VOC / Odyssey enhancement ticket:
    xxxxxxxx

...