Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Recommendation & Results:

Test Results

...

This wiki page captures our AB experiment’s hypothesis, goals, supporting data/findings, test screenshot previews, and results once available.

...

Hypothesis / Findings / Test Goals

Hypothesis:  

  • By making the Global Carousel Stripe static with one consistent message or by removing it entirely, we will reduce friction, thus increasing carousel engagement and purchases.

Goals & Success Metrics:

  • ↗️ Engagement

  • ↗️ Carousel promotion clicks

  • ↗️ Purchases

Target:  

...

Results, Recs, & Next Steps

  • Results: After 22 days of runtime, v2 (Carousel Removed) is a Winner! 

...

  • Engagement: Control saw more clicks to the carousel with stat sig. v1 saw 22% fewer clicks and v2 saw virtually no clicks due to the carousel element being removed. PDP page views are seeing small stat sig improvements under the two variations with a 0.46% lift for v1 and 0.83% increase for v2 (both with stat sig.).

  • Conversions: Transaction rate is showing great improvements for v1 and v2. v1 shows a 0.58% lift in transaction rate at 86% stat sig and v2 is showing a 1.18% lift with 99% stat sig.

...

  • Recommendations & Next Steps:

    • Simplify site stripe banner -OR- use or consider using the static version as the v2 variant (removed banner) outperformed the control and alternative variants indicating . This indicates there are gains to be had through enhancing the banner’s display and functionality.

    • (original CXperts Dec8 Rec: implement Winning variant (v2) and remove the carousel).

...

By The Numbers: ABTasty Data & Insights

...

Appendix & Notes

...

Test Variants:

Image AddedImage AddedImage Added

...

Need more info?

For questions or if you’d like to discuss this ticket further please contact Alex Alesio (Deactivated)
cc benjamin.good / john.morrison (Unlicensed)

⚠️ ( WIP / update in progress ) ⚠️

This wiki page captures our AB experiment’s hypothesis, goals, supporting data/findings, test screenshot previews, and results once available.

[ Test Design Image ]

Hypothesis / Findings / Test Goals

Hypothesis:  

Findings:

Goals:

Target:  

Results, Recs, & Next Steps

  • Results:

    • xxxxxxx

  • Recommendations & Next Steps:

    • xxxxxx   

By The Numbers: ABTasty Data & Insights

Appendix & Notes

Related Links:

  • ABT Jira ticket:
    xxxxxx

  • VOC / Odyssey enhancement ticket:
    xxxxxxxx

For additional information contact Alex Alesio (Deactivated).