Skip to end of banner
Go to start of banner

Yankee PLP Star-Rating (##) Reviews Presentation (ABT-109)

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 14 Current »

This wiki page is designed to summarize and capture our AB experiment goals, screen shot previews, and results after a test concludes.

Experiment Name

new-22-009 PLP | Star-Rating # Reviews presentation (Yankee)


Video Capture Preview:

AB Test 009 QA Preview 2022-08-12 1pm SR Very Low-64k.mov

Experiment Design


Hypothesis:  

  • By adding the number of reviews underneath the stars on products within the PLP,
    we will illustrate product popularity accurately, decreasing user hesitations, increasing “Add to Bag” CTA clicks and conversions.

Goals:

  • ↑ Add to Bag CTA Clicks

  • ↑ Conversions

Target:  


Results & RECs:

Results:

  • The Verdict: The test ran for 14 days and the results are inconclusive.

  • Interactions: We are seeing a decline in add to bag clicks by nearly 14% on PLP, which is unintended and not ideal, but no stat sig decrease on PDP visits.

  • Conversions: We are not seeing any stat sig impact on order confirmation page visits or other checkout page visits between either variation. Note: Test duration calculator based on order conf page is suggesting this test is at its end. We segmented by Device, Loyalty, and other filters and found no differences among users.)


Recommendation:

  • Conclude the test and move on to more fruitful tests.

  • This is a good reminder that users may say one thing but do another, in that reviews are important to them, but maybe not on the PLP.


Results by The Numbers: AB Tasty Data




AB Tasty Preview Links


Open / Next Step:

  • QA’d by Alex Alesio (Deactivated) . Sent feedback to Rohan (Aug4 530p)
  • Rohan resolved PLP White / Grey BG color changes??
  • CXP sent to for approval to Yankee biz
  • Approved by Imran Khan
  • Launched 2022 Aug 15
  • Test Completed 2022 Sept ___
  • Results (early preview)
  • Results (full report)
  • No labels