Yankee PLP Star-Rating (##) Reviews Presentation πŸ“ Learner (ABT-109 cxp.009)

This wiki page is designed to summarize and capture our AB experiment goals, screen shot previews, and results after a test concludes.

Experiment Name:Β 

new-22-009 PLP | Star-Rating # Reviews presentation (Yankee)


AB Experiment Previews:
Screen Shots, Video Capture, & Preview links

Video Capture Preview:


Experiment Design

Β 


Hypothesis: Β 

  • By adding the number of reviews underneath the stars on products within the PLP,
    we will illustrate product popularity accurately, decreasing user hesitations, increasing β€œAdd to Bag” CTA clicks and conversions.

Goals:

  • ↑ Add to Bag CTA Clicks

  • ↑ Conversions

Target: Β 


Results & RECs:

Results:

  • The Verdict: The test ran for 14 days and the results are inconclusive.

  • Interactions: We are seeing a decline in add to bag clicks by nearly 14% on PLP, which is unintended and not ideal, but no stat sig decrease on PDP visits.

  • Conversions: We are not seeing any stat sig impact on order confirmation page visits or other checkout page visits between either variation. Note: Test duration calculator based on order conf page is suggesting this test is at its end. We segmented by Device, Loyalty, and other filters and found no differences among users.)


Recommendation:

  • Conclude the test and move on to more fruitful tests.

  • This is a good reminder that users may say one thing but do another, in that reviews are important to them, but maybe not on the PLP.


Results by The Numbers: AB Tasty Data

Β 

Β 





AB Tasty Preview Links:Β 

Β 


Open / Next Step:

QA’d by @Alex Alesio (Deactivated) . Sent feedback to Rohan (Aug4 530p)
Rohan resolved PLP White / Grey BG color changes??
CXP sent to for approval to Yankee biz
Approved by @Imran Khan
Launched 2022 Aug 15
Test Completed 2022 Sept ___
Results (early preview)
Results (full report)