Yankee PLP Star-Rating (##) Reviews Presentation π Learner (ABT-109 cxp.009)
This wiki page is designed to summarize and capture our AB experiment goals, screen shot previews, and results after a test concludes.
Experiment Name:Β
new-22-009
PLP | Star-Rating # Reviews presentation (Yankee)
AB Experiment Previews:
Screen Shots, Video Capture, & Preview links
Video Capture Preview:
Experiment Design
Β
Hypothesis: Β
By adding the number of reviews underneath the stars on products within the PLP,
we will illustrate product popularity accurately, decreasing user hesitations, increasing βAdd to Bagβ CTA clicks and conversions.
Goals:
β Add to Bag CTA Clicks
β Conversions
Target: Β
Yankee DTC website ( YankeeCandle.com )
All Users
All PLP PagesΒ Β Β Β
Results & RECs:
Results:
The Verdict: The test ran for 14 days and the results are inconclusive.
Interactions: We are seeing a decline in add to bag clicks by nearly 14% on PLP, which is unintended and not ideal, but no stat sig decrease on PDP visits.
Conversions: We are not seeing any stat sig impact on order confirmation page visits or other checkout page visits between either variation. Note: Test duration calculator based on order conf page is suggesting this test is at its end. We segmented by Device, Loyalty, and other filters and found no differences among users.)
Recommendation:
Conclude the test and move on to more fruitful tests.
This is a good reminder that users may say one thing but do another, in that reviews are important to them, but maybe not on the PLP.
Results by The Numbers: AB Tasty Data
Β
Β
AB Tasty Preview Links:Β
Β