Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

About: This wiki page captures the latest AB Experimentation learnings and captures what we have logged via VOC to ensure Productization occurs as we conclude and learn from our AB Tests.

...

Experiment
Status 

Experiment Name
& Hypothesis

Test
Timing

Test Details
(Metrics, etc.)

In-Flight  

[22.007]  

PLP & HP Quantity Selector removal (Yankee)   

Hypothesis: By removing the Quantity Selector on the PLP, we will reduce user friction and hesitation on the PLP, increasing PDP visits, add to bag clicks, and conversions.

Aug Launched  

↑ PDP Tile Clicks
↑ Conversions  

For more details, visit this test’s wiki page.   

  

In-Flight  

[22.009]  

PLP Star-Rating # Reviews presentation (Yankee)   

Hypothesis: By adding the number of reviews underneath the stars on products within the PLP, we will illustrate product popularity accurately, decreasing user hesitations, increasing “Add to Bag” CTA clicks and conversions.

Aug Launched  

↑ Add to Bag CTA Clicks
↑ Conversions  

For more details, visit this test’s wiki page.

Coming Soon  In-Flight 

[22.008]

Checkout UI simplification (padlock icon removal)   

Hypothesis: By updating or removing the padlock icon we will decrease confusion within checkout, increasing conversions.

Aug Launched 
(Aug30)

↑ Conversions
↑ Engagement

For more details, visit this test’s wiki page.





Coming Soon  

[ODYI-1513]

Checkout | Skip Login Screen by relocating login option to appear within Shipping Step

Hypothesis: Removing the separate Login Screen (within the Checkout flow) will create an overall easier shopping-to-checkout experience for our customers and improve conversion rates.

Sept Launch planned  
(pending Yankee biz feedback)

↑ Conversions
↑ Engagement

More details on Jira Page.

Coming Soon  

[ODYI-1510]

Mini Cart | add Checkout CTA Button

Hypothesis: Giving users the option to bypass the (full) Cart will help conversion rates and create an easier shopping-to-checkout experience.

Sept Launch planned  
(pending Yankee biz feedback)

↑ Conversions

More details on Jira Page.

Coming Soon  

[22.0100xx]  

Global NAV | Bag Icon Functionality functionality update (mini-cart toggle)

Sept Launch planned  

↑ Conversions
↑ Engagementexpand Mini-Cart instead of current switching pages to full cart)

Hypothesis: Making the bag icon open a mini cart will allow users to view their cart without leaving product pages which will increase the average number of items users add to their cart before checkout.

Findings: Once a user adds a product to bag they are presented with a mini cart; but there is no other way to produce said mini cart later.

Sept Launch planned  
(pending Yankee biz feedback)

↑ Average Order Revenue
↑ Conversions

For more details, visit this test’s wiki page.

Coming Soon  

[22.011]  

PDP Return & Exchange Copy   

Hypothesis: By adding copy about returns and exchanges in the PDP product detail section, we can boost user confidence and increase conversions.

Sept Launch planned  

↑ Conversions
↑ Engagement


(pending Yankee biz feedback)

↑ Add to Cart Clicks
↑ Conversions


For more details, visit this test’s wiki page

Coming Soon  

[22.012]  

Global | Auto-Ship Messaging   

Hypothesis: By updating the auto-ship language, we will increase the number of auto-ship toggle clicks and transactions with auto-ship.

Sept Launch planned  
(pending Yankee biz feedback)

↑ Conversions
↑ Engagement↑ Auto-Ship Toggle Click
↑ Transactions with Auto-Ship

For more details, visit this test’s wiki page

Coming Soon  

[22.010] 

Checkout | Shipping Address Changes Message

Hypothesis: By adding Shipping Address Changes messaging to checkout, we will reduce friction in the checkout flow, increasing continuation and conversions.

Sept
( or October )
Launch planned  
(pending Yankee biz feedback)

↑ Conversions

For more details, visit this test’s wiki page.

Coming Soon  

(Your Experiment Here!) 

The future  

See details below and submit your hypothesis today!

  

Do you have an idea for an experiment?

...