Inflow - Attract Convert Grow

Inflow: eCommerce Marketing Agency

  • Services
    • SEO
    • PPC
    • CRO
    • Paid Social
  • Clients
    • Case Studies
  • About Us
    • Contact Us
  • Insights Blog
  • Request Proposal
  • Services
    • SEO
    • PPC
    • CRO
    • Paid Social
  • Clients
    • Case Studies
  • About Us
    • Contact Us
  • Insights Blog
  • Request Proposal

Home > eCommerce Digital Marketing Blog > Conversion Rate Optimization > A/B Testing > Measuring Success of eCommerce Website Testing

Measuring Success of eCommerce Website Testing

Posted By Michael Kuehn on April 28, 2015

  • 3shares

measure successI recently wrote a post about some of the common challenges I’ve encountered running testing programs for my clients. I’d like to expand on one of them – selecting KPIs. I was reading a post the other day about the three Cardinal Sins of KPIs and Performance Metrics[i] and realized that many eCommerce managers make the mistake of defaulting to their primary business KPIs as the measure of success for every test. While the goal of testing is ultimately to impact these business KPIs, it is important to recognize how each step in the process impacts the whole.

When selecting KPIs for your business, it makes sense to focus on things that impact the bottom line – what’s my end goal conversion rate and AOV, how many users are finding products and adding them to the cart, how many users are signing up for email or registering, etc. These metrics can tell you important information about the health of your business, and by measuring them regularly over time you can get an early read when things are changing, or when your own changes significantly impact your business.

For testing, selecting KPIs is very different. Just like your business has a main goal and specific metricswaterfall that can tell you how you’re performing against your goal, each test you run should have a clear goal and associated metrics. Sometimes, the main goal of your test may have nothing to do with your primary website metrics. For example, one of my clients recently ran a test optimizing their careers page because they needed to get more workers in the field – could you imagine judging that test on it’s impact to service leads instead of applications submitted?

While the above example should be fairly obvious to most, other situations are more nuanced. Take homepage tests, for example. The goal of your homepage should be to get users to another page on your site as fast as possible. The likelihood of changes to your homepage having a significant impact on your bottom line is small, but if you measure the impact to either a category or product page, you are likely to make a noticeable impact. The problem with going from the homepage straight to the final conversion metric is that there are too many decision points in the middle. If your test reduces bounce rate from the homepage and gets users looking at more products, that’s a win even if it doesn’t result in purchases. Your takeaway from this test shouldn’t be that you didn’t have an impact on orders, it should be to find where you lost the users you’ve pushed further down the funnel and optimize the new drop-off point.

To ensure that you are not selecting KPIs that are too far from your test, I like to break the larger conversion funnel into several smaller funnels. At a minimum, every eCommerce site has at least two flows – landing page to cart, and cart to confirmed order. For checkout, I actually prefer to separate the cart as its own single goal page – get users into the checkout flow – then look at the next page through order complete as a separate flow. The important thing here is that you choose success metrics for your tests that can be directly impacted by your changes, then optimize each successive step in the flow as you drive more users to it. This is known as the waterfall approach to testing. Ultimately, the flows you look at will depend upon your unique business.

 

[i] https://www.linkedin.com/pulse/3-cardinal-sins-kpis-performance-metrics-bernard-marr

  • 3shares

0 Comments on "Measuring Success of eCommerce Website Testing"

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Posts

  • Improving eCommerce Site Speed for Higher Conversions, Traffic & Rankings Increasing the speed of your website can improve search engine rankings, attract more traffic, lower bounce rates and lift conversion rates. However, making an eCommerce website faster is […]
  • B2B and eCommerce Inbound Marketing Compared I recently attended a HubSpot User Group meeting in Denver, CO. Mike Vittum from HubSpot was the guest speaker and he presented an awesome session on Inbound Marketing and landing pages. I […]
  • eCommerce Marketing Outlook: How eCommerce Companies Are Navigating the COVID-19 Demand Shock We surveyed 18 eCommerce clients on their marketing plans during the current COVID-19 crisis. Here are the results.
Michael Kuehn on couch with dog.

Michael Kuehn

With more than five years of digital marketing experience, Michael Kuehn combines analytics-based decision-making with a passion for user experience. In addition to CRO, Kuehn is experienced in both project and product management, having previously managed five software units for a leading loyalty website.

View Author’s Profile

Related Categories

  • A/B Testing (11)
  • eCommerce Page CRO (10)
  • Mobile Conversion Optimization (5)
  • Tools and Plugins (14)
  • Usability (5)
  • Most Popular Posts:

    eCommerce Marketing Automations Systems Compared
    Technical Mobile Best Practices for SEO and Usability
    Expanding the Horizons of eCommerce Content Strategy
    Thin & Duplicate Content: eCommerce SEO
    5 Ways eCommerce Content Audits Can Increase Revenue
    Want to get content like this straight to your inbox? Subscribe to our weekly content alerts and monthly Inflow Insights newsletter now.

    Categories

    • SEO
      • Content Marketing
      • Link Building
      • On-Page SEO
      • SEO Strategy
      • Technical SEO
    • Paid Advertising
      • Goal Metrics and Analytics
      • Paid Search
      • Paid Search Shopping
      • Paid Social
    • Conversion Rate Optimization
      • A/B Testing
      • eCommerce Page CRO
      • Mobile Conversion Optimization
      • Tools and Plugins
      • Usability
    • Case Studies
    • eCommerce Strategy
      • KPIs and Reporting
    • Digital Marketing Trends in eCommerce
    • Inflow News

    Request a Proposal

    We'll build a custom proposal to meet your goals. Get the process started now.

    Google Premier PartnerInflow is a facebook-certified-creative-strategy-professional Moz Recommended Company Inc 5000 Inflow Clutch Profile
    • Services
      • SEO
      • PPC
      • Conversion
    • Case Studies
      • SEO
      • PPC
      • Conversion
    • Insights Blog
    • Resources
    • More
      • Contact
      • Careers
      • Press Info
      • Privacy Policy
    REQUEST A PROPOSAL
     
    CALL US AT 303-905-1504
    Monday - Friday, 8 a.m. - 6 p.m. (MST)
     
    facebook twitter linked-in linked-in rss

    Send this to a friend