inflow-logo

Inflow: eCommerce Marketing Agency

  • Services
    • SEO
    • PPC
    • CRO
    • Paid Social
  • Clients
    • Case Studies
  • About Us
    • Contact Us
  • Insights Blog
  • Request Proposal
  • Services
    • SEO
    • PPC
    • CRO
    • Paid Social
  • Clients
    • Case Studies
  • About Us
    • Contact Us
  • Insights Blog
  • Request Proposal

Home > eCommerce Digital Marketing Blog > SEO > Technical SEO > The Stalker (2 of 9 Winning Plays) – Screaming Frog Reports for Googlebot Mobile

The Stalker (2 of 9 Winning Plays) – Screaming Frog Reports for Googlebot Mobile

Posted By The Inflow Team on June 20, 2017

  • 9shares

inflow_featured-post-stalker

Did you know Google will soon be giving more weight to what their mobile bot finds on your website than what’s found by the desktop-oriented Googlebot they’ve used to crawl the web for the last decade? Learn more here.

About the Play

The Stalker is from page six of our eCommerce Marketing Playbook, which outlines three tactics from SEO, PPC and Conversion Optimization for a total of nine eCommerce marketing “plays”. This play will help SEOs prepare their website for Google’s “Mobile First” update by crawling and rendering the site with settings that mimic the mobile-centric “Googlebot” crawler.

Who’s It For?

Search Engine Optimization Professionals
SEO-Savvy Marketers Familiar with Screaming Frog

When to Use It:

This is a good exercise for any site, but it is most important for SEOs working on domains with a dynamic mobile aspect, meaning the content itself, the or user-experience, might change significantly. Use The Stalker when:

  • Crawling “app-like” mobile sites (e.g. Single Page Web Application)
    • In this example the SPA is only served to mobile visitors. The standard desktop site is served to others. the mobile site, or when the mobile site is on another domain.
  • Crawling “dynamically served” mobile sites
    • In which content not only shifts in size and location (as in responsive fluid grid) but entire paragraphs might be removed from the mobile version, as outlined here.

This play involves crawling your entire website using a mobile crawlbot that can render JavaScript, HTML, and CSS into a mobile-sized version of the page.

You will then have a screenshot of how the page appears when rendered by a mobile crawler, as well as data about any differences between the two versions, such as different content, meta tags, or other technical SEO features.

Why Stalk Your Own Website as a Mobile Crawler?

We recently came across a domain on which every Title Tag on the mobile version of the site was the same: “Brand Mobile Site”. There were hundreds of thousands of these. On that same site, there was a technical issue causing the Rel Canonical tag to break on mobile, but not on desktop. This would have likely been catastrophic in the short term once Google rolled out their “mobile first” index for all users (including those on desktop).

How to Execute The Stalker

Get Screaming Frog

First, if you do not have the latest version of Screaming Frog (7.+), go download it. The free version gives you 500 URLs, but not all of the necessary features. We recommend buying the software, which is very affordable.

The Stalker - Screaming Frog Screenshot

You can do the same thing with DeepCrawl, Sitebulb, and other SEO crawlers with some adjustments to the process below.

Put Screaming Frog Into Mobile Stalker Mode:

Open Screaming Frog and click “Configuration” in the top menu. Then from the dropdown, select “Spider”.

Go to the “Rendering” tab and select “JavaScript” from the dropdown. If this is your first crawl of the site in mobile mode, we recommend checking “Enable Rendered Page Screen Shots,” which will drastically slow things down, but will show you what the rendered mobile page would look like to Google.

The Stalker - Screaming Frog Screenshot, Stalker Mode

Learn more about Screaming Frog’s Rendering feature, and other configuration options in their setup guide. If this is your first time using Screaming Frog, start here.

Run All the Reports

My favorite way to start is by exporting all of the reports, and opening them up one at a time in Excel, looking for anything suspicious, such as thousands of duplicate title tags that just read “Mobile Site” or missing/broken rel canonical and rel alternate tags.

Screaming Frog offers many helpful views and reports for determining the health of your website. Who knows what you’re going to find until you crawl and render as a mobile spider!

The Stalker Resources

Screaming Frog SEO Spider V 7.0 (now with JS rendering)

Screaming Frog JS Crawling Setup Guide

Moz Mobile SEO Guide

Mobile Optimization by Inflow

Let Inflow’s eCommerce SEO team help strategize and implement this play for you on one category. Earn links, rankings, and conversions all at the same time. A triple win!

Start Today!

  • 9shares

0 Comments on "The Stalker (2 of 9 Winning Plays) – Screaming Frog Reports for Googlebot Mobile"

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Posts

  • “Mobilus Maximus” PPC Strategy for Mobile Conversion Rate Improvement (1 of 9 Winning Plays) With a dramatic increase in mobile use and improvement in mobile site functionality, mobile devices have become a huge part of the customer buying experience. As such, it’s more important […]
  • McAfee Trust Seals vs Norton Trust Badges for eCommerce In this article, we'll show you 3 of Norton and McAfee trust seals that led to an increase in revenue. Learn more about when and how to use trust seals on your site.
  • Research and Analysis of the Top 50 eCommerce Brands’ Facebook Ads How do the top eCommerce companies use Facebook ads? We analyzed 50 top companies to find out what eCommerce Facebook ads they were running. Here are the trends we found.
Inflow Team Icon

The Inflow Team

This article was written by a member of the past or present Inflow team.

View Author’s Profile

Related Categories

  • Content Marketing (13)
  • Link Building (16)
  • On-Page SEO (14)
  • SEO Strategy (10)
  • Technical SEO (33)
  • Most Popular Posts:

    eCommerce Marketing Automations Systems Compared
    Technical Mobile Best Practices for SEO and Usability
    Expanding the Horizons of eCommerce Content Strategy
    Thin & Duplicate Content: eCommerce SEO
    5 Ways eCommerce Content Audits Can Increase Revenue
    Want to get content like this straight to your inbox? Subscribe to our weekly content alerts and monthly Inflow Insights newsletter now.

    Categories

    • SEO
      • Content Marketing
      • Link Building
      • On-Page SEO
      • SEO Strategy
      • Technical SEO
    • Paid Advertising
      • Goal Metrics and Analytics
      • Paid Search
      • Paid Search Shopping
      • Paid Social
    • Conversion Rate Optimization
      • A/B Testing
      • eCommerce Page CRO
      • Mobile Conversion Optimization
      • Tools and Plugins
      • Usability
    • Case Studies
    • eCommerce Strategy
      • KPIs and Reporting
    • Digital Marketing Trends in eCommerce
    • Inflow News

    Request a Proposal

    We'll build a custom proposal to meet your goals. Get the process started now.

    Google Premier PartnerInflow is a facebook-certified-creative-strategy-professional Moz Recommended Company Inc 5000 Inflow Clutch Profile
    • Services
      • SEO
      • PPC
      • Conversion
    • Case Studies
      • SEO
      • PPC
      • Conversion
    • Insights Blog
    • Resources
    • More
      • Contact
      • Careers
      • Press Info
      • Privacy Policy
    REQUEST A PROPOSAL
     
    CALL US AT 303-905-1504
    Monday - Friday, 8 a.m. - 6 p.m. (MST)
     
    facebook twitter linked-in linked-in rss

    Send this to a friend