Google’s John Mueller explains how often your web pages get indexed

, , , ,

If you operate a website that is frequently creating or changing pages – such as an e-retail or publishing site – you’ve probably noticed it can take Google a while to update the search engine with your new content.

This has led to widespread speculation about just how frequently Google indexes pages and why it seems like some types of websites get indexed more frequently than others.

In a recent Q&A video, Google’s John Mueller took the time to answer this directly. He explains how Google’s indexing bots prioritize specific types of pages that are more “important” and limit excessive stress on servers. But, in typical Google fashion, he isn’t giving away everything.

The question posed was:

“How often does Google re-index a website? It seems like it’s much less often than it used to be. We add or remove pages from our site, and it’s weeks before those changes are reflected in Google Search.”

Mueller starts by explaining that Google takes its time to crawl the entirety of a website, noting that if it were to continuously crawl entire sites in short periods of time it would lead to unnecessary strain on the server. Because of this, Googlebot actually has a limit on the number of pages it can crawl every day.

Instead, Googlebot focuses on pages that should be crawled more frequently like home pages or high-level category pages. These pages will get crawled at least every few days, but it sounds like less-important pages (like maybe blog posts) might take considerably longer to get crawled.

You can watch Mueller’s response below or read the quoted statement underneath.

“Looking at the whole website all at once, or even within a short period of time, can cause a significant load on a website. Googlebot tries to be polite and is limited to a certain number of pages every day. This number is automatically adjusted as we better recognize the limits of a website. Looking at portions of a website means that we have to prioritize how we crawl.

So how does this work? In general, Googlebot tries to crawl important pages more frequently to make sure that most critical pages are covered. Often this will be a websites home page or maybe higher-level category pages. New content is often mentioned and linked from there, so it’s a great place for us to start. We’ll re-crawl these pages frequently, maybe every few days. maybe even much more frequently depending on the website.”

/0 Comments

Google launches two new tools showing how your site compares to your competition

, , ,

Google has been banging the drum for speeding up mobile websites for what seems like forever now, and they’ve released numerous tools to try to help webmasters do just that. This week, at the Mobile World Congress in Barcelona, the search engine announced two more resources to show websites how they are performing – a new “Mobile Scorecard” and Conversion Impact Calculator.

The tools present marketers and webmasters with visual-heavy depictions of how their website stacks up to the competition and what they may be missing out on by not being quicker to load pages

Google’s Mobile Scorecard

The Mobile Scorecard uses data from the Chrome User Experience Report to compare the speed of several sites on mobile. This allows you to directly compare your site against your closest competitors in a race for the fastest website. According to Google, the Mobile Scorecard can give information on thousands of sites across 12 countries.

Even if you’re the leader of the pack, Google recommends making sure your site loads and becomes usable within five seconds on most mobile devices and within three seconds on 4G connections.

Google Conversion Impact Calculator

Of course, the biggest thing keeping most businesses from enhancing their websites for mobile devices is money. To help sway you towards making the investment, Google is launching the new Impact Calculator which shows how much revenue you could be missing out on because of a slow loading speed.

The calculator uses data from The State of Online Retail Performance report from April 2017. This report found that every second it takes for your web pages to load can hurt conversions by up to 20 percent.

The tool calculates your potential lost conversion revenue based on your average monthly visitors, average order value, and conversion rate.

Both the Mobile Scorecard and Impact Calculator are available to check out here.

/0 Comments

Enhance your email with AMP for Gmail

, , ,

Google is bringing its super-fast Accelerated Mobile Pages to email the company announced this week. During its conference in email, the company unveiled that developers can now take advantage of the mobile-friendly AMP framework when developing emails for Gmail.

The decision gives people the ability to create faster, sleeker emails with a higher level of interaction than typically possible.

Among the many things you can do by incorporating AMP into Gmail, Google recommends:

  • Creating content that is kept up-to-date in real-time
  • The ability for recipients to browse and interact with content
  • Users getting more done in less time without having to leave email.

From the announcement:

For example, say an external contractor wants to schedule a meeting with you but can’t see your calendar, so they send an email to get information on which dates and times you’re available. Within the email is a form to coordinate details. Thanks to AMP for Email, you can respond interactively through the form without having to click a link and redirect to another webpage. AMP for Email could also help you get more done in less time by allowing you to quickly RSVP to events, browse and interact with listings and campaigns, or fill out a questionnaire without ever leaving email.

Google also provided a few examples of what you can accomplish with AMP in Gmail:

AMP for Email does require a higher level of expertise to use, since it takes knowledge of coding to build emails with. Still, with a bit of work and some knowledge, the incorporation of AMP into email opens the door to many exciting possibilities for email.

/0 Comments

Google launches its own ad blocker for Chrome

, , , ,

Starting today, Google’s own web browser will start blocking troublesome ads across the net. The company has been warning they would be launching their own ad blocker since last June, and has officially started rolling out. By default, Google’s Chrome browser will remove ads from sites that use disruptive ad techniques.

“A big source of frustration is annoying ads: video ads that play at full blast or giant pop-ups where you can’t seem to find the exit icon,” said Rahul Roy-Chowdhury, vice president for Chrome. “These ads are designed to be disruptive and often stand in the way of people using their browsers for their intended purpose — connecting them to content and information. It’s clear that annoying ads degrade what we all love about the web.”

What is getting blocked?

The built-in ad blocker is designed specifically to filter out ads on any sites that repeatedly show offensive or disruptive ads. These include a wide swath of frequently used ad techniques including pop-ups, prestitial ads, and flashing banner ads.

Google is using the guidelines laid out by the Coalition for Better Ads (CBA) – a collective of advertising and media companies such as Facebook, Microsoft, and Unilever.

Rather than just block the offending ads, the tool will instead block ALL ads on any site that has broken the rules repeatedly. That means, all ads get stripped away is a publisher continues to let intrusive ads persist on their site after a warning.

Chris Bentzel, engineering manager for Chromium (an open-source version of Chrome), says Google is using this approach because webmasters are largely in control over what ads they choose to display.

“Although a few of the ad experiences that violate the Better Ads Standards are problems in the advertisement itself, the majority of problematic ad experiences are controlled by the site owner — such as high ad density or prestitial ads with countdown,” said Bentzel.

According to Bentzel, Google’s mission isn’t to block ads at all. They want to encourage webmasters to clean up their sites and deliver quality, unintrusive ads (like those offered by Google AdWords).

“Our goal is not to filter any ads at all but to improve the experience for all web users.”

According to The Guardian, approximately 42% of sites that have received warnings from Google ahead of the ad blocker have since altered their ad displays.

Why start blocking ads now?

The news that Google was designing its own ad blocker raised eyebrows when it was first announced. Considering Google runs perhaps the largest ad platform online, it is a bit like the pot calling the kettle black for the search engine to complain about ads.

More likely, the decision to launch an ad blocker of their own was motivated by the growing use of third-party ad blockers across the internet. While some ad blocker companies have partnered with Google to “whitelist” the ads from the search engine, many also strip out ads published from AdWords. This cuts into Google’s potential ad reach and can cause ad spend waste in some cases.

“We’ve already seen more and more people express their discontent with annoying ads by installing ad blockers, but blocking all ads can hurt sites or advertisers who aren’t doing anything disruptive,” said Roy-Chowdhury.

Estimates from PageFair indicate approximately 11% of internet users have third-party ad blockers installed.

“By focusing on filtering out disruptive ad experiences, we can help keep the entire ecosystem of the web healthy, and give people a significantly better user experience than they have today,” Roy-Chowdhury said.

For now, Google estimates its ad blocker will only affect around 1% of all ads. So, don’t get your hopes up for an ad revolution. Most users are unlikely to notice a huge change online, and only those who are most egregiously abusing the rules are expected to be hit.

/0 Comments

See your SEO performance through Google’s eyes with Chrome browser extension

, , ,

Google Lighthouse SEO Audit Tool

Google has announced a new set of tools for its Chrome Lighthouse developers extension that may finally make the tool relevant for both marketers and business owners

The Lighthouse extension is adding SEO audit metrics that make the tool an easy and fast way to see how Google perceives your website and what needs a tune-up.

The browser plugin already contains audits for things like performance, progressive web apps, accessibility, and Google best practices, but the inclusion of SEO metrics make it an all-in-one way to review your website’s performance.

A small (but revealing) look at your SEO

Of course, Google isn’t giving away everything with their tool. It only contains ten of the estimated hundreds of  ranking factors, which Google seems to view as most-essential for the average webmaster.

“The current list of SEO audits is not an exhaustive list, nor does it make any SEO guarantees for Google websearch or other search engines. The current list of audits was designed to validate and reflect the SEO basics that every site should get right, and provides detailed guidance to developers and SEO practitioners of all skill levels.”

Google notes that they expect to add more metrics in the future.

What is included?

The ten SEO ranking factors measured by Google Chrome’s lighthouse extension are:

  1. Meta Viewport Element
  2. Title Element
  3. Meta Description
  4. Page has successful HTTP status code
  5. Links have descriptive text
  6. Page isn’t blocked from indexing
  7. Document has a valid hreflang
  8. Document has a valid rel=canonical
  9. Document uses legible font sizes
  10. Document avoids browser plugins

Do you need it?

The Lighthouse extension’s SEO audit feature isn’t an elite-level tool that takes hours to learn and understand. It is a quick, brief overview of just a few of your site’s SEO signals that might reveal some of the basic things you’ve been overlooking or neglecting. If you haven’t used it, I strongly recommend giving it a try and checking out your site through Google’s eyes.

/0 Comments

Excessive retargeting may get your ads “muted” on Google

, , ,

Retargeting is undeniably a powerful way to reconnect with potential customers and remind them to take action on something they were interested in. Unfortunately, when done poorly, it can also be terribly annoying.

Now, Google is giving users the power to mute ads from brands who abuse retargeting or remarketing ads.

Retargeting ads – or as Google is calling them, “reminder” ads – are designed to gently nudge someone into taking action on a product or service they previously looked at on a website. They work by tracking what pages a user has looked at but not taken action on, then reserving that content in ads afterword.

The problem is that many fail to monitor just how frequently these ads appear to users. This causes a problem where people see an annoying number of repetitive ads that seem to follow them all around the internet.

 

With the new section in Google’s ads settings, called “Your reminder ads,” you can now see who is retargeting ads to you with Google display ads. You can also mute these advertisers individually is they are showing repetitive or excessive retargeting ads.

If a user mutes an advertiser, their ads will entirely disappear across all of Google’s apps and websites – not just a specific offending ad or campaign. Google says it will soon be expanding this to include YouTube, Search, and Gmail.

The advertiser will be muted for 90 days and can be muted again if desired.

Google also says it has updated the mute feature to sync across devices for logged-in users. This means ads muted on laptop will also be muted on a phone or desktop, and vice-versa.

While users will likely be glad to see this feature, advertisers should take the move as an indication to check their retargeting campaigns. Make an effort to find the “sweet spot” between showing your ads enough times to have an impact without being overbearing. Otherwise, you risk being muted.

/0 Comments

Page speed to become an official ranking signal for mobile Google searches

, , , ,

Google has been encouraging webmasters to make their sites as fast as possible for years, but now they’re making it an official ranking requirement.

The company announced this week that it will be launching what it is calling the “Speed Update” in July 2018, which will make page speed an official ranking signal for mobile searches.

Google recommends checking your site’s speed using its PageSpeed report, as well as using tools like LightHouse to measure page speed and improve your loading times.

As Google’s Zhiheng Wang and Doantam Phan wrote in the announcement:

The “Speed Update,” as we’re calling it, will only affect pages that deliver the slowest experience to users and will only affect a small percentage of queries. It applies the same standard to all pages, regardless of the technology used to build the page. The intent of the search query is still a very strong signal, so a slow page may still rank highly if it has great, relevant content.

While Google says the update will only affect a “small percentage of queries”, it is impossible to tell exactly how many will be impacted. Google handles billions of queries a day, so a small piece of that could still be a substantial number of searches.

This is the first time page speed will be made a ranking factor for mobile searches, but it has been a ranking factor on desktop since 2010. It makes sense to expand this to mobile since there is a wealth of evidence showing that mobile users prioritize loading time when clicking search results. If a page doesn’t load within three-to-five seconds, they are likely to leave the page and find another relevant search result.

/0 Comments

Google My Business officially launches videos in listings

, , , ,

After a few weeks of testing, Google My Business has officially announced that all business owners can now upload videos to their Google My Business listings.

Business owners can “view videos added by customers and upload videos about their business for customers to view,” said Google’s Allyson Wright.

Videos can be up to 30 seconds in length and may take up to 24 hours to become visible on the business listing in Google Maps and local search results.

Because others like Google’s “Local Guides” can also upload videos to business listings, GMB will also soon give businesses the ability to mark offensive or inappropriate videos on their listings.

To get started adding videos to your own listings, open your Google My Business Dashboard and click “photos,” followed by the “video” tab at the top of the page. From there, select the option to “Post Videos.”

Just drag and drop your video to the box.

Let it upload.

And wait for it to appear. Within about a day, the video should become visible for you and anyone who sees your listing.

Wright also provided these notes about the new feature:

  • Videos will appear in the overview tab of the Google My Business Dashboard.
  • Customer uploaded videos can be found in the “customer” tab.
  • Merchant uploaded videos can be found in the “by owner” tab.
  • All videos can be viewed together in the “videos” tab.
  • After upload, it could take up to 24 hours for the videos to appear. Once live, they will display where local photos do.
/0 Comments

Google My Business starts letting some upload videos to their listings

, , , ,

Business owners may be able to upload videos to their Google My Business accounts in the near future, based on a new feature popping up for some account owners.

Colan Nielsen from SterlingSky noticed that some of his clients now had access to a new panel for uploading videos showcasing their stores or products.

Several others have since reported seeing the option appearing in their own accounts, however, not everyone says they can use the feature quite yet.

For now, it is unclear whether the feature is just one of the many tests Google runs on a regular basis or a slow rollout of a widely anticipated feature. Google has yet to release a statement on the issue.

It’s worth noting that this isn’t the first time videos have started showing up in GMB accounts. During the earlier years of Google My Business, Google included a similar video upload option. The tool disappeared long ago.

Since then, Google has allowed “Local Guides” – volunteers who help Google gain in-person information about businesses – have been able to upload videos to local listings. Actual business owners or account operators have not been able to until now, though.

While many can already upload videos, few have reported actually seeing their videos show up on their listings yet. When they do appear, videos are likely to be shown under the photos tab, as they do in the listing for Voodoo Doughnut in Portland:

Business owners using GMB have been asking for the ability show videos for years because they can provide a more complete view of both their stores and their products. Hopefully, the appearance of this feature for some is a sign of a much wider roll-out coming soon.

/0 Comments

Twitter makes tweetstorms an official feature with “threads”

, , ,

Tweetstorms have grown from a user-initiated trick to get past Twitter’s original 140-character limit into a legitimate feature this week, as Twitter launches a new feature to combine tweets into a longer statement.

In a blog post, the company says the ability to tie tweets into what they are calling a “thread” will be rolling out to all Twitter users “in the coming weeks.”

Since the launch of Twitter, it has been tradition for users to reply to their own tweets to expand on what they want to say. Often, these tweets and replies will be labeled with numbers to make it clear what order to read them in.

Now, Twitter is simplifying the process with a “+” button which lets them continue their thought in a thread. The process can be repeated to make threads as long as users need (up to 25 threads). People will also be able to add tweets to new threads.

Thanks to the new feature, the way tweetstorms or threads are shown in people’s feeds will also be changing. Instead of scrolling through the list of tweets in replies, users can simply click a “show this tread” label to expand the full set of tweets.

The decision to launch the thread feature now is an interesting one. The company has already expanded the maximum length of tweets to allow users to fit more in at a time. With the latest move, Twitter has made it clear that brevity is quickly falling down their list of priorities in favor of more complex conversations.

/0 Comments