Google Says If You’ve Blocked GoogleBot
There are many webmasters who have their reason to block GoogleBot from their site. Your site can still be listed, but if you’ve prevented the GoogleBot from crawling your pages Google will display it clearly in the SERPs. Instead of showing the standard description tag (or another snippet) it will say, “A description for this result is not available because of this site’s robots.txt – learn more.” This may be worth knowing if you care about what displays on Google when people find you there and you’ve been blocking the GoogleBot.
Read the full article here:
Google Search Descriptions Now Say If GoogleBot Is Blocked
Leave a Reply
Want to join the discussion?Feel free to contribute!