Report Indicates LLMs.txt Files Have No Impact On AI Visibility

,

LLMs.txt files, an increasingly popular method to improve visibility in AI search, may not be as effective as previously thought.

After reviewing over 300,000 domains, a new analysis from SE Ranking found that LLMs.txt files have no noticeable effect on visibility in major LLMs. 

What Are LLMs.txt Files?

LLMs.txt files are files uploaded alongside your website with the intention of helping AI tools understand your domain and more easily navigate or index your site. In recent months, these..txt files have begun to catch on as a relatively easy way to optimize your site for major AI tools.

They are similar to robots.txt files, which are widely used to optimize websites for search engines like Google or Bing. 

While robots.txt files are well-established as an effective and simple SEO tool, it has been unclear whether any major LLM has begun using LLMs.txt files when indexing websites. 

Slow Adoption

As a new optimization strategy, LLMs.txt files have seen relatively slow adoption. According to SE Ranking’s data, just 10.13% of domains crawled for the study had implemented these files as an optimization strategy. 

Part of the reason for the slow adoption of these files is the lack of research or clear data showing their impact.

Notably, the sites that were most likely to use these files were mid-tier websites likely looking for any edge against high-traffic competition. 

Data Says LLMs.txt Files Are Not Tied To Visibility

For SE Ranking’s study, a team of researchers analyzed how frequently domains were cited across responses from several popular LLMs. 

Ultimately, their data was unable to provide any evidence that the strategy had any real effect, even when using alternate research models to compare.

While the study doesn’t outright discourage people from implementing LLMs.txt files, the researchers conclude fairly bluntly that LLMs.txt “doesn’t seem to directly impact AI citation frequency. At least not yet.”

Robots.txt Is Still Used – Even By AI

While LLMs.txt files had been gradually gaining popularity, the reality is that none of the major AI tools have indicated they use these files when crawling or indexing websites. 

Aside from limited data suggesting GPTBot sometimes fetches LLMs.txt files, there is no evidence of any major LLM using or recommending implementing these files. 

Instead, OpenAI encourages websites to focus on robots.txt files and Google seemingly defers to these types of files when crawling or indexing pages. 

For more about the analysis and how it was conducted, read SE Ranking’s full report here.

/0 Comments

Google’s VP of Search Talks AI and Why People Still Want Human Perspectives

, ,

Google VP of Search, Liz Reid, recently spoke with The Wall Street Journal in a revealing interview focusing on the company’s approach to content as AI becomes more deeply integrated in both its search engine and society at large. 

Google Strives To Give Users What They Want

Liz Reid made it clear that what content Google decides to surface in both AI overviews and traditional search results are shaped heavily by user feedback.:

“…we do have to respond to who users want to hear from, right? Like, we are in the business of both giving them high quality information, but information that they seek out. And so we have over time adjusted our ranking to surface more of this content in response to what we’ve heard from users.

…You see it from users, right? Like we do everything from user research to we run an experiment. And so you take feedback from what you hear, from research about what users want, you then test it out, and then you see how users actually act. And then based on how users act, the system then starts to learn and adjust as well.”

This reflects how Google doesn’t just look for “the best content” but instead ranks “the best content for its users”. It is a small but important distinction which can have significant implications for what content gets seen on the search engine. Smart businesses and marketers will keep this in mind when creating online content. Don’t just make great content. Make great content that people want to engage with. 

Is AI Content Automatically Bad?

When discussing the idea of high quality content, Reid takes a moment to discuss AI content. Specifically she indicates that the search engine is essentially neutral about AI-generated content. While the search engine strives not to show “slop”, she suggests that AI content can easily rank alongside handmade content – so long as it passes the same quality standards:

“Now, AI generated content doesn’t necessarily equal spam.

But oftentimes when people are referring to it, they’re referring to the spam version of it, right? Or the phrase AI slop, right? This content that feels extremely low value across, okay? And we really want to make an effort that that doesn’t surface.”

People Want Unique Perspectives

When discussing what type of content users are most likely to click on, Reid emphasized that people don’t want surface level takes or superficial content. They want content that has depth and offers a unique perspective. This is especially true when it comes to what content people click on in AI overviews. 

As Reid said:

“But what we see is people want content from that human perspective. They want that sense of like, what’s the unique thing you bring to it, okay? And actually what we see on what people click on, on AI Overviews, is content that is richer and deeper, okay?

That surface-level AI generated content, people don’t want that because if they click on that, they don’t actually learn that much more than they previously got. They don’t trust the result anymore.

So what we see with AI Overviews is that we surface these sites and get fewer what we call bounce clicks. A bounce click is like you click on your site, Yeah, I didn’t want that, and you go back.

AI Overviews gives some content, and then we get to surface deeper, richer content, and we’ll look to continue to do that over time so that we really do get that creator content and not the AI generated.”

Even AI Tools Look For Human Perspectives

Throughout the interview, Reid makes it clear that users are looking for content that stands out from the noise. They want content with unique, strong perspectives and human experiences. While AI can help turn these perspectives into content people can enjoy, they ultimately require human guidance and insight to rise above all the other content online. 

The full interview has a lot of interesting insights from someone with deep knowledge of how Google search works and how it is advancing into the AI age. Watch it below:

/0 Comments

Google Says AI-Generated Images Won’t Hurt Your Site’s Rankings

, ,

Google’s Gary Illyes recently explained that Google’s search engine treats AI-generated images essentially the same as any other images and does not penalize sites for using AI images.

In a Q&A with interviewer Kenichi Suzuki and shared by Search Engine Journal, Illyes explained that AI-generated images have no direct impact on SEO or online rankings. 

Instead, he suggested that any effect to rankings from AI-generated issues may be brought on by technical issues. He suggested that brands may even see increased traffic if they use AI to create unique images. 

How Does Google Handle AI-Generated Content?

Google has largely been trying to take a nuanced approach to how it handles content made with AI. While the company has encouraged those who use AI-generated text content to ensure it is reviewed by humans, they have also taken steps to derank low-quality AI content.

At the same time, Google has not directly addressed how it handles AI-generated images.

About 10 minutes into the recent interview, Illyes was asked if Google would punish a site if some of their images were made with AI:

“Say if there’s a content that the content itself is legit, the sentences are legit, but also there are a lot of images which are relevant to the content itself, but all of them – let’s say all of them are generated by AI. Will the content or the overall site, is it going to be penalized or not?”

In response, Illyes emphasized that AI-generated images don’t affect SEO in any direct way.

“No, no. So AI generated image doesn’t impact the SEO. Not direct.

So obviously when you put images on your site, you will have to sacrifice some resources to those images… But otherwise you are not going to, I don’t think that you’re going to see any negative impact from that.

If anything, you might get some traffic out of image search or video search or whatever, but otherwise it should just be fine.”

In other words, the only major SEO consideration a site should have when using AI-generated content is ensuring the images are small enough and properly optimized to load quickly. 

While brands should consider other potential issues you might encounter using AI-generated images, such as how your audience will respond, Illyes’s comments make it clear that Google won’t be punishing you simply for using AI to create your graphics or pictures.

/0 Comments

Google Says You Don’t Need Special SEO For AI Overviews

, ,

While AI overviews upend much of how we look for information online, marketers have been split on how to respond. Some say that traditional SEO is all that is necessary to get your site cited by Google’s AI overviews, while others have been arguing that a new “SEO for AI” is needed. Now, Google has weighed in. 

During a talk at Search Central Live, Google’s Gary Illyes, told attendees that AI search tools don’t mean marketers need to use a new type of optimization and that standard SEO practices are all that is needed to be included in Google’s AI overviews and AI mode. 

While we were not present at the event, Google Search Advocate Kenichi Suzuki shared a detailed overview of what Gary Illyes discussed, including three main focus areas: 

  1. AI uses traditional SEO infrastructure and signals.
  2. Content quality matters, but so does authenticity
  3. Google has used AI in its traditional search for a long time.

How AI Uses SEO

Illyes emphasized that Google’s AI tools rely on the same basic systems and infrastructure used elsewhere by Google, including relying on the same search signals and indexing approach. 

As Suzuki says:

“[Illyes] explicitly stated that there is no need for a new acronym or a separate discipline. The core principles of creating helpful, reliable, people-first content remain the foundation for visibility in all of search formats.”

Authenticity Matters

Gary Illyes said that while Google does not punish sites that publish content made with AI, it watches for signs of abuse, including sites that churn out tons of low-quality AI content or pages with deceptive information like fake author personas or AI-generated images presented as real. 

Suzuki summed up Illyes’s statements, saying:

“Search Quality Raters are instructed to give the lowest possible rating to any content that is deceptive. This includes creating fake author personas with AI-gen images or churning out content that simply rehashes information from other sources without adding unique value or experience.”

Google Has Been Using AI For a Long Time

Throughout his presentation, Gary repeatedly emphasized that Google’s use of AI goes back years before the current surge in generative AI tools. Specifically, Illyes pointed to Google’s MUM system as a form or predictive AI to understand the intent behind queries.

While the introduction of MUM did cause some shifts in how we approach SEO in general, it did not call for an entirely new optimization discipline, just as new generative AI tools do not require a new “SEO for AI”. 

The Takeaway

While AI is undeniably making us change some aspects of search engine optimization, it doesn’t call for your business to adopt “GEO” or “AI SEO” or any other separate approaches to optimization. 

Instead, it is essential that you adapt your current SEO strategies, focus on providing content that provides real value to readers, and develop strategies to cement your authentic authority in your field.

/0 Comments

TikTok Adds AI Tools To Create Videos Off Text Or Product Images

,

TikTok is rolling out new generative AI tools that will allow brands to create unique video content based on just their product images or short text prompts. 

The new tools are a new part of the social platform’s Symphony suite, a collection of AI tools aimed at brands and content creators. Along with the existing Symphony suite features, TikTok introduced image-to-video and text-to-video options that allow you to create 5-second branded clips and a new Showcase Products feature. 

The text-to-video and image-to-video features are built directly into TikTok, but are also being integrated with Adobe Express and WPP Open. 

The Showcase Products feature is built into the TikTok app and lets you create lifelike videos featuring AI avatars that can hold products, demo apps, or model clothing. All it takes to create one is a visual of the product and a brief description. 

Why Does This Matter

These new tools give brands the flexibility to create short but detailed marketing materials that would typically require an entire team and a sizable marketing budget to create. By integrating with other platforms, TikTok is giving brands more than just new ways to market on their platform – they are giving brands freedom to create for anywhere their brand needs. 

Extra Details

TikTok says that all videos created with its AI tools will be clearly labeled and go through several rounds of reviews to ensure that unsafe or inappropriate materials are not being created. 

Notably, these tools were released right as TikTok was facing a June 19th deadline to sell or divest from parent company ByteDance or be banned from the United States. However, President Trump extended the deadline by 90 days, giving the company more time to find a buyer.

/0 Comments

New Research Shows SEO Is Key For Appearing In AI Overviews

,

Based on an analysis of over 25,000 user searches, websites that rank at the top of Google’s traditional search results appeared in AI search answers at least 25% of the time. 

This means that even in the era of increasing zero-click searches and decreasing clicks to search listings, SEO remains a crucial marketing strategy for brands looking to improve their online presence and reach more customers. 

The Study

The findings come from Tomasz Rudzki, co-founder of ZipTie. In an attempt to determine if SEO was losing relevance in the AI age, Rudzki assessed searches from ChatGPT, Perplexity, and Google’s AI overviews. 

What Rudzki saw was clear – sites that rank at the top of Google search results had 1-in-4 odds of being highlighted in AI overviews. The lower the sites were ranked, the lower their chances were of being included in AI responses. 

As Rudzki put it: 

“The higher you rank in Google’s top 10, the more likely you are to appear in AI search results across platforms. This isn’t speculation – it’s based on real queries from real users.”

While this is particularly of interest for Google, Rudzki said this pattern was consistent across all AI search platforms he evaluated, including ChatGPT. 

How AI Search Engines Work

In his report, Rudzki uses information from Google to detail how AI search engines work. 

Pre-selection: In the first step, AI systems select the pages they believe are the most relevant for a query. In most cases, this includes the highest-ranking pages for similar searches. 

Content extraction: Next, AI tools parse the context of the selected pages and pull content directly related to the question it is answering. 

AI synthesis: AI systems finally aggregate the information they have collected from across the web and package them in one easy-to-read response. 

In the process of finding the most relevant and accurate information for a specific question, AI tools heavily favor the sites that are already favored by Google, just as most humans naturally favor the highest ranked sites in organic search results. 

Why AI Sometimes Pulls From Lower-Ranked Sites

When exploring why AI tools sometimes pull information from pages that rank lower, sometimes even falling below the top 10 search results, Rudzki provided a few potential answers. 

The first is search personalization. While a specific site may not typically be included at the top of the search results, there is a chance of it appearing higher in personalized search results. 

The second, and perhaps more notable, reason is a concept called “query fan-out”. 

Google’s AI documentation explains query fan-out like this:

“Both AI Overviews and AI Mode may use a ‘query fan-out‘ technique — issuing multiple related searches across subtopics and data sources — to develop a response.”

In other words, when you ask AI a specific question, it may run several processes to ask questions about specific details of your question or related information. This means that while a selected page may not rank well for your specific question, it may rank well for a particular aspect that the AI system looked into. 

SEO is Here To Stay

There is no arguing that AI tools are drastically changing how we search and access information. While AI overviews are tied to decreasing click-through rates on organic results, brands can still gain ground by positioning themselves as an authority that Google can rely on to provide accurate information. This not only helps mitigate lost traffic from zero-click searches, but can also improve your reputation and connect you with new potential customers.

/0 Comments

Google Executives Say Falling Referral Traffic Are Sign Of Higher-Quality Clicks

, ,

Critics accuse Google’s increasing use of AI in its search engine of taking referral traffic away from websites, but Google’s executives say the issue is a matter of quality versus quantity. 

In a recent press and Q&A event, Google’s executives argued that AI is improving the quality of search results (while largely avoiding the issue of decreasing clicks).

The session included statements from several executives, such as Jenny Cheng (Vice President and General Manager of Google’s Merchant Shopping operations), Sean Downey (President of Americas & Global Partners at Google), and Nicky Rettke (YouTube Vice President of Product Management).

Does AI Reduce Traffic To Websites?

Numerous studies have found that Google’s AI overviews have significantly reduced click-through rates to both organic and paid listings, leading to significant reductions in referral traffic. The trend has brought down CTRs for nearly every type of search, but non-branded informational searchers have been most heavily impacted since the introduction of AI overviews. 

Ahrefs, Advanced Web Ranking, Similarweb, and many others have independently verified that this trend is happening and seems to be getting worse as Google has increased how frequently it shows AI overviews. 

What Google’s Execs Have To Say

When asked about falling click-through rates in search, Google’s executives began by saying it is partially driven by an increase in follow-up searches while using AI-enhanced search. 

“What we’re seeing is people asking more questions. So they’ll ask a first question, they’ll get information, and then go and ask a different question. So they’re refining and getting more information, and then they’re making a decision of what website to go to.”

As this happens, Google seems to believe users refine exactly what they are looking for, ensuring that their clicks are more valuable. 

“When they get to a decision to click out, it’s a more highly qualified click… What we hope to see over time—and we don’t have any data to share on this—is more time spent on site, which is what we see organically in a much more highly qualified visitor for the website.”

Notably, even Google admits it cannot back up these claims with data. 

What About Ads?

While the Google executives did their best not to directly address falling referral traffic for organic content, they did claim that CTRs on ad placements are stable overall. Despite AI overviews pushing paid placements further down the page, Google says clicks remain largely unchanged. 

“When we run ads on AI overviews versus ads on standard search, we see pretty much the same level of monetization capabilities, which would indicate most factors are the same and they’re producing really the same results for advertisers to date.”

Again, however, the company declined to share any data on the issue. 

What About AI Mode?

Don’t expect anything to improve with the new wide launch of Google’s AI mode. Along with doubling down on AI features in search, this new mode, Google has made referral traffic from AI mode untrackable. 

When someone clicks through to your website from within AI mode, it is currently not being recorded in Google Search Console analytics. At best, some tools seem to be capturing when clicks occur, however, they are shown with no attribution. In most cases, however, they seem not to be registering at all. This will only serve to muddy the waters while websites deal with seeing less traffic from Google.

/0 Comments

Google AI Overviews Appear In 13% of Searches

, ,

It may feel like Google’s AI overviews are appearing on practically every search you make on Google Search. New analysis, however, shows that while the number of searches that include AI may be increasing, overviews are in fewer search results than you may think. 

An analysis from Semrush indicates that AI search overviews appeared in just 13.14% of all U.S. desktop searches made in March. While that number seems low, it is a 102% increase from the 6.49% of searches that included automated overviews in January. 

AI Has a Big Impact for Being So Rarely Shown

The relatively low number of searches with AI overviews emphasizes how much of an impact AI is already having on people’s search behavior. Since they started appearing in search results, auto-generated overviews have been cited as the cause for significantly decreasing click-through rates and decreasing organic traffic from search results. 

How much of these shifts in Google search behavior is actually caused by AI is also contested by some in the industry who say falling organic traffic and CTRs are related to other changes in search or have been overstated. 

For example, the latest report indicates that although AI overviews generally have higher zero-click rates (ie, they do not lead to a click on a search result), zero-click rates have actually declined overall. This would indicate that the search feature does not necessarily contribute to more zero-click searches. 

AI Overviews are More Likely For Specific Types of Searches

According to Semrush’s analysis of over 10 million keywords, AI search overviews were most likely to appear in searches for fact-based and uncontroversial content. However, there are signs that Google is also expanding AI to other, more competitive types of searches. 

Here’s a breakdown of where AI overviews appeared:

  • 88.1% of overviews appeared on informational searches
  • 8.69% of overviews appeared in commercial searches (up from 6.28%)
  • 1.43% of overviews were included in navigational queries

The report also identified 5 industries that were most likely to trigger overviews in search:

  • Science (up 22.3%)
  • Health (up 20.3%)
  • People & Society (up 18.8%)
  • Law & Government (up 15.2%)
  • Travel (up 14.3%)

For more, read the full report from Semrush here. 

/0 Comments

AI Overviews Are Coming To YouTube In New Test

,

Google is bringing its AI overviews to its sister platform, YouTube. 

In an announcement, the company said it was testing showing AI overviews similar to those already seen in Google search results. These overviews will choose the most relevant clips from videos it believes are relevant to a search.

How Will This Impact YouTube Click-Through Rates

Despite seemingly trying to avoid the issue during a recent earnings call, Google can’t hide that its AI overviews are reducing click-through rates in search results and sending less traffic to other websites. 

With this in mind, it is reasonable to be concerned that YouTube is similarly pulling users away from fully watching videos from creators in a way that may reduce viewership and revenue to content creators.

What To Expect From YouTube AI Overviews

For the current test, only a small group of U.S. YouTube premium features will be eligible to see AI overviews for English-language search results. 

When searching, these users will be shown a collection of relevant videos and highlighted clips that it believes are most relevant. The clips will be shown in a carousel within the search results, letting users quickly browse the selection. 

For now, YouTube is using AI overviews on two specific types of searches:

  • Product research (such as users looking for info about the best noise-cancelling headphones)
  • Travel and local discovery (for example, when users search for information about museums to visit in a specific city)

Throughout the test, YouTube says it will be collecting user feedback which it will use to determine whether to expand this feature to more users. 

For more, you can read the announcement for AI overviews on YouTube here.

/0 Comments

AI Content Gets Lowest Rating From Google Quality Raters

, ,

New directions given to Google’s quality raters tell them to look for signs that a page’s main content is AI-generated or otherwise made using automated tools. If a page is found to be primarily made with AI, according to Google’s John Mueller, raters are asked to rate it as “lowest quality.” 

Though this policy shift was apparently part of the January 2025 Search Quality Rater Guidelines update, Mueller first publicly revealed it this week while speaking at Search Central Live Madrid. 

Why This Matters

Though Search Quality Raters do not directly affect Google’s search results, their work is used to improve Google’s algorithms. The way they are asked to rank pages typically reflects Google’s overall internal guidelines.

Here’s what Google had to say when they updated the raters’ guidelines in January:

“As a reminder, these guidelines are what are used by our search raters to help evaluate the performance of our various search ranking systems, and their ratings don’t directly influence ranking. The guidelines share important considerations for what content is helpful for people when using Google Search. Our page on how to create helpful, people-first content summarizes these concepts for creators to help them self-assess their own content to be successful in Google Search.”

If Google is instructing its raters to give AI-generated content, it is a sign that the company is hardening its stance on AI content and moving to reduce its presence in search results. 

AI content has always been a risky prospect when it comes to SEO, but this is the one of the most significant signs we’ve seen from Google itself that AI-generated content may be unwelcome in search results.

/0 Comments