立即打开
谷歌搜索结果质量下降,SEO寄生虫和AI催生的垃圾信息正在毁掉互联网

谷歌搜索结果质量下降,SEO寄生虫和AI催生的垃圾信息正在毁掉互联网

Paolo Confino 2024-01-23
谷歌搜索的效果是否已经今不如昔?

图片来源:GETTY IMAGES

谷歌(Google)搜索的效果似乎大不如前。

在21世纪,谷歌搜索引擎几乎成为人人生活中不可或缺的一部分,它每天的使用量多达数十亿次,但它最近的一次更新却带来了意想不到的后果。谷歌搜索基本上被垃圾信息所淹没。欢迎来到网络搜索的垃圾邮件时代。

数字营销公司Amsive Digital的搜索引擎优化高级总监莉莉·莱伊说:“这是我在14年职业生涯中见过的质量最差的谷歌搜索结果。”

弹窗广告、假冒商品广告和诱导人们安装无法删除的恶意软件的链接,在互联网上无处不在,但在谷歌的网站上通常看不到这些内容。谷歌每天有数十亿次搜索,而且互联网上有无数网站,因此谷歌只能像数字“打地鼠”游戏一样,在这些欺诈内容再次出现之前发现它们。

莱伊对《财富》杂志表示:“现在看来,欺诈内容似乎占据了上风。”

莱伊认为,实际情况是,谷歌发布的算法更新,把用户创作内容排在了搜索结果的前列。更新的出发点是,当用户提出问题时,他们会看到可能知道答案的其他人提供的回答,旨在将网络进一步民主化,但也让《财富》等新闻网站把关者的权威不复存在。谷歌形容此次更新是“隐藏宝石更新”,它从2023年5月至11月执行了一系列修改,因为表面上看,谷歌应该从互联网上找到最佳答案,无论这些答案的发布者是谁。因此,如果用户搜索“最好用的汽车消音器是什么?”或者“如何知道你的家酿啤酒已经变质?”他们就会看到曾经遭遇汽车问题的其他人或者更有经验的家酿啤酒爱好者的回答。

然而,莱伊称,最终一些毫无顾忌的网站发现,它们可以利用新政策,在谷歌新算法优先推荐的位置投放垃圾信息链接。

莱伊说道:“Google Docs、Google Maps、领英(LinkedIn)、Reddit,凡是你能够想到的有论坛的地方,都会被垃圾信息发送者利用。”

德国研究人员最近的一项研究分析了产品测评网站的质量,研究结果与莱伊的说法一致。404 Media之前报道了该研究的结果。基于研究,研究人员最后认为,在搜索结果里排名靠前的页面,往往正文质量较差,更多的是旨在利用这些网站牟利的联盟营销链接。尽管如此,谷歌搜索的质量确实高于必应(Bing)和DuckDuckGo等竞争对手。与其他搜索引擎相比,谷歌还有最有效的减缓策略,但垃圾信息发送者最终也会找到避开这些策略的方法。

莱伊在Gizmodo媒体上谈到网络搜索现状时曾经说:“我从未见过如此混乱的谷歌。”

寄生在合法网页上的“SEO寄生虫”

一些不良分子之所以认为值得利用新搜索更新发送垃圾信息,是因为所谓的联盟营销链接。这是一种常见的网络操作,即如果其他人点击一个网站上的链接后购买了一款产品,这个网站就可以获得佣金。如果有联盟营销链接的网站能够在谷歌搜索结果中排在前列,这就会给网站的所有者带来丰厚的收入。诈骗者试图利用这些规则,通过在毫无用处的网站上的链接贩卖无用的产品。

在谷歌搜索里获得最佳排名,这本身就是一项业务,名为搜索引擎优化,简称SEO。据市场研究公司IBISWorld统计,2023年,SEO业务的规模高达760亿美元。SEO几乎是开展在线业务的所有公司非常普遍的操作(包括作者在Fortune.com上发表的每一篇文章)。SEO已经成为大多数在线营销的关键组成部分,并且在广告界被视为一个特种领域。如果操作得当,就能够保证最相关的信息出现在谷歌最显眼的位置上。

例如,在飓风可能登陆的地区生活的人们,需要谷歌搜索结果优先显示可信的气象预警来源,比如美国国家气象局(National Weather Service)或本地媒体等。令人讨厌的副作用是,现在许多搜索结果大同小异。如果你搜索“最好的床单”,结果中就会有几十篇相同的文章,标题可能是《2024年8款最佳床单》或《22款最佳床单》或者更生动的《这是Z世代最喜欢的床单》。

SEO的批评者认为,它把在线搜索变成了一种同质化体验,所有结果都在重复相同的信息。《纽约客》(New Yorker)的特约撰稿人凯尔·柴卡在新书《过滤世界》(Filterworld)里写道,迄今为止,在全世界被互联网改变的约30年里,算法的力量已经超越了文化,它将无数日常体验变成了“信息流”,例如全世界雷同的咖啡店审美。另一方面,SEO的支持者们认为,SEO可以奖励最优秀的网站,尤其是小公司可能无力承担高额广告预算,付费在谷歌搜索结果中排在前列。

研究的作者写道:“规模达数十亿美元的搜索引擎公司与针对性的SEO联盟营销垃圾信息之间的持续斗争,证明网络搜索是一场多方参与的动态博弈,有些人怀着不良的意图。”

谷歌发言人表示,这项研究存在缺陷,因为它仅调查了特定搜索项。谷歌在写给《财富》杂志的邮件里称:“这项研究仅分析了产品测评内容,并不能体现谷歌搜索的整体质量和带来的帮助。我们每天要处理数以十亿计的搜索请求。”

莱伊认为,导致谷歌搜索结果质量下滑的另外一个问题是,“寄生在大型出版商身上”的“SEO寄生虫”,即一个被信任的网站,将网站上的空间甚至重要的域名,出租给第三方发布赞助内容。这些第三方利用母站点的流量和信誉,在赞助内容中发布联盟营销链接。这在技术上是获得允许的做法,但对用户而言却并不是良好的体验。

莱伊说道:“人们正在利用谷歌存在的漏洞。”

德国研究人员的研究还发现,联盟营销链接的泛滥,可能与低质量网站相关联。研究称:“我们还发现,联盟营销的使用与内容的复杂性之间存在逆相关的关系,所有搜索引擎都是大规模联盟营销链接泛滥的受害者。但我们还发现,良性内容和以内容与链接工厂的形式传播的垃圾信息之间的界限日益模糊,生成式AI诞生之后,情况肯定会更加恶化。”

在AI诞生之初,监管机构就警告它可能会让诈骗变得更容易。AI生成的录音可以模仿人类或他们的亲人,用于获取他们的银行信息或病例信息。而在网络搜索方面,AI让行骗者能够生成垃圾内容,并以前所未有的规模侵蚀谷歌的搜索结果。

谷歌的一位发言人向《财富》杂志提到了莱伊在X上发表的一篇文章。莱伊在文中着重介绍了针对哈佛大学(Harvard University)超链接上的可疑内容遭到的投诉,谷歌的处理方式。他表示,谷歌正在努力“采取措施,以更好地处理这类第三方内容”。谷歌的账户还指出,这“可能是官网并未意识到网站上发布了这条内容,而不是有意存放相关内容。”

谷歌还在发给《财富》杂志的一份声明里称,公司“为解决[研究中重点提到的]这些问题,已经启动了针对性的改进。”谷歌表示,这项研究本身也指出,谷歌搜索在过去一年有所改善,而且其表现胜过了其他搜索引擎。“更广泛地来说,有许多第三方分析了其他类型问题的搜索引擎结果,并发现谷歌的搜索结果质量远高于竞争对手。”

莱伊也认为谷歌已经认识到并且正在努力解决问题,可能会更新用户政策和算法。她说:“谷歌总是能够拨乱反正,只是需要时间。”(财富中文网)

译者:刘进龙

审校:汪皓

谷歌(Google)搜索的效果似乎大不如前。

在21世纪,谷歌搜索引擎几乎成为人人生活中不可或缺的一部分,它每天的使用量多达数十亿次,但它最近的一次更新却带来了意想不到的后果。谷歌搜索基本上被垃圾信息所淹没。欢迎来到网络搜索的垃圾邮件时代。

数字营销公司Amsive Digital的搜索引擎优化高级总监莉莉·莱伊说:“这是我在14年职业生涯中见过的质量最差的谷歌搜索结果。”

弹窗广告、假冒商品广告和诱导人们安装无法删除的恶意软件的链接,在互联网上无处不在,但在谷歌的网站上通常看不到这些内容。谷歌每天有数十亿次搜索,而且互联网上有无数网站,因此谷歌只能像数字“打地鼠”游戏一样,在这些欺诈内容再次出现之前发现它们。

莱伊对《财富》杂志表示:“现在看来,欺诈内容似乎占据了上风。”

莱伊认为,实际情况是,谷歌发布的算法更新,把用户创作内容排在了搜索结果的前列。更新的出发点是,当用户提出问题时,他们会看到可能知道答案的其他人提供的回答,旨在将网络进一步民主化,但也让《财富》等新闻网站把关者的权威不复存在。谷歌形容此次更新是“隐藏宝石更新”,它从2023年5月至11月执行了一系列修改,因为表面上看,谷歌应该从互联网上找到最佳答案,无论这些答案的发布者是谁。因此,如果用户搜索“最好用的汽车消音器是什么?”或者“如何知道你的家酿啤酒已经变质?”他们就会看到曾经遭遇汽车问题的其他人或者更有经验的家酿啤酒爱好者的回答。

然而,莱伊称,最终一些毫无顾忌的网站发现,它们可以利用新政策,在谷歌新算法优先推荐的位置投放垃圾信息链接。

莱伊说道:“Google Docs、Google Maps、领英(LinkedIn)、Reddit,凡是你能够想到的有论坛的地方,都会被垃圾信息发送者利用。”

德国研究人员最近的一项研究分析了产品测评网站的质量,研究结果与莱伊的说法一致。404 Media之前报道了该研究的结果。基于研究,研究人员最后认为,在搜索结果里排名靠前的页面,往往正文质量较差,更多的是旨在利用这些网站牟利的联盟营销链接。尽管如此,谷歌搜索的质量确实高于必应(Bing)和DuckDuckGo等竞争对手。与其他搜索引擎相比,谷歌还有最有效的减缓策略,但垃圾信息发送者最终也会找到避开这些策略的方法。

莱伊在Gizmodo媒体上谈到网络搜索现状时曾经说:“我从未见过如此混乱的谷歌。”

寄生在合法网页上的“SEO寄生虫”

一些不良分子之所以认为值得利用新搜索更新发送垃圾信息,是因为所谓的联盟营销链接。这是一种常见的网络操作,即如果其他人点击一个网站上的链接后购买了一款产品,这个网站就可以获得佣金。如果有联盟营销链接的网站能够在谷歌搜索结果中排在前列,这就会给网站的所有者带来丰厚的收入。诈骗者试图利用这些规则,通过在毫无用处的网站上的链接贩卖无用的产品。

在谷歌搜索里获得最佳排名,这本身就是一项业务,名为搜索引擎优化,简称SEO。据市场研究公司IBISWorld统计,2023年,SEO业务的规模高达760亿美元。SEO几乎是开展在线业务的所有公司非常普遍的操作(包括作者在Fortune.com上发表的每一篇文章)。SEO已经成为大多数在线营销的关键组成部分,并且在广告界被视为一个特种领域。如果操作得当,就能够保证最相关的信息出现在谷歌最显眼的位置上。

例如,在飓风可能登陆的地区生活的人们,需要谷歌搜索结果优先显示可信的气象预警来源,比如美国国家气象局(National Weather Service)或本地媒体等。令人讨厌的副作用是,现在许多搜索结果大同小异。如果你搜索“最好的床单”,结果中就会有几十篇相同的文章,标题可能是《2024年8款最佳床单》或《22款最佳床单》或者更生动的《这是Z世代最喜欢的床单》。

SEO的批评者认为,它把在线搜索变成了一种同质化体验,所有结果都在重复相同的信息。《纽约客》(New Yorker)的特约撰稿人凯尔·柴卡在新书《过滤世界》(Filterworld)里写道,迄今为止,在全世界被互联网改变的约30年里,算法的力量已经超越了文化,它将无数日常体验变成了“信息流”,例如全世界雷同的咖啡店审美。另一方面,SEO的支持者们认为,SEO可以奖励最优秀的网站,尤其是小公司可能无力承担高额广告预算,付费在谷歌搜索结果中排在前列。

研究的作者写道:“规模达数十亿美元的搜索引擎公司与针对性的SEO联盟营销垃圾信息之间的持续斗争,证明网络搜索是一场多方参与的动态博弈,有些人怀着不良的意图。”

谷歌发言人表示,这项研究存在缺陷,因为它仅调查了特定搜索项。谷歌在写给《财富》杂志的邮件里称:“这项研究仅分析了产品测评内容,并不能体现谷歌搜索的整体质量和带来的帮助。我们每天要处理数以十亿计的搜索请求。”

莱伊认为,导致谷歌搜索结果质量下滑的另外一个问题是,“寄生在大型出版商身上”的“SEO寄生虫”,即一个被信任的网站,将网站上的空间甚至重要的域名,出租给第三方发布赞助内容。这些第三方利用母站点的流量和信誉,在赞助内容中发布联盟营销链接。这在技术上是获得允许的做法,但对用户而言却并不是良好的体验。

莱伊说道:“人们正在利用谷歌存在的漏洞。”

德国研究人员的研究还发现,联盟营销链接的泛滥,可能与低质量网站相关联。研究称:“我们还发现,联盟营销的使用与内容的复杂性之间存在逆相关的关系,所有搜索引擎都是大规模联盟营销链接泛滥的受害者。但我们还发现,良性内容和以内容与链接工厂的形式传播的垃圾信息之间的界限日益模糊,生成式AI诞生之后,情况肯定会更加恶化。”

在AI诞生之初,监管机构就警告它可能会让诈骗变得更容易。AI生成的录音可以模仿人类或他们的亲人,用于获取他们的银行信息或病例信息。而在网络搜索方面,AI让行骗者能够生成垃圾内容,并以前所未有的规模侵蚀谷歌的搜索结果。

谷歌的一位发言人向《财富》杂志提到了莱伊在X上发表的一篇文章。莱伊在文中着重介绍了针对哈佛大学(Harvard University)超链接上的可疑内容遭到的投诉,谷歌的处理方式。他表示,谷歌正在努力“采取措施,以更好地处理这类第三方内容”。谷歌的账户还指出,这“可能是官网并未意识到网站上发布了这条内容,而不是有意存放相关内容。”

谷歌还在发给《财富》杂志的一份声明里称,公司“为解决[研究中重点提到的]这些问题,已经启动了针对性的改进。”谷歌表示,这项研究本身也指出,谷歌搜索在过去一年有所改善,而且其表现胜过了其他搜索引擎。“更广泛地来说,有许多第三方分析了其他类型问题的搜索引擎结果,并发现谷歌的搜索结果质量远高于竞争对手。”

莱伊也认为谷歌已经认识到并且正在努力解决问题,可能会更新用户政策和算法。她说:“谷歌总是能够拨乱反正,只是需要时间。”(财富中文网)

译者:刘进龙

审校:汪皓

Google search increasingly looks like it just isn’t working the way it used to.

The search engine that has become a 21st century staple in virtually everyone’s lives, used billions of times a day, is struggling with the unintended consequences of a recent update. Basically, it’s all spammed up. Welcome to web search’s junk mail era.

“It’s the worst quality results on Google I’ve seen in my 14-year career,” says Lily Ray, senior director of search engine optimization at digital marketing agency Amsive Digital.

Pop-up windows, ads for spurious products, and links that are sure to download some impossible-to-remove malware are common on the internet. But one doesn’t usually see them interspersed in between websites on Google. With billions of searches a day to go alongside the countless websites on the internet Google can only catch so many of these scammers before they pop up again like a game of digital whack-a-mole.

“Right now, it feels like the scammers are winning,” Ray tells Fortune.

In essence what happened, according to Ray, was Google released an update to its algorithm that pushed user generated content further up the rankings of its search results. The idea was that when users asked a question, they’d get to see answers from other real people who might have the answer, democratizing the web further and moving gatekeeper authority away from, say, news sites such as Fortune. Google called this the hidden gems update, implemented in a series of changes from May to November 2023, because it was ostensibly supposed to find the best answers from across the internet regardless of who had posted them. So if a user searched “what’s the best used muffler?” or “how to know if my homemade beer has gone bad?” they’d find answers from other people who had car trouble or were more experienced homebrewers.

Instead what ended up happening is unscrupulous sites realized they could take advantage of the new policy by putting spam links in places Google’s new algorithm prioritized, according to Ray.

“Google Docs, Google Maps, LinkedIn, Reddit, anywhere you can imagine that there is a forum, spammers are taking advantage of it,” Ray says.

A recent study from researchers in Germany that examined the quality of product review websites, previously reported on by 404 Media, is in line with Ray’s claims. The higher-ranked pages on the searches they conducted tended to have lower-quality texts and more affiliate links meant to monetize those sites, according to the research. Although, the quality of Google’s search did outperform that of its competitors Bing and DuckDuckGo. The company also had the most effective mitigation tactics compared to other search engines, although the spammers would also eventually find ways around those.

As Ray told Gizmodo about the state of web search: “I’ve never seen Google in such disarray.”

“SEO parasites” leech off legitimate webpages

The reason some bad actors found it worthwhile to spam the new search update was because of something called affiliate links. They’re a common online practice whereby a website might earn a commission if a product gets bought after clicking a link featured on one of its pages. If a website with a lot of affiliate links can make it to the top of the pile on Google Search, that can be quite lucrative for whoever owns that website. And scammers try to take advantage of the rules to try and peddle worthless products via links on useless websites.

Just getting into the prime positions on Google is a business unto itself known as search engine optimization, or SEO. Last year, SEO was a $76 billion business, according to market research company IBISWorld. It’s another very common practice for virtually any business that has an online presence (including every story this reporter publishes on Fortune.com). SEO has become a critical part of most online marketing and is considered a speciality in the advertising world. When done well, it ensures that the most relevant information surfaces to the most visible spots on Google.

For example, people living in an area where a hurricane is expected to make landfall would need trusted sources of weather alerts, like the National Weather Service or a local news outlet, at the top of their Google searches. The irksome side effect is that many search results now look the same. A simple search for something like “best bed sheets” turns up dozens of the same article with titles like “The 8 Best Sheets of 2024,” or “The 22 Very Best Bed Sheets,” or the more colorful “These Are Our Favorite Sheets to Catch Some Z’s.”

Critics of SEO would argue it’s turned online search into a homogenous experience where all the results reiterate the same information. Filterworld, a new book by New Yorker staff writer Kyle Chayka, argues that by now, roughly 30 years into a world changed by the internet, the power of the algorithm has gone beyond culture to curate countless everyday experiences into “feeds,” for example the oddly similar coffee-shop aesthetic around the world. On the other hand, supporters would say it’s a way to reward the best websites, in particular if they’re small businesses who might not be able to afford huge advertising budgets for the paid spots at the top of Google’s search results.

“The constant struggle of billion-dollar search engine companies with targeted SEO affiliate spam should serve as an example that web search is a dynamic game with many players, some with bad intentions,” the study’s authors write.

A spokesperson for Google said the study is flawed in that it only looked at certain search terms. “This particular study looked narrowly at product review content, and it doesn’t reflect the overall quality and helpfulness of Search for the billions of queries we see every day,” they told Fortune in an email.

Another problem that caused the quality of Google’s search results to decline, according to Ray, is what she calls “SEO parasites” who are “leeching off of big publishers.” This is when a trusted website leases out space on their site, and crucially their domain name, to third parties for sponsored content. These third parties capitalize on the traffic and respectability of the parent site to stuff their sponsored post with affiliate links. It’s technically allowed but just doesn’t make for a great experience.

“People are exploiting loopholes on Google,” Ray says.

The study from the German researchers also found that the prevalence of affiliate links could be correlated to lower-quality websites. “We further observe an inverse relationship between affiliate marketing use and content complexity, and that all search engines fall victim to large-scale affiliate link spam campaigns,” the study says. “However, we also notice that the line between benign content and spam in the form of content and link farms becomes increasingly blurry—a situation that will surely worsen in the wake of generative AI.”

From the earliest days of AI, watchdogs warned it could be used to make scamming easier. AI-generated voice recordings could impersonate people or their loved ones as part of a ruse to gain access to their banking information or medical records. While in the case of online search, AI lets fraudsters make the sort of junk content that’s cluttering Google’s search results at an unprecedented scale.

A Google spokesperson pointed Fortune to a post on X from Ray highlighting Google’s handling of a complaint about shady content hosted on a Harvard University URL, stating the company was working to “take steps to better deal with third party content of this nature.” Google’s account also specified that “was likely a case that the site is unaware this content has been placed on it rather than a purposeful attempt to host the content.”

Google also acknowledged in its statement to Fortune that it has “launched specific improvements to address these issues [highlighted in the study].” Google noted that the study itself points out that Google Search has improved over the past year and is performing better than other search engines. “More broadly, numerous third parties have measured search engine results for other types of queries and found Google to be of significantly higher quality than the rest.”

Ray agrees that Google is aware of the problem and is working to address it, likely through a mix of updates to its user policy and to its algorithm. “Google always generally gets things right,” she says. “It just takes them time.”

热读文章
热门视频
扫描二维码下载财富APP