By Jia Lissa 
The legal boundaries of web scraping, search engine data aggregation, and copyright protection are undergoing a major test in federal court. On July 20, the U.S. District Court for the Northern District of California granted a motion to dismiss two key claims brought by Google LLC against SerpApi, a prominent provider of Google search result scraping services.
The court’s decision temporarily halts Google’s attempt to use the Digital Millennium Copyright Act (DMCA) to block third-party tools from scraping its Search Engine Results Pages (SERPs). However, the ruling is not a final victory for SerpApi, as the court granted Google a 21-day window to amend its complaint and address specific evidentiary deficiencies regarding its anti-scraping technology, SearchGuard.
Main Facts of the Ruling
The core of the dispute lies in whether Google can leverage the DMCA to prevent third-party platforms from automatically harvesting data from its search results. In its ruling, the U.S. District Court for the Northern District of California systematically dismantled parts of Google’s DMCA claims while leaving the door open for Google to salvage others.
The Split by Content Type
The court’s ruling drew a sharp distinction between search results containing copyrighted material and those that do not:
- Permanent Dismissal (Without Leave to Amend): The court permanently dismissed all parts of Google’s DMCA claims that were based on search results containing non-copyrighted content. Because public data, facts, and non-copyrightable elements do not fall under the purview of the DMCA, Google cannot use copyright law to protect them from automated extraction.
- Dismissal with Leave to Amend: The court dismissed the claims involving search results that do contain copyrighted content (such as text snippets, licensed images, and proprietary directory information). However, this dismissal was granted with leave to amend. Google was given 21 days to file a revised complaint to address a critical legal gap: proving that its proprietary anti-scraping system, SearchGuard, was authorized by the actual copyright owners of that content.
Stay of Discovery
In addition to dismissing the DMCA claims, the court stayed all discovery proceedings. This means that active information-gathering and depositions are paused until Google decides whether to file an amended complaint, and until any subsequent motion to dismiss that amended complaint is fully resolved by the court. This stay represents a temporary financial and operational relief for SerpApi, saving the company from costly discovery processes during this phase of litigation.
Chronology of the Dispute
The legal battle between the search engine giant and the scraping API provider has been developing over several months, reflecting a broader industry-wide conflict over data ownership in the age of artificial intelligence and search engine optimization (SEO).
[Dec 19, 2023] --> Google files a federal lawsuit against SerpApi, alleging DMCA violations.
[Early 2024] --> SerpApi files a motion to dismiss, challenging Google's standing and claims.
[July 20, 2024] --> Northern District of California grants SerpApi's motion to dismiss DMCA claims.
[August 2024] --> Google's 21-day deadline to file an amended complaint.1. The Initial Lawsuit (December 19, 2023)
Google filed its initial complaint against SerpApi in the U.S. District Court for the Northern District of California. Google alleged that SerpApi was systematically bypassing its technological protection measures—specifically its security system known as SearchGuard—to scrape search results and resell them to third parties. Google argued that this practice bypassed security controls, put an undue load on its servers, and violated the DMCA’s anti-circumvention provisions.
2. SerpApi’s Motion to Dismiss (Early 2024)
SerpApi responded by filing a motion to dismiss. The defendant argued that Google lacked standing under the DMCA because Google does not own the copyrights to the third-party websites, snippets, and images displayed in its search results. SerpApi also asserted that scraping publicly available search engine results does not constitute a violation of federal copyright law.
3. The District Court’s Order (July 20, 2024)
The court issued its order, partially granting and partially denying SerpApi’s motion. While the court threw out Google’s current DMCA claims, it rejected SerpApi’s broader argument that Google completely lacked standing to sue under the DMCA.
4. The 21-Day Amendment Window (August 2024)
Google has 21 days from the date of the order to submit an amended complaint. The court noted that the evidence required to sustain the amended complaint—specifically, documentation showing whether third-party copyright owners authorized Google to use SearchGuard to protect their licensed content—should already be within Google’s possession or control.
Supporting Legal and Technical Data
To understand why the court ruled this way, it is necessary to examine the technical mechanics of search engine scraping and the specific statutory requirements of the DMCA.
Section 1201 of the DMCA and the "Authority" Requirement
Under 17 U.S.C. § 1201(a)(1), it is illegal to "circumvent a technological measure that effectively controls access to a work protected under this title." To win a claim under this provision, a plaintiff must prove:
- It owns or has rights to a copyrighted work.
- It has implemented a technological protection measure (TPM) to control access to that work.
- The defendant bypassed or circumvented that TPM without authorization.
The legal hurdle for Google is that it does not own the copyright to the vast majority of content displayed on its SERPs. When a user searches for a query, Google displays snippets, descriptions, and images hosted on third-party websites.
The court pointed out that Google failed to allege facts showing that its anti-scraping system, SearchGuard, was implemented and functioned "with the authority of the copyright owner." In other words, Google did not prove that the publishers, bloggers, and e-commerce platforms whose snippets appear on Google Search had authorized Google to use SearchGuard to shield their content from scraper APIs.
What is SearchGuard?
SearchGuard is Google’s proprietary internal infrastructure designed to detect and block automated traffic, bots, and scraping activities. It employs a variety of security measures, including:
- IP Rate Limiting: Restricting the number of requests a single IP address can make within a given timeframe.
- CAPTCHAs: Forcing suspected automated browsers to solve puzzles to prove humanity.
- Browser Fingerprinting: Analyzing the technical configuration of the incoming request to identify bot frameworks (like Puppeteer or Selenium).
Google asserted that SerpApi used sophisticated techniques, such as rotating residential proxy networks and forged browser headers, to bypass SearchGuard. While the court agreed that Google had alleged enough facts to support a plausible inference that SerpApi did indeed circumvent SearchGuard, the claim still failed because Google could not tie that circumvention directly to the protection of authorized, copyrighted works.
Official Responses
The court’s decision drew immediate reactions from the parties involved, signaling the high stakes of the litigation for the broader tech sector.
SerpApi’s Response
Following the ruling, SerpApi CEO Julien Khaleghy expressed optimism, framing the decision as a defense of open data practices:
"This ruling is a win not just for SerpApi, but for all who depend on an open internet. Web scraping is essential for search engine optimization, market research, and artificial intelligence training. We remain committed to defending the right to access public data."
Google’s Position
Google has maintained that automated scraping of its search results harms the integrity of its platform, degrades user experience by consuming immense server bandwidth, and bypasses safety controls. While Google has not issued an official public statement regarding its strategy for the 21-day amendment window, legal experts expect the tech giant to review its licensing agreements with major content partners to establish that it does, in fact, have the authority to protect their copyrighted snippets via SearchGuard.
Implications for the Tech and SEO Industries
The outcome of this case has far-reaching consequences for several overlapping industries, including Search Engine Optimization (SEO), artificial intelligence, and competitive intelligence.
+-----------------------------------------------------------------------------+
| POTENTIAL IMPACTS OF THE CASE |
+------------------------------------+----------------------------------------+
| SEO & Rank Tracking | Rely heavily on scraped SERP data to |
| | monitor keywords and organic rankings. |
+------------------------------------+----------------------------------------+
| AI & LLM Training | Web scraping remains the primary way |
| | developers gather training data. |
+------------------------------------+----------------------------------------+
| Legal Precedent | Could redefine the scope of DMCA |
| | protection for aggregated web data. |
+------------------------------------+----------------------------------------+1. The SEO Software Ecosystem
Modern SEO tools—such as Semrush, Ahrefs, Moz, and BrightEdge—rely on automated access to public search results. They track keyword rankings, monitor competitors, analyze localized search results, and evaluate search engine layout changes. If Google successfully establishes that scraping its search results violates the DMCA, it could set a legal precedent that allows search engines to shut down or heavily restrict the third-party data aggregators that fuel the entire SEO software industry.
2. The Legal Shift in Web Scraping Jurisprudence
For years, web scraping lawsuits were fought primarily under the Computer Fraud and Abuse Act (CFAA). However, following the landmark ruling in hiQ Labs, Inc. v. LinkedIn Corp., federal courts have largely established that scraping publicly accessible data on the internet does not constitute unauthorized access under the CFAA.
As a result, major tech platforms have shifted their legal strategies. Instead of relying on the CFAA, they are increasingly turning to breach of contract (Terms of Service violations) and DMCA anti-circumvention claims to protect their data. The Google v. SerpApi case is a prime example of this transition. If Google can successfully use the DMCA to protect aggregated search results, it will hand platforms a powerful new weapon to bypass the limitations of the hiQ v. LinkedIn precedent.
3. Artificial Intelligence and Large Language Models (LLMs)
The rise of generative AI has created an insatiable demand for training data. AI developers regularly scrape search engines and public directories to train large language models and power real-time AI search agents. A final ruling in favor of Google could complicate how AI companies gather search index data, potentially forcing them into expensive licensing agreements with search providers rather than relying on independent scraping APIs.
What Lies Ahead
The Northern District of California’s decision represents a temporary pause in a high-stakes legal battle. By dismissing the claims but granting leave to amend, the court has effectively handed Google a roadmap.
If Google can produce licensing agreements or terms of service showing that publishers authorized SearchGuard to protect their search snippets, its DMCA claims could be reinstated, moving the case into a highly contentious discovery phase. If Google fails to meet this burden within the 21-day window, the permanent dismissal of these DMCA claims will stand as a landmark shield for the web scraping and data aggregation industries.
Reynand Wu 
Azzam Bilal Chamdy 
Evan Lee Salim 