< Back to Blog
January 30, 2026

Host- and Domain-Level Web Graphs November/December 2025 and January 2026

The latest Web Graphs from the November and December 2025 and January 2026 crawls are now available, comprising 279.4 million host-level nodes with 13.4 billion edges, and 122.3 million domain-level nodes with 6.1 billion edges.
Thom Vaughan
Thom Vaughan
Thom is a Principal Engineer at the Common Crawl Foundation.

We are pleased to announce a new release of host-level and domain-level Web Graphs based on the crawls of November and December of 2025, and January 2026. The crawls used to generate the graphs were CC-MAIN-2025-47, CC-MAIN-2025-51, and CC-MAIN-2026-04. Additional information about the data formats, the processing pipeline, our objectives, and credits can be found in the announcements of prior Web Graph Releases. You may also visit the projects cc-webgraphand cc-pyspark which include all scripts and tools required to construct the graphs. Instructions to explore the graphs in the webgraph format are given in our collection of Web Graph Notebooks. You may also wish to explore our Web Graph Statistics page for more information on ranking, and our Index of Web Graph Releases.

Important note

Starting with this Web Graph release, the leading www. in a host name is preserved. That is, the host name www.subdomain.example.com becomes com.example.subdomain.www in reverse domain name notation. See the issue report for further details.

Host-level Graph

The host-level graph consists of 279.4 million nodes and 13.4 billion edges.

There are 211.2 million dangling nodes (75.60%) and the largest strongly connected component contains 38.9 million (13.92%) nodes. Dangling nodes stem from:

  • Hosts that have not been crawled, yet are pointed to from a link on a crawled page
  • Hosts without any links pointing to a different host name
  • Hosts which did only return an error page (eg. HTTP 404).

Host names in the graph are in reverse domain name notation: www.example.com becomes com.example.www.

You can download the graph and the ranks of all 279.4 million hosts from AWS S3 on the path s3://commoncrawl/projects/hyperlinkgraph/cc-main-2025-26-nov-dec-jan/host/ (this requires an account on AWS). Alternatively, you can use https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2025-26-nov-dec-jan/host/ as prefix to access the files from everywhere.

Please note that the text representation of the host-level graph is shipped in 168 gzip-compressed files listed in two path listings - one for the nodes (vertices), one for the edges (arcs). First, download the paths listing and decompress it using gzip -d or gunzip. By adding the prefix s3://commoncrawl/ or https://data.commoncrawl.org/ to each line in the path listing you get the list of URLs to download the entire graph.

Download files of the Common Crawl November, December, and January 2025-26 host-level Web Graph

Size File Description
199 Bytes cc-main-2025-26-nov-dec-jan-host-vertices.paths.gz nodes ⟨id, rev host⟩, paths of 24 vertices files
529 Bytes cc-main-2025-26-nov-dec-jan-host-edges.paths.gz edges ⟨from_id, to_id⟩, paths of 144 edges files
18.2 GiB cc-main-2025-26-nov-dec-jan-host.graph graph in BVGraph format
1.3 KiB cc-main-2025-26-nov-dec-jan-host.properties
18.1 GiB cc-main-2025-26-nov-dec-jan-host-t.graph transpose of the graph (outlinks inverted to inlinks)
1.3 KiB cc-main-2025-26-nov-dec-jan-host-t.properties
828 Bytes cc-main-2025-26-nov-dec-jan-host.stats WebGraph statistics
5.2 GiB cc-main-2025-26-nov-dec-jan-host-ranks.txt.gz harmonic centrality and pagerank

Domain-level Graph

The domain graph is built by aggregating the host graph on the level of pay-level domains (PLDs) based on the public suffix list maintained on publicsuffix.org. Version (commit) 2218b36 of the public suffix list was used (commit date 2026-01-08T11:50:45Z).

The domain-level graph has 122.3 million nodes and 6.1 billion edges. 62.6% or 76.6 million nodes are dangling nodes, the largest strongly connected component covers 32.4 million or 26.46% of the nodes.

All files related to the domain graph are available on AWS S3 under s3://commoncrawl/projects/hyperlinkgraph/cc-main-2025-26-nov-dec-jan/domain/ or on https://data.commoncrawl.org/projects/hyperlinkgraph/cc-main-2025-26-nov-dec-jan/domain/.

Download files of the Common Crawl November, December, and January 2025-26 domain-level Web Graph

Credits

Thanks to the authors of the WebGraph framework, whose software made the computation of graph properties and ranks possible. We hope the data will be useful for you to do any kind of research on ranking, graph analysis, link spam detection, etc.

Let us know about your results via Common Crawl's Google Group, or on our Discord Server.

This release was authored by:
Thom is a Principal Engineer at the Common Crawl Foundation.
Thom Vaughan
Luca Foppiano is a Senior Engineer at the Common Crawl Foundation.
Luca Foppiano

Erratum: 

Content is truncated

Originally reported by: 
Permalink

Some archived content is truncated due to fetch size limits imposed during crawling. This is necessary to handle infinite or exceptionally large data streams (e.g., radio streams). Prior to March 2025 (CC-MAIN-2025-13), the truncation threshold was 1 MiB. From the March 2025 crawl onwards, this limit has been increased to 5 MiB.

For more details, see our truncation analysis notebook.