February 14, 2020

S3 Throughput: Scans vs Indexes

A comparison of S3 throughput with many requests for small files or one request for a large file.

November 6, 2019

Hello, WARC: Common Crawl code samples

Code samples and benchmarks for processing Common Crawl WARC files in Python, Java, Go and Node.