Design a web crawler
At the start we seed a few webpage which recursively add more pages from the links found on the seed pages. Uses Cases Used for search engine indexing, web archiving, web minining (scraping), web moni
Aug 24, 20262 min read74

Search for a command to run...
Articles tagged with #distributed-systems
At the start we seed a few webpage which recursively add more pages from the links found on the seed pages. Uses Cases Used for search engine indexing, web archiving, web minining (scraping), web moni

A URL shortener is a proxy service that provides a mapping between the short and full representation of a URL. The short URL has the advantage of being small. The service can also provide useful analy

We need to create a unique ID generator for our high-traffic web application, generating about 10K IDs/second. The IDs can't simply be monotonically increasing integers, which are good for data access