Search Before Search Felt Settled

WebCrawler in October 1996 calls itself a search service home page, with metadata naming search engines, web databases, and web robots. The page lets users search the web, choose titles and summaries, and set result counts of 10, 25, or 100.

It also offers categories: Arts & Literature, Business, Chat, Computers, Daily News, Education, Entertainment, Government, Health & Medicine, and more.

That hybrid structure is historically telling. WebCrawler stands between directory browsing and full-text search. It understands that users may want to type a query, but also that they may still need guided categories.

The page captures the web while discovery methods were still competing. Search was not yet one dominant habit. It was a set of experiments around robots, indexes, summaries, examples, and taxonomies. WebCrawler's promise is not elegance; it is reach. The page says: the web is large, but a machine can help you enter it.