World Wide Web Wanderer

The Wanderer was developed at the Massachusetts Institute of Technology by Matthew Gray, who also created back in 1993 one of the 100 first web servers in history, www.mit.edu.

[1] The crawler was used to generate an index called the Wandex later in 1993.

The Wanderer charted the growth of the web until late 1995.

The Wanderer was probably the first web robot, and, with its index, clearly had the potential to become a general-purpose WWW search engine.

[2] Elsewhere, it is stated that the purpose of the Wanderer was not to be a web search engine.