Automated software that requests data from a web server's URL , parses the data for additional URLs or any other desired data, then crawls through each new link repeating the process.
next>