Skip to Content

Evaluation of Open Source Spidering Technology

This is a paper from 2004.


Twenty spidering programs were evaluated for ease of use, technical ability and extensibility. Some lacked relative link rewriting and image saving ability. None could break through to the deep web without extension.

about seo | resource