A Web crawler written in Python that finds and hits URL(s) in a page and goes on.

Prasanna Venkadesh 04e14c2575 Output written to file 4 years ago
README.md 7dd070272d Check for basic usage 4 years ago
crawl.py 04e14c2575 Output written to file 4 years ago

README.md

An Internet web-crawler that finds URL(s) in a given root or seed URL and continues to do the same in those spotted URL.

Usage

    python crawl.py