A simple web-crawler application.
- Clone this repo
git clone [email protected]:Milesjpool/web-crawler.git && cd web-crawler
- Run the tests
go test -v ./...
- Build the executable
go build
- Crawl the web
./web-crawler http://my.target.domain
*
* Or to write output to a file ./web-crawler http://my.target.domain > output.json