[Athen] looking for spider-like software

Bourne, Sarah (MASSIT) sarah.bourne at mass.gov
Mon Nov 28 06:07:08 PST 2016


I recommend HTTrack - I have used it many times on sites small and large. Getting the parameters right isn't for the faint of heart, but that's the trade-off for having lots of parameters you can adjust. It's free - GPL license.

http://www.httrack.com/

Sarah E. Bourne
Director of IT Accessibility, MassIT
Commonwealth of Massachusetts
1 Ashburton Pl. rm 811 Boston MA 02108
617-626-4502
sarah.bourne at mass.gov
http://www.mass.gov/MassIT

-----Original Message-----
From: athen-list [mailto:athen-list-bounces at mailman13.u.washington.edu] On Behalf Of Prof Norm Coombs
Sent: Monday, November 28, 2016 1:20 AM
To: athen-list at u.washington.edu
Subject: [Athen] looking for spider-like software

I am looking for software like an old, old program called offsite explorer.
It would download a set of related web pages for me. Somehow I tole it where to go to start spidering web pages and how many levels down to include. It would get all the details and then save part of a web site for me. It let me select a sequence of related/connected web pages and then save them all for me.
Instead of having to save a lot of individual web pages, it collected them and saved them. I just set the parameters and waited.

It was free open source, but I'd also be willing to pay something if necessary.
Norm

_______________________________________________
athen-list mailing list
athen-list at mailman13.u.washington.edu
https://urldefense.proofpoint.com/v2/url?u=http-3A__mailman13.u.washington.edu_mailman_listinfo_athen-2Dlist&d=DQICAg&c=lDF7oMaPKXpkYvev9V-fVahWL0QWnGCCAfCDz1Bns_w&r=rhLenV33VPpmkT7iP0-OkUlRYw9YWn3HMLHZVP2q9y8&m=ccqpnwJeswMKoeW1FS0HUSXn3iJjAempV5DN-h4-Rxk&s=sKGigXGy4cREfGD8ijM1Q7527c26B3jDoIzyT5Mgi_Q&e=



More information about the athen-list mailing list