Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
github.com/ArchiveTeam/comcast-grab
Grabbing the personal websites on comcast.
https://github.com/ArchiveTeam/comcast-grab
allow webhosting.comcast.net links. bump version/
0946bb92339cab59d772b7e6348c3032f9c28c93 authored about 9 years ago by Arkiver2 <[email protected]>
0946bb92339cab59d772b7e6348c3032f9c28c93 authored about 9 years ago by Arkiver2 <[email protected]>
make sure to not grab other domains. bump version.
86dbc61eb0c3423e29d2d53d4b329f8989314625 authored about 9 years ago by Arkiver2 <[email protected]>
86dbc61eb0c3423e29d2d53d4b329f8989314625 authored about 9 years ago by Arkiver2 <[email protected]>
skip urls with three slashes, ///. bump version.
e520e81c24ad26d7abe961b709fdb35a0711d540 authored about 9 years ago by Arkiver2 <[email protected]>
e520e81c24ad26d7abe961b709fdb35a0711d540 authored about 9 years ago by Arkiver2 <[email protected]>
also skip URLs from website itself after too many errors. bump version.
7a1afc721f1ce3c540c14ca3c390952dbbda5e82 authored about 9 years ago by Arkiver2 <[email protected]>
7a1afc721f1ce3c540c14ca3c390952dbbda5e82 authored about 9 years ago by Arkiver2 <[email protected]>
fix error on login pages
d31be0f53de6b068cfd8add1b7bc93eefa34c5fb authored about 9 years ago by Arkiver2 <[email protected]>
d31be0f53de6b068cfd8add1b7bc93eefa34c5fb authored about 9 years ago by Arkiver2 <[email protected]>
fix loop. fix minor problem. bump version.
3ccf3db54a47758dc046d64d547737a573e849d3 authored about 9 years ago by Arkiver2 <[email protected]>
3ccf3db54a47758dc046d64d547737a573e849d3 authored about 9 years ago by Arkiver2 <[email protected]>
prevent script from wasting time on non-exsistant sites
The scripts would previously get stuck on 0 errors for a while.
d97c1305131a207dc3ae22cf6c2387f69e5e2d4f authored about 9 years ago by Start <[email protected]>
pipeline.py: bump version.
a9c9c3dfb7efc8276a18d28604f82348a4360737 authored about 9 years ago by Arkiver2 <[email protected]>
a9c9c3dfb7efc8276a18d28604f82348a4360737 authored about 9 years ago by Arkiver2 <[email protected]>
set as executable fie
4b6c2bd035eb571aa89d08a08a53f4b40336b116 authored about 9 years ago by Arkiver2 <[email protected]>
4b6c2bd035eb571aa89d08a08a53f4b40336b116 authored about 9 years ago by Arkiver2 <[email protected]>
initial
1d7257df3d87e32409bf9325f97b4907ac13d66b authored about 9 years ago by Arkiver2 <[email protected]>
1d7257df3d87e32409bf9325f97b4907ac13d66b authored about 9 years ago by Arkiver2 <[email protected]>