Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
github.com/ArchiveTeam/tabletalk-scrape
Downloading tabletalk.salon.com
https://github.com/ArchiveTeam/tabletalk-scrape
Added check.sh to check if a topic is complete.
48aff9fb69434f2ee065b2d9b343fd72ea6ca9cd authored over 13 years ago by Alard <[email protected]>
48aff9fb69434f2ee065b2d9b343fd72ea6ca9cd authored over 13 years ago by Alard <[email protected]>
Be more persistent: retry until we've got a file.
The script will now keep retrying the same file until it succeeds.
The new version also deals wi...
dld-all.sh now continues on an error (doesn't quit).
When the script is finished, run it again to get missing files.
fbfb5fc1586038d6b06fe024c1dcd24541ee39a6 authored over 13 years ago by Alard <[email protected]>
Version 4: More tries, more timeout for wget. Renamed temp file. Support for proxy.
wget will wait a bit longer and try two times.
Temp file now includes pid, which makes it possib...
Source of the index pages.
92da13822a24f6e99cb89ab778ad9f281d6c6f50 authored over 13 years ago by Alard <[email protected]>
92da13822a24f6e99cb89ab778ad9f281d6c6f50 authored over 13 years ago by Alard <[email protected]>
Silence wget.
4ba2a87f0cb227463fdf63714adf7d8d4eb7fd57 authored over 13 years ago by Alard <[email protected]>
4ba2a87f0cb227463fdf63714adf7d8d4eb7fd57 authored over 13 years ago by Alard <[email protected]>
Better error handling for grabdisc.sh. A download script.
grabdisc.sh will stop when it finds an error (because the script has been blocked, for instance)...
aa1e5a8b6c78a4183d1aeda354b6b19c03142fb2 authored over 13 years ago by Alard <[email protected]>
Download scripts.
24af7e50dff2f76fb00d32b372d411b30065a477 authored over 13 years ago by Alard <[email protected]>
24af7e50dff2f76fb00d32b372d411b30065a477 authored over 13 years ago by Alard <[email protected]>
First commit. Added discussion ids.
A list of discussion ids per topic/attic.
2c3a535637e3e3a6235d9832c4544123b72f030d authored over 13 years ago by Alard <[email protected]>