Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/puush-grab


https://github.com/ArchiveTeam/puush-grab

item_queue.py: Add missing slash.

2fc6f154685008362839666126cbe904786d2a2f authored almost 11 years ago by Christopher Foo <[email protected]>
Update readme from new standalone readme template

Pulls some info from ArchiveTeam/standalone-readme-template
ebb02d13012d63b856f39aa7f8392eb472a8...

c7cd32f0de47babcd147eb302621c81a178ac847 authored almost 11 years ago by Christopher Foo <[email protected]>
pipeline.py: Updates tracker host to dynamic hostname

a8c246614e19e704bdbc0caa757d1bcec55ecabc authored over 11 years ago by Christopher Foo <[email protected]>
item_queue.py: Make failure sentinel file more robust.

b6fa431f931218408b9e4868db65586ad9070db6 authored over 11 years ago by Christopher Foo <[email protected]>
item_queue.py: Check for fake/malicious IDs before continuing.

ee85eabb4472b3577fa0882196ca7bda11f48431 authored over 11 years ago by Christopher Foo <[email protected]>
item_queue.py: Add example crontab entry to doc

d43b137a8ee648b7850f4f0def784e8e7480e05a authored over 11 years ago by Christopher Foo <[email protected]>
Add item_queue.py and enqueue.rb

544d4d10c99b0d2d882b0f2353ba86a8fe914c87 authored over 11 years ago by Christopher Foo <[email protected]>
decentralized_puush_grab.py: Support only grabbing one at a time.

2dbc2d49e49d84ec0645c1c0b146ece70d065bc8 authored over 11 years ago by Christopher Foo <[email protected]>
db_dump.py: Make redis module optional

a30c04c75a3dcd609838729bd88b933989ccb202 authored over 11 years ago by Christopher Foo <[email protected]>
Merge branch 'master' of github.com:ArchiveTeam/puush-grab

8b84cdf4fabc8da0953e0a2ee2fb35ee0d2c9973 authored over 11 years ago by Christopher Foo <[email protected]>
Update readme about installing gnutls

852b4604b4f14c2181b315795829111cd6ab512d authored over 11 years ago by Christopher Foo <[email protected]>
Update readme about new alphabet

a85db293d698cacaaaf188ff9ee40951b0722bc6 authored over 11 years ago by Christopher Foo <[email protected]>
Supports alternate base 62 alphabet

e80e68956f5aaa15b6c910f74f66e9bc310fa504 authored over 11 years ago by Christopher Foo <[email protected]>
Update readme to reflect the alphabet used by puush.

ef4c2de50617c3d680999c55965d0a62a2624248 authored over 11 years ago by Christopher Foo <[email protected]>
Fix wrong retry param. Fix missing variable.

da087e9aef09db369dd71c87548f2006128b68bd authored over 11 years ago by Christopher Foo <[email protected]>
Tweak delay values

f40cfd23a7eeb6a0e915e95229ace321e71a30d4 authored over 11 years ago by Christopher Foo <[email protected]>
Use exponential delay instead of waiting immediately after error

50ddf671088eb46b666beb7a3ca9e244fb6aab2a authored over 11 years ago by Christopher Foo <[email protected]>
db_dump.py: Support reading an archived log dump.

9838e7ccaa269be6487ab0756829857d4efcbfd0 authored over 11 years ago by Christopher Foo <[email protected]>
Use random delay between requests. Show http status.

cdc9a0e6e4f9d46cdf308527e7077c46ece059d9 authored over 11 years ago by Christopher Foo <[email protected]>
item_name_gen.py: fix item exclusion

04e5bd28bec4ec7aa5862ee8151dbc2c1a4acf54 authored over 11 years ago by Christopher Foo <[email protected]>
db_dump.py: add option to scrub out username from logs

0ada2f8b8a594e04febdd535c763cbd2a7994fde authored over 11 years ago by Christopher Foo <[email protected]>
Add a script to dump out database

62faefa0652efb4a20da6662429805ba87397df9 authored over 11 years ago by Christopher Foo <[email protected]>
pipeline.py: Support items with ranges

58588fe5ec848497b8d12894e80ebfe830f3fe1a authored over 11 years ago by Christopher Foo <[email protected]>
Make item name generation script support item containing ranges.

1075004d8e8332c2c83159f81eb4240e13c5c262 authored over 11 years ago by Christopher Foo <[email protected]>
Add instructions on running pipeline without warrior

Instructions taken from ArchiveTeam/greader-grab/blob/master/README.md

587e3f2fe2e55712c14112455e7e7ca2416dd429 authored over 11 years ago by Christopher Foo <[email protected]>
Add non-offical tracker url.

6a0053591ff12f98b032d1b26f28cb9ab1601188 authored over 11 years ago by Christopher Foo <[email protected]>
Update the readme about the item ids.

5e84a63773b9d03307498834461c37016f0dfbf7 authored over 11 years ago by Christopher Foo <[email protected]>
Check wget & delay in case of ban or server overload

12d7db24710edf4cb762deaeedce6aa12ea55f60 authored over 11 years ago by Christopher Foo <[email protected]>
Adds item name generation scripts.

045290c8cacc1f1a40fe3745b1c1ce0712d65ad7 authored over 11 years ago by Christopher Foo <[email protected]>
Fix up the pipeline.py to be suitable for the tracker.

8ed4d72bedc7b551aeef58d396cfb3e7415eda50 authored over 11 years ago by Christopher Foo <[email protected]>
decentralized_puush_grab: Show what kind of error occured

fc7073cf33cba94d950222033e30d2f22a931b6b authored over 11 years ago by Christopher Foo <[email protected]>
Make wget return custom error code instead of aborting.

c94d54455851557f5bd4cceb8f69f72bac7518fd authored over 11 years ago by Christopher Foo <[email protected]>
Merge branch 'master' of github.com:ArchiveTeam/puush-grab

669fec78f9d45e6c306660a17400aa7bd1b88ca0 authored over 11 years ago by Christopher Foo <[email protected]>
Fixes mix up of the min delay in the throttle calculation

4391bf7c2a5d832d32496fd6337a9fcc764517aa authored over 11 years ago by Christopher Foo <[email protected]>
Merge pull request #2 from chfoo/master

Add in a basic lua script and include a decentralized grab script

fdabcd1681e84987f9fa73fd6c87b391d572b045 authored over 11 years ago by Ivan Kozik <[email protected]>
Add a decentralized script for now.

b1bae41416f87b6278f93c7df0c9afce4e0b488c authored over 11 years ago by Christopher Foo <[email protected]>
Add a basic lua script.

590710ef765dbe95b3b0956f5e6aa852723dd67b authored over 11 years ago by Christopher Foo <[email protected]>
Merge pull request #1 from chfoo/master

Get started by putting in basic files

9ffe27e0e4e52ad080be0ba75f29f1a0a82d957a authored over 11 years ago by Ivan Kozik <[email protected]>
Get started by putting in basic files

6b1b6f98365d31aac43b6c62c5e2e24cb2af737a authored over 11 years ago by Christopher Foo <[email protected]>
Initialise repo, add basic readme

06c055cd9438689fb71ef961a1b313587185b022 authored over 11 years ago by Terry Wrist <[email protected]>