github.com/ArchiveTeam/verizon-grab commits | Ecosyste.ms: OpenCollective

Use bellatlantic.net for all bellatlantic* packs.

verizon.lua previously attempted to match verizon.net for a
bellatlantic1296pack, but no other a...

227cb040b8d9db52f154a7730aa5e0c6edca8352 authored over 10 years ago by David Yip <[email protected]>

On response code 0, also output wget error code.

This provides a little more insight into the sort of protocol/network
error that wget encountered.

8075a209c0cb79da16a76fd65122fb3dd7e57644 authored over 10 years ago by David Yip <[email protected]>

pipeline.py: assert 'bellatlantic1296pack'. bump

version

5068784b85afe62e425aa2601858c8011426d082 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

4580610e0fd2f35432108c745ac3937ef71f475f authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: add support for

'bellatlantic1296pack'

4e87b1dd74f1329be0a0e54ce022640d3b8045fe authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: add support for

'bellatlantic1296pack'

d6f14139cd6a404261d247815800804177554fae authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

eca6fd7028f6c01698757cfcce7baecf334ae60c authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua

43dc8f86ccdbd01544758e61568eb194c493946d authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

3351cac14a5d55e1787e8cfcbf007f92e3dba0e6 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: abort after 5 tries on status code 0

3e16ac0fa7e52e752376c15c0aab53a770ad30bd authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: rising retries for error status codes

(except 423) to 15 tries

cd307920bc53e50b0b2c4ac89e38cf2afb3eb760 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: import string

51743dd87b691fddd1905f337190c7206574585c authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: assert 'verizon1296pack'

576effe15a7c062dfa122dd103ec9acab48f71fc authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: add support for 'verizon1296pack'

0eda8b9a027c71d7080bf7f3d93baa5535c34780 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: add support for 'verizon1296pack'

ae84294d63bd490195f4896a4eb20dd364a7d2a8 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline: Don't report failures.

This filled up a VPS with a bunch of 423 notifications that likely won't
ever become accessible.

d6c44e1f421a8c38ae631d5a59684d0cdc0862ee authored over 10 years ago by David Yip <[email protected]>

pipeline.py: add support for verizon1296pack

c2c3f7ff0859d4012696ecfc4999ec89373e23fc authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

22d30aa10f570739d7e1749e988ef84a2ff2f440 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: do not download front pages

48c4a0ee19af9c214cdaae1a3447f9c5119bd457 authored over 10 years ago by Arkiver2 <[email protected]>

Set +x warrior-install.sh. Bump pipeline version.

3633c5b76321c2291295dc10d87fb53fd4226feb authored over 10 years ago by Christopher Foo <[email protected]>

Bump pipeline version.

33652609423e623d62abfb6b161ef9485f1bbd17 authored over 10 years ago by David Yip <[email protected]>

Use port 81 for failure report endpoint.

verizoff.at.ninjawedding.org is running on a system with other HTTP
daemons on it. Easiest solu...

e0a0f0fd392c1b7ef84144c156865813e9530598 authored over 10 years ago by David Yip <[email protected]>

failure_report.lua: send failure reports to

http://verizoff.at.ninjawedding.org/fail

c94ed06ed401e5d1f2bc51fdbfcd5503861696e4 authored over 10 years ago by Arkiver2 <[email protected]>

Add files needed for report of failure

6563f59577e69de77616a4b07a3225a493dbfc2e authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: accept protocol errors from wget

aa83d30f9925e9cf6c8ae0124292a745d677b506 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: log failures

7e25ef4a8dd32a7898a6b89a497d67c45cc6dd34 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: log downloader

f4bc6cb9746830da8064e6baa98b7cb4813d6388 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

fcf9afa49b448b59ecac1adbe2bd7c94255679ef authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: match.string > string.match

544533d202ace413664106192fd2fbd73c5ea95d authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

3f528a90b22edfc7e4d023423ff406851ce55e9f authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: check 36 packs for matching strings

3d7cd3fe51cb02a10db0522ccac9be5496e5a769 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

93a254f3634eab9319c95a9118fb05e4301e3cd8 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: fix little mistake

53d5ed802ff3948dac15e099626ef16f65ed26f7 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

75be5e02a4cd1ddf4a5f513c7ea7571b491ee79a authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: add support for verizon36pack

7e5edef96fc35006f3347a977337f51ac0dcb3de authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: add support for verizon36pack...

, bump version

616907e4a8880c74bf75433234473fe6c4eac4f2 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

319dd551019f3ebb8819636698f7cc8d0ab31e87 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: add a longer sleep time for 0 code

3afca6429a17ba80c30f67b2e810b73ab447d9e4 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: add a longer sleep time for 0 code

d4d20e8fc04f702ef1e3add47387a88e90cbd2bf authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

bc17f05d017a4ef9e37e5489542b163562a38149 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: add some sleep time

c6670eaced43d3fb63b900831e93afd85b334497 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: change sleep to 1

59b359cbc3a6f8178c6d4b7540988beda51dc2ba authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: add support for bellatlantic36pack...

, bump version

36b2f084ea4671c501edea8aa1fea3c7d76fe7c3 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: add support for bellatlantic36pack

25149c86cedbe753e01343356b6afa7edd2af300 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

8281cc0c0ba5e403abc6051a211a540494956a41 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: abort on status_code 423

ed5134a45f7132f0b8d7f93b06dde340a26230d5 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: set max_tries to 2, bump version

9e8fde1e4f319cac5e671d8c530081ab4b5da3ad authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

c0b17398960aebe3617e2d3974df35abd7101f66 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: add 5 tries for status code "0"

5687b20b1cc95abb4c9a6302267ddb95f29d79a1 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

ae3e1f68c2260636342f7f9d3bad0fd68983fffc authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: Fix string compare. Assert fail on else fall-through for debugging.

43900f64b32c32b71d8bfcc2f826efaa4ef92284 authored over 10 years ago by Christopher Foo <[email protected]>

verizon.lua: Fix unreachable code.

2e3309833104bf0d9d6a62275e91083f43e4211e authored over 10 years ago by Christopher Foo <[email protected]>

Set executable bit on wget+lua

ef44631c92baac0b3ad5ce878dfc9051c4b3e6cf authored over 10 years ago by Christopher Foo <[email protected]>

verizon.lua: do not download sites that have ten /

80fa7a3e01602b7ea67b7d8337d2c603d418748e authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: fix for "'s

f87b220c10950be3bab20dcbf6b09ee3dcb10200 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: update to responde on status codes

Abort when getting a 0 status code. Abort after 5 tries when getting status code above 500 or st...

c48398a59fa355b0c0bc06243647a5dd0469ceaf authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: change to not download other sites

875dc288c55fd56db569331d633f706eb3c951f5 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: fixed problem in script

364d39c5babe32e702c0ceeeb898ee345ec60d32 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: changed some errors in the code

5e8d44548a4e55a082e20508206654c50b709734 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: do not download other websites

817b8d7c6f238fb4d838bba0c9adf353adc4b178 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: set max retries to 10, instead of 2

c799b3a7a13b7ada83f2edcd96f69b68e23e6d51 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

bda45fb7bb0eb16f964682b5364c092322bfbf71 authored over 10 years ago by Arkiver2 <[email protected]>

verizon.lua: add wget NOTHING for code 404 and 403

a3edc15343217fa03e384dd8f32a7b5e54c23f37 authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: bump version

f646f370008d086ae986f2fbb3c68d327590a65a authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: assert ':' in item_name

577fed45fd0623338c1d84ee89ffa120edd4bc7a authored over 10 years ago by Arkiver2 <[email protected]>

pipeline.py: "-archive" is canvas specific

f3a85ea459827fed5f670915dd9ea1df8f5640ff authored over 10 years ago by Arkiver2 <[email protected]>

Remove wget.callbacks.get_urls from verizon.lua.

33c0a3b8051987d619533271b12110064f1c82fc authored over 10 years ago by Arkiver2 <[email protected]>

Added wget-lua-warrior

f61d6057f8143e65bc849c556a884e2ebb9d5307 authored over 10 years ago by Arkiver2 <[email protected]>

htp:// to http://

09e99df213ec70eb88efb4a5cf5d08d9c125ad53 authored over 10 years ago by Arkiver2 <[email protected]>

Create verizon.lua

6c8c56acd82f98da360955bfadab1549bb3651f9 authored over 10 years ago by Arkiver2 <[email protected]>

Create pipeline.py

d09aee84e2f688d909e9507e1281b711e044446e authored over 10 years ago by Arkiver2 <[email protected]>

Create LICENSE

40d65a31ad8d8119a62d031198061afc4baf35e9 authored over 10 years ago by Arkiver2 <[email protected]>

Create get-wget-lua.sh

c2ee744e2ccaedfedd9609b5d03d703b5a0be56c authored over 10 years ago by Arkiver2 <[email protected]>

Create README.md

cc40cf4a9136cf3c5d50e255bd010f1c37be89bc authored over 10 years ago by Arkiver2 <[email protected]>