Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/livejournal-discovery

Merge pull request #4 from Medowar/patch-1

Added handling of HTTP response 500

b177c964f3647f1293356c2e5babc70308a658f3 authored almost 8 years ago by Arkiver2 <[email protected]>

Update pipeline.py

15f10063cba2c86ffd81e8c0bcbce75c55d51cba authored about 8 years ago by Medowar <[email protected]>

Added handling of HTTP response 500

Seems there are a few journals, that always return a 500-error. Script should now not stop on this.

a5e9a900482ce70c16f11fea1794caa3e1e6a178 authored about 8 years ago by Medowar <[email protected]>

Merge pull request #2 from bzc6p/patch-2

Sleep one hour when banned

541b1add0faeb8e2abdbeb6b28b74cdc5818c05e authored over 8 years ago by Arkiver2 <[email protected]>

Merge pull request #3 from bzc6p/patch-3

Ramp up sleep time to 5 sec

dd728b1713bbe964ac5db533751eafa42864cafe authored over 8 years ago by Arkiver2 <[email protected]>

Ramp up sleep time to 5 sec

This should be enough even with 2 concurrent threads, and still better than the current situatio...

9726b9f6f4a730a37028e27c1be379dd55b1880d authored over 8 years ago by bzc6p <[email protected]>

Sleep one hour when banned

In order to prevent excessive item trashing.

27bac319b8d011eb42506478bb9ac471f8760f1f authored over 8 years ago by bzc6p <[email protected]>

pipeline.py: bump version to 20160421.01.

0c4147eada2d3be425f167cd2ff703404449a7cd authored over 8 years ago by Arkiver2 <[email protected]>

Merge pull request #1 from bzc6p/patch-1

Bug fixes / Enhancements

b6aa64ba886e31e74fb5b5d3b42241bc3fc3f2d5 authored over 8 years ago by Arkiver2 <[email protected]>

Put back 0.5 seconds sleep (to a more logical point)

5399f64138c30bce6cc4031e3b231bd9576bae72 authored almost 9 years ago by bzc6p <[email protected]>

Bug fixes / Enhancement

In check_200:
– Check in the end if we reached the max number of tries, then raise exception in...

9e7bebca18b1c092caab006c1bc4345ed7f52ba1 authored almost 9 years ago by bzc6p <[email protected]>

Sleep 0.5 seconds between requests. Do not abort on status code 403 the page is a 'Suspended Journal'. Bump version to 20160314.01.

8adc98a15ff89723934bc9360b6052f61bc50b10 authored almost 9 years ago by Arkiver2 <[email protected]>

Abort discovery if status code 403 is received. Bump version to 20160313.01.

a6dd79d9396fb794c0b49a4499d67313799b3636 authored almost 9 years ago by Arkiver2 <[email protected]>

Create README.md

0ab718d7bbab85fa77655f27886f4474a750d838 authored almost 9 years ago by Arkiver2 <[email protected]>

Fix output of profileid and status_code. Bump version to 20160312.02

813dd3ca6d0aaf7058fdd984ab0f190757d2f163 authored almost 9 years ago by Arkiver2 <[email protected]>

discover.py: remove debugging

f0ead73302718130709ecd1fa4abc519d1768146 authored almost 9 years ago by Arkiver2 <[email protected]>

initial

8b153a665e1403fe66a775c08260ae7716827216 authored almost 9 years ago by Arkiver2 <[email protected]>