Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/tumblr-grab

Archiving all to-be-deleted NSFW tumblr blogs.
https://github.com/ArchiveTeam/tumblr-grab

Update version to 20181223.01

c3b723ceec7476ab8f760afec7c029ae4b90c9c6 authored about 6 years ago by Arkiver2 <[email protected]>
Merge pull request #92 from Fusl/skipgdpr

Skip PFG cookie generation for countries not affected by GDPR

4c47c29b7bbb3cd8e4e8dacadc850280fd9ee96e authored about 6 years ago by km09 <[email protected]>
proper tornado error handling

3b659308b5933912aa4db1408efd473b406704f4 authored about 6 years ago by Katie Holly <[email protected]>
fix use of append->extend

e7f43facfe8616930a49487f20d59be2d3a81d45 authored about 6 years ago by Katie Holly <[email protected]>
set reuses back to 0

dd3bc7fa47f3c087ce31286903f71fc966f4dc4a authored about 6 years ago by Katie Holly <[email protected]>
add return stmt

0c25fbdf453713116e4b2178b9346a7a491bf022 authored about 6 years ago by Katie Holly <[email protected]>
refine pfg skip check

53fae55617308366d02c1d6863c6f55a68dffb0b authored about 6 years ago by Katie Holly <[email protected]>
skip pfg cookie generation for non-gdpr countries

e4ae2142674db769fb77bf5591f9b2f73487589e authored about 6 years ago by Katie Holly <[email protected]>
Merge pull request #91 from Fusl/useragents

Abort items whos base URL redirect to safe-mode, skip subsequent safe-mode redirects

e6ccf67d35fd75814c62a0761670c54004018d4c authored about 6 years ago by Arkiver2 <[email protected]>
Merge remote-tracking branch 'upstream/master' into useragents + bump version

d83c03b82b0582575ee39bb60768cb3a773a07a4 authored about 6 years ago by Katie Holly <[email protected]>
Abort items whos base URL redirect to safe-mode, skip subsequent safe-mode redirects

1d97ab53a2fb1c0d1417d00f0a9b72fb18654866 authored about 6 years ago by Katie Holly <[email protected]>
Update version to 20181219.01

06c6bbfb259f89437b4d745be514ccec3f681197 authored about 6 years ago by Arkiver2 <[email protected]>
Merge pull request #90 from Fusl/useragents

always generate new pfg token, reuse existing pfg token on failure, update UAs

e6067c5c5e2ef6a53d97cd0b1e6118405fc251ff authored about 6 years ago by Arkiver2 <[email protected]>
Overwrite UAX only if we got a new cookie

69f8360cf67a104ccdc40353420b99873a0e910a authored about 6 years ago by Katie Holly <[email protected]>
forgot to set PFG variable on success

9832825c88c434e4dc0d6261ff81fafd76c7b6e7 authored about 6 years ago by Katie Holly <[email protected]>
always generate new pfg token, reuse existing pfg token on failure, update UAs

9891a20d6940a63fa1911c1772fadafb6ad8ac67 authored about 6 years ago by Katie Holly <[email protected]>
Merge pull request #89 from Fusl/ignoresafemode

Ignore safe-mode redirects instead of aborting

0c30b9fc7c592ef47673e09a8bc2385e822ea73c authored about 6 years ago by David Yip <[email protected]>
Ignore safe-mode redirects instead of aborting

527369261db2a5942e7238030b187bd7f74ed717 authored about 6 years ago by Katie Holly <[email protected]>
Merge pull request #88 from Fusl/distributed-cookiefactory-2

Hotfix: decode http response as utf-8 instead of ascii, ignore unknown chars

d6d3e6ac4fdce2f5f077a27c2dbcdce60edf1266 authored about 6 years ago by Arkiver2 <[email protected]>
use `with UAX_PFG_LOCK` instead of .acquire()/release() calls

b62006bc67d74ba3e2d36b09ec532440e896a4db authored about 6 years ago by Katie Holly <[email protected]>
typo

2ffeef17624abca6734ce99e0137549183646e92 authored about 6 years ago by Katie Holly <[email protected]>
add pfg acquire locking

153bdffe0e07662879ac2934cf99764b73986b33 authored about 6 years ago by Katie Holly <[email protected]>
Hotfix: decode http response as utf-8 instead of ascii, ignore unknown chars

afc89e69e6bae99508ab9783cdeee858694a165a authored about 6 years ago by Katie Holly <[email protected]>
Merge pull request #87 from Fusl/distributed-cookiefactory-2

Add pfg cookie factory to pipeline for distributed cookie baking, attempt #2

5a9175281bd800a6c628e736cd50bc1f52db05f1 authored about 6 years ago by kiska3 <[email protected]>
use random.choice instead of .sample, drop strip()

7db971c4425affbc58420504ac4cac3069fd2a1b authored about 6 years ago by Katie Holly <[email protected]>
Add pfg cookie factory to pipeline for distributed cookie baking, attempt #2

22e1a5db1d35df2153214c6611e01e1680a9576f authored about 6 years ago by Katie Holly <[email protected]>
Merge pull request #86 from ArchiveTeam/revert-85-distributed-cookiefactory

Revert "Add pfg cookie factory to pipeline for distributed cookie baking"

a92eb2da43ed0e8358e25f763e96fbdcf11fcf75 authored about 6 years ago by kiska3 <[email protected]>
Revert "Add pfg cookie factory to pipeline for distributed cookie baking"

abc8b68c6c507f76f39fea81c52aa081af64e865 authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #85 from Fusl/distributed-cookiefactory

Add pfg cookie factory to pipeline for distributed cookie baking

94afc8e146d0947f194d2b54f743adc7cc135438 authored about 6 years ago by kiska3 <[email protected]>
Add pfg cookie factory to pipeline for distributed cookie baking

a123c648cdf6f8cc8dfc907d510f7b20fe104c54 authored about 6 years ago by Katie Holly <[email protected]>
Update to 20181217.10

162c799bc35bfeab2ca82dcb245a6f6a58e40d65 authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #83 from sfan5/patch-2

Fix safe-mode abort condition

e9cf679263db18cb0728b798ce0278d265edb5af authored about 6 years ago by kiska3 <[email protected]>
Fix safe-mode abort condition

1b94b04c14433819ccdbdf0fc9cb0a4deeb1df11 authored about 6 years ago by sfan5 <[email protected]>
Update to 20181217.09

0046ceac209cfaa316049a35da4f4e957650fad6 authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #81 from drdaxxy/patch-16

Replace cookies

880788512e591473c30f35777fb908779cb7c98f authored about 6 years ago by kiska3 <[email protected]>
Remove sfan5's faulty cookie

0d3d90a1afcfc8e836300075a358245bd9f94f65 authored about 6 years ago by Niklas K <[email protected]>
Merge branch 'master' into patch-16

bd05463833f911965f88e2d07f4c800b9ebd160a authored about 6 years ago by Niklas K <[email protected]>
Update to 20181217.08

d729fdcc77805993047a98fe27cb0db73ebd772d authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #82 from sfan5/patch-1

Cookies

6d87819d88eaf0fe1fb59301286299811846a5f4 authored about 6 years ago by kiska3 <[email protected]>
Remove broken cookies

51c1bc100c57eb130bb7843c4d9c87877a6f17e2 authored about 6 years ago by sfan5 <[email protected]>
Replace cookies

Only the ones from the form with pfg set.

6 cookies on one UA is a bit short, but hey.

8453b45097803de8438d32961514ed8bc5544834 authored about 6 years ago by Niklas K <[email protected]>
Refresh cookies

0865169ec99290f36d0b08d28c703e9cb4201b55 authored about 6 years ago by sfan5 <[email protected]>
Update to 20181217.07

187b3aedad80f079a258d7e4eda27100d08e8d08 authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #77 from sfan5/patch-1

Add cookies

aae25fdaa8df35c1b8d6897f74c93db097667dcc authored about 6 years ago by kiska3 <[email protected]>
Add cookies

d1538cd6dcafa4dce9cd7c981e10ec9bd4eabcf3 authored about 6 years ago by sfan5 <[email protected]>
Merge pull request #79 from nemobis/patch-2

Add links for monitoring, cosmetic change

bd989519a42084bcbdacdb2e0a6a7e62c1a046e1 authored about 6 years ago by kiska3 <[email protected]>
Add links for monitoring

5a0bb6d5b6c512f4930e679a7afb139961e27335 authored about 6 years ago by nemobis <[email protected]>
Merge pull request #76 from Fusl/removecookie

remove outdated browser UA cookie

9f1b1870137aa5bc9578beec894cadea881657c7 authored about 6 years ago by kiska3 <[email protected]>
remove outdated browser UA cookie

f8e714679024b9b149b059d83f9dcc41d5b99ee7 authored about 6 years ago by Katie Holly <[email protected]>
Update to 20181217.05

7d286ee322dad98e14eead9bd04d6a518ea40449 authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #75 from Fusl/cookiefactory

add more cookies

a6795b287a45c88337cfaf18248550807e337aa6 authored about 6 years ago by km09 <[email protected]>
even more of them

04a2afa7d09360de431c1657e8d2a03eed52c1c8 authored about 6 years ago by Katie Holly <[email protected]>
add more cookies

045c026f333a408101830da9fd40d35ced4804e3 authored about 6 years ago by Katie Holly <[email protected]>
Update to 20181217.04

6241795198d7a39a51851e2ac8c2579ca6df2055 authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #66 from Fusl/exclude_template_urls_in_get_urls

Exclude /: template urls early in get_urls already by adding it to allowed() check

ed41ca139244d93847235a42e16ae70e6cd31914 authored about 6 years ago by kiska3 <[email protected]>
Merge branch 'master' into exclude_template_urls_in_get_urls

a2297639c8e6c5c342ba4f804274f85b0bf8011a authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #70 from marked/patch-16

Prevent /embed URLs also from posts with no title

80800612038ef0b8765a6b7473f3143a410c965a authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #74 from Fusl/cookiefactory

bump version

e2777a677420e1d53404eb505904c917a7ded52e authored about 6 years ago by Jason Scott <[email protected]>
bump version

a97b25b42d10da7127139347bce144640b34c58e authored about 6 years ago by Katie Holly <[email protected]>
Merge pull request #73 from Fusl/cookiefactory

Cookiefactory

455add56a2e5ad3d41a028fedaa481a9bf4fd6df authored about 6 years ago by Jason Scott <[email protected]>
Add more cookies

d0261a1cd269779cd8aa741adf95a06ef86ba724 authored about 6 years ago by Katie Holly <[email protected]>
Randomize cookies for each item instead for the entire pipeline runtime

0a77333b3ac74c94abe44a65d263c223c829b0e3 authored about 6 years ago by Katie Holly <[email protected]>
Fix cookies, add cookie check script

ebf31daed7547654f1221d48bee7783ff0e504ce authored about 6 years ago by Katie Holly <[email protected]>
Add import json

32fef38b7e33c708e02488ee6713034b3df28944 authored about 6 years ago by Katie Holly <[email protected]>
Add more cookies, nom nom

f648668a5f68c1081d6848a59e60be97af0129f0 authored about 6 years ago by Katie Holly <[email protected]>
Add multi cookie function

7c278aeb44e1e6a5090dc8a89126c736be05a243 authored about 6 years ago by Katie Holly <[email protected]>
Update to 20181217.02

a7bf5989698b2844d1110c9bc642476bc90e9888 authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #71 from scrottie/master

cookies again because again we did not turn safe mode off

487270cd411771662e48c0e66afcf447acad7cca authored about 6 years ago by kiska3 <[email protected]>
cookies again because again we did not turn safe mode off

e5969b52ba3c54980eadf0b4c1e1f4f495c9e83b authored about 6 years ago by Scott <[email protected]>
Prevent /embed URLs also from posts with no title

9e387e7b6df48b6e816076e955b050af609ef51a authored about 6 years ago by marked <[email protected]>
Update to 20181217.01

2e6036b39f400d37780427898cefe040aeb4751f authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #69 from scrottie/master

new cookies until we have cookie shuffling online

910c75dc67481e7f59eb76bcb7c02237311aa78a authored about 6 years ago by kiska3 <[email protected]>
new cookies

de8db4785249e2d5a69e80e9fb4e87af94f0029b authored about 6 years ago by Scott <[email protected]>
add comment explaining why we're matching /: template urls in allowed check

2ee72a23d9130a2b61898e4286699d5eb93f0ed0 authored about 6 years ago by Katie Holly <[email protected]>
Make the code look cleaner

bd491a346812500e20f03a511af4b68b3e481c3e authored about 6 years ago by Katie Holly <[email protected]>
bump version

d77e592da6310c1d3e3595ecefb4124569aa8719 authored about 6 years ago by Katie Holly <[email protected]>
Exclude /: template urls early in get_urls already by adding it to allowed() check

670fe8b4c855f3d8b3a4d4eade77d40f98fd7ab0 authored about 6 years ago by Katie Holly <[email protected]>
Merge pull request #65 from hook54321/patch-1

Updated first question

30f5039ab3e51a33d8c5901529c5f606930f7ad9 authored about 6 years ago by km09 <[email protected]>
Updated first question

3abf5b3e673baf0af7f27f561c7a1a7007282d91 authored about 6 years ago by hook <[email protected]>
Update to 20181216.11

Correct UA

eb119640203de92a8641bd927753259e946fa1de authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #61 from drdaxxy/patch-15

Fix cookie, again

89b3201a370f9b4d750cf99c210f5fa47550efde authored about 6 years ago by km09 <[email protected]>
Fix cookie, again

d2cc6e66277fe4661e55a7d6f3c4066900b2b316 authored about 6 years ago by Niklas K <[email protected]>
Update UA

713ff9e290c07178a61326475233c1308afb664f authored about 6 years ago by km09 <[email protected]>
Update cookie

9cf3085e84a8355f9e80bc8e46dada52b3de828b authored about 6 years ago by km09 <[email protected]>
Merge pull request #56 from ArchiveTeam/proposedUA

Proposed ua

b4e18daf3f5a62f7261dab4e79da276329e87dbc authored about 6 years ago by km09 <[email protected]>
Merge pull request #60 from drdaxxy/fix_ban_regex

fix ban regex escape, bump version

bf8174f0705cf83d7315ef101ffcf1f0544ba225 authored about 6 years ago by km09 <[email protected]>
fix ban regex escape, bump version

740668ae35390d094fb7b4728fa43d2524243d33 authored about 6 years ago by Niklas K <[email protected]>
Merge pull request #57 from sfan5/patch-1

Add setup instructions for Alpine

d7a19c993bdd4784bc545f572f5a3c3afa1c54bc authored about 6 years ago by km09 <[email protected]>
Merge pull request #58 from nemobis/patch-1

Add web-based import/export options

3aea23c377e27a398c67d500729ef5eadeb88b3d authored about 6 years ago by km09 <[email protected]>
Merge pull request #59 from drdaxxy/bail_on_bad_cookies

bail on GDPR/safe mode page during a crawl

6bd23ae24081109b9a2d3917321a02416eefc215 authored about 6 years ago by km09 <[email protected]>
bail on GDPR/safe mode page during a crawl

080b59787131c908ad664e52dbe032305ceb8fbf authored about 6 years ago by Niklas K <[email protected]>
Add web-based import/export options

Also, make punctuation consistent and remove short URL.

2dbafe26b33b3fd73ff1560085dc2d216d8704c3 authored about 6 years ago by nemobis <[email protected]>
Add setup instructions for Alpine

d84a96c3107cf33b1ae9e89aa97d3fc306225717 authored about 6 years ago by sfan5 <[email protected]>
Merge pull request #54 from drdaxxy/split_media

Media URL extraction

de106cd603b524a10f0e61ad116f9d7e5b991027 authored about 6 years ago by kiska3 <[email protected]>
Update pipeline.py

7925cc4fb6dbbe51c0edf58f769c1182ae465b63 authored about 6 years ago by kiska3 <[email protected]>
Merge pull request #55 from Fusl/handle429

Handle 429 errors like 403

07aa12268e63bf08dc1e1cdb98ef3752aac15c66 authored about 6 years ago by kiska3 <[email protected]>
bump version

59660c0b73501921b2d318b468aa83db1da9f43d authored about 6 years ago by Katie Holly <[email protected]>
Handle 429 errors like 403

5abccc941ddb24c71d6aeaf9a375c7f900c404a0 authored about 6 years ago by Katie Holly <[email protected]>
basic (untested) media URL extraction

9d2a0010d06239438956e3ef9fcec0b4cdb36670 authored about 6 years ago by Niklas K <[email protected]>
Update to 20181216.04

bcbab5414d219b2fc415f71342202e6aabc6244e authored about 6 years ago by kiska3 <[email protected]>