Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/urls-grab

Archiving URLs (outlinks) from a variety of sources.
https://github.com/ArchiveTeam/urls-grab

Errors about not using Quad9

qados opened this issue about 2 months ago

Extra docker container params

imerr opened this pull request over 1 year ago

TikTok's webpages takes forever and end up failing the whole task

CreaZyp154 opened this issue over 2 years ago

Urlteam workers crash after this url format with error 124 "20=301 https://vt.tiktok.com/ZSeTTFu3m/"

kotenok2000 opened this issue almost 3 years ago

Problem with an item

kotenok2000 opened this issue almost 3 years ago

Revive NewsGrabber

Arkiver2 opened this issue over 3 years ago

Support periodically crawling RSS feeds

Arkiver2 opened this issue over 3 years ago

Add https://fundraise.cancerresearchuk.org/ so we stop ddosing them

ttq-ak opened this pull request over 3 years ago

Get all outlinks for URLs from certain domains.

Arkiver2 opened this issue over 3 years ago

Optionally use hash for deduplication with the Wayback Machine

Arkiver2 opened this issue over 3 years ago

Deduplicate files over certain size with the Wayback Machine

Arkiver2 opened this issue over 3 years ago

Allow URL to be requeued

Arkiver2 opened this issue over 3 years ago

Use wget-at installed in /usr/local/bin as well

SrihariThalla opened this pull request almost 4 years ago

report_bad_urls on Instagram login page

OrIdow6 opened this pull request almost 4 years ago

Add more params to strip

OrIdow6 opened this pull request about 4 years ago