Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/mwmbl/crawler-script

docs: more explanation

thiswillbeyourgithub opened this issue 6 months ago

main.py ValueError No URLs in batch

thiswillbeyourgithub opened this issue 6 months ago

docs: readme should mention a docker compose is available

thiswillbeyourgithub opened this issue 6 months ago

Allow specifying unique config for each process

daoudclarke opened this pull request 8 months ago

Fix docker file

daoudclarke opened this pull request about 1 year ago

Add Mirror to Codeberg workflow

diagonalo opened this pull request about 1 year ago

[Feature] Adjustable requests limit per website

EchedeyLR opened this issue over 1 year ago

--site option added

gonzoknows opened this pull request almost 2 years ago

[Feature] Add support for sitemaps

EchedeyLR opened this issue about 2 years ago

Allow crawling specific URLs

daoudclarke opened this pull request about 2 years ago

Feature/dockerize

EchedeyLR opened this pull request about 2 years ago

Unable to decode robots file - 'utf-8' codec can't decode byte 0xe9

EchedeyLR opened this issue about 2 years ago