Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

Archive Team

We are going to rescue your shit
Collective - Host: opensource - https://opencollective.com/archiveteam - Website: https://archiveteam.org/ - Code: https://github.com/ArchiveTeam

Version 20230827.01. Use --secure-protocol=TLSv1_3.

github.com/ArchiveTeam/reddit-grab - e6b1602e31b7f8e1c337a6ab0c6037bba2c6d923 authored about 1 year ago by arkiver <[email protected]>
Fix --with-ssl option in Dockerfile.

github.com/ArchiveTeam/wget-lua - e237033799009a5b4ef594d8da02258ec770d279 authored about 1 year ago by arkiver <[email protected]>
Version 1.21.3-at.20230825.01. Build with libluajit-5.1 if available. Print Lua info. Install PCRE2 in Dockerfile.

github.com/ArchiveTeam/wget-lua - da43582bfda92c9f5848f7b1fc15edf78d9e1b41 authored about 1 year ago by arkiver <[email protected]>
Version 20230822.05. More --prefer-family check. Set default concurrency of 2 if not found.

github.com/ArchiveTeam/gfycat-grab - 2d90e943bd1d7e83785eef9ba334e4e5fe6c99f8 authored about 1 year ago by arkiver <[email protected]>
Version 20230822.04. Use --prefer-family=IPv6 by default.

github.com/ArchiveTeam/gfycat-grab - 576396b6305f1b05ae647d4234a15eb84a0115ae authored about 1 year ago by arkiver <[email protected]>
Version 20230822.03. Support PREFER_IPV4 and PREFER_IPV6 environment variables.

github.com/ArchiveTeam/gfycat-grab - a207c9f86b6baa466ce1c56148f26e1778292f14 authored about 1 year ago by arkiver <[email protected]>
Version 20230822.02. Abort item immediately in case of 404 on first API URL.

github.com/ArchiveTeam/gfycat-grab - cff1b616d73e43ce9f54df14884c8df6e660423f authored about 1 year ago by arkiver <[email protected]>
Version 20230822.01.

github.com/ArchiveTeam/gfycat-grab - 081d905d840ee8dd69cfc8a61962749031699a37 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #2 from imerr/imerr-patch-1

Prefer IPv4/6 command line flag

github.com/ArchiveTeam/gfycat-grab - 1ee46f7fc17388de8fac79077d7dbdaeed38ca37 authored about 1 year ago by arkiver <[email protected]>
Version 20230820.01. Ignore URLs containing ////.

github.com/ArchiveTeam/skyblog-grab - 8a0a6e3992ac2928706bc821439bf5696b970bd5 authored about 1 year ago by arkiver <[email protected]>
Prefer IPv4/6 command line flag

github.com/ArchiveTeam/gfycat-grab - 0f9d276a8f8aa6d1c8d31b7730fdddd74153c185 authored about 1 year ago by Robin Rolf <[email protected]>
Version 20230820.01. Do not get large mp4.

github.com/ArchiveTeam/gfycat-grab - 5133ce2d3b364ebf04341204c27e87f90aad43f3 authored about 1 year ago by arkiver <[email protected]>
Version 20230815.01. Do not get large mp4 if the mobile mp4 is available and there are less than 3000 views.

github.com/ArchiveTeam/gfycat-grab - c4effef04dfbea65ec8f419c537b7c316b736a0a authored about 1 year ago by arkiver <[email protected]>
Version 20230814.07. Implement 0.5*concurrency delay for gfycat.com and api.gfycat.com URL.

github.com/ArchiveTeam/gfycat-grab - 02b35e15bb71994e3b50c0c55d5183efa6048702 authored about 1 year ago by arkiver <[email protected]>
Version 20230814.06. Ignore the language versions.

github.com/ArchiveTeam/gfycat-grab - 5146336015303e1c52c2713102f7b2f59b5a3f40 authored about 1 year ago by arkiver <[email protected]>
Version 20230814.05. Do not get some versions in certain cases.

github.com/ArchiveTeam/gfycat-grab - 0a5ec6ff90983dc3907e87f1dc545fc16ec68b48 authored about 1 year ago by arkiver <[email protected]>
Version 20230814.04. Max tries 1. Do not retry on likely harmless 403, but abort for now.

github.com/ArchiveTeam/gfycat-grab - dedee546c62cc75dac44142010343bc8cee0355c authored about 1 year ago by arkiver <[email protected]>
Version 20230814.03. Fix backfeed.

github.com/ArchiveTeam/gfycat-grab - 8e4056ae0ab0c542d1df6d3afd9ab5cd00610c33 authored about 1 year ago by arkiver <[email protected]>
Version 20230814.02. General improvements.

github.com/ArchiveTeam/gfycat-grab - 7dc0dfff990c87b1a5937013c00017060f22fbcb authored about 1 year ago by arkiver <[email protected]>
Move 2019 files to 2019 directory.

github.com/ArchiveTeam/gfycat-items - 5cedf73370a199b106001c27a08017adc43fbe01 authored about 1 year ago by arkiver <[email protected]>
Version 20230814.01. Rewritten for 2023.

github.com/ArchiveTeam/gfycat-grab - 00b63bd97ab05aaafe90136f7cf59adc326f1218 authored about 1 year ago by arkiver <[email protected]>
Version 20230811.01.

github.com/ArchiveTeam/urls-grab - 7a5d6cd66f641dec3fff0ed9d93c6c19f3262544 authored about 1 year ago by arkiver <[email protected]>
Revert "Version 20230810.01. Enable getting special interest URLs."

This reverts commit a61bf4cb0674c3e3410e69ebe8c14a40e09580e3.

github.com/ArchiveTeam/urls-grab - 28aa4aae5c6ac376f88225f2db70851e7a8a9618 authored about 1 year ago by arkiver <[email protected]>
Version 20230810.01. Enable getting special interest URLs.

github.com/ArchiveTeam/urls-grab - a61bf4cb0674c3e3410e69ebe8c14a40e09580e3 authored about 1 year ago by arkiver <[email protected]>
Version 20230810.01. Fix nil problem for URLs queuing.

github.com/ArchiveTeam/skyblog-grab - 396930c1af93dab786c8e65c80aaa0a15605a387 authored about 1 year ago by arkiver <[email protected]>
Version 20230809.04. Allow up to 4 doubles of URL.

github.com/ArchiveTeam/skyblog-grab - bd6a2a084d4c6e079bfaf024db659a790ccbc17c authored about 1 year ago by arkiver <[email protected]>
Version 20230809.03. Correctly crawl non-blog items.

github.com/ArchiveTeam/skyblog-grab - 8045eee82635ea6e5fee4b6c0f481b4847d8e726 authored about 1 year ago by arkiver <[email protected]>
Version 20230809.02. Improved 404 handling. Fix bug causing abort on retry on status code < 400. Only check subdomain string on blog.

github.com/ArchiveTeam/skyblog-grab - abf700f04ce6a1649af9289dad4bc28ebb599200 authored about 1 year ago by arkiver <[email protected]>
Version 20230809.01. Get rid of --rotate-dns option.

github.com/ArchiveTeam/urls-grab - 0f8d2e87667bb7e7c1eda71b00636d4b03cf3a44 authored about 1 year ago by arkiver <[email protected]>
Version 20230809.01. Do not abort item on 404 on likely pagination URL treated as post.

github.com/ArchiveTeam/skyblog-grab - ce8a35cec5eee74eff592c78e5e03bb8a73e64e9 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.22. Prevent loop archiving URL with good status code.

github.com/ArchiveTeam/skyblog-grab - 345e81d09712a0225228a000b8bf422d09ccbece authored about 1 year ago by arkiver <[email protected]>
Version 20230807.21. Abort fast on 404 on article_*.html page.

github.com/ArchiveTeam/skyblog-grab - 5e7bcce7c0ad84576ee76849a9a791da04cab8c0 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.20. Do not accept status code 404.

github.com/ArchiveTeam/skyblog-grab - 06211c4021286e7289650581709d12dc84cacbcd authored about 1 year ago by arkiver <[email protected]>
Version 20230807.19. Connect timeout 1 second.

github.com/ArchiveTeam/skyblog-grab - e57345d20390d67801fa2ea0f26de709068f83db authored about 1 year ago by arkiver <[email protected]>
Version 20230807.18. Connect timeout 2 seconds. Multi item size 100.

github.com/ArchiveTeam/skyblog-grab - b1eacdec0725ceee9bc509818250d28eb4b4e7bb authored about 1 year ago by arkiver <[email protected]>
Version 20230807.03. More one time URLs.

github.com/ArchiveTeam/urls-grab - 913501289112fe48ee9889c6c617c1188c714667 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.17. Prevent assets from being queued to #//.

github.com/ArchiveTeam/skyblog-grab - 48fb115be828121a89e5e0ed5a17f54787b1758e authored about 1 year ago by arkiver <[email protected]>
Version 20230807.16. Do not rotate DNS (IPs). Connect timeout 5 seconds.

github.com/ArchiveTeam/skyblog-grab - aca8c69c860f7f7972b70bee4e9f1d57bd15d423 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.15. Connect timeout 0.3.

github.com/ArchiveTeam/skyblog-grab - 6bc5b6f54e9fee3333b648fa943086f4de579828 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.02. Update user-agents.

github.com/ArchiveTeam/urls-grab - 745ab956747a5d55067f69c86e031ffb51bcaebe authored about 1 year ago by arkiver <[email protected]>
Version 20230807.14. Update user-agents. Check status code on first URL of item. Reduce connect timeout to 0.2. Do not reject skyblog IPs.

github.com/ArchiveTeam/skyblog-grab - 1653585d0aae2c504ef1799928405116448a9458 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.13. Ignore _comments.xml URL. Relax check on if something is remix.

github.com/ArchiveTeam/skyblog-grab - ade01786ab1625768b6336c42345ececd7312fe8 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.12. Do not connect with the IPs that are unresponsive.

github.com/ArchiveTeam/skyblog-grab - 02966fc607e39af228f4f9c839413a5699ea8f99 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.11. Do not get _comments.xml URL if not explicitly mentioned.

github.com/ArchiveTeam/skyblog-grab - fa93a1d050979b1dc47a976ab483a1d8d1ec9e99 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.10. Ignore paginated comments from comments.xml URL.

github.com/ArchiveTeam/skyblog-grab - 0ecd35f7f4c7b1ae45bb199d821b42692b669f82 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.09. Ignore certain unimportant comments page.

github.com/ArchiveTeam/skyblog-grab - 66f2c782d0249a6a14472ff248d4a845db42b7c6 authored about 1 year ago by arkiver <[email protected]>
Version 20230807.08. Prevent loop. Ignore ADD_COMMENT URL.

github.com/ArchiveTeam/skyblog-grab - 888b9b5c66a6eeb7568b5c246c04f631cd6ab88e authored about 1 year ago by arkiver <[email protected]>
Version 20230807.07. Skip tag items.

github.com/ArchiveTeam/skyblog-grab - 980f29a0cff3c4e950cb22810b9f498ec2db654e authored about 1 year ago by arkiver <[email protected]>
Version 20230807.06. Ignore individual photo and video blog pages.

github.com/ArchiveTeam/skyblog-grab - 3e55beb5eb23b651f4e038d3e2561cd670a5d95d authored about 1 year ago by arkiver <[email protected]>
Version 20230807.05. Connect timeout 0.3. Support mg.skyrock.com for tracks.

github.com/ArchiveTeam/skyblog-grab - 4b7344b4298953aa5331dfc43c920ce34a4db51e authored about 1 year ago by arkiver <[email protected]>
Version 20230807.04. Ignore URLs. Ensure only HTTPS is archived.

github.com/ArchiveTeam/skyblog-grab - fb2defb1e6024764a6611e1606ab6ef07f875efa authored about 1 year ago by arkiver <[email protected]>
Version 20230807.03. Only 0.5 second connect timeout.

github.com/ArchiveTeam/skyblog-grab - 81e59c3cec3733ea2a8939507e8805e833472fbc authored about 1 year ago by arkiver <[email protected]>
Version 20230807.02. Timeout 1 second.

github.com/ArchiveTeam/skyblog-grab - f3c9d66a3eda38d46981d2c8b48b952ac973dd1a authored about 1 year ago by arkiver <[email protected]>
Version 20230807.01. Skip post URLs with action parameter is post is remix.

github.com/ArchiveTeam/skyblog-grab - 43f6dce3258e361d1c985aa6139adfa0fb85bd5d authored about 1 year ago by arkiver <[email protected]>
Version 20230807.01. Treat doubleclick.net as one time URL. Do not queue back all URLs found on pages of interest.

github.com/ArchiveTeam/urls-grab - 20b98a866b62d35fd7ca27c10dd2c077f3857a58 authored about 1 year ago by arkiver <[email protected]>
Version 20230806.04. Multi item size 30. Make this actually get items.

github.com/ArchiveTeam/skyblog-grab - d126f901860b78dca8cde04ddf0e4172e08e9714 authored about 1 year ago by arkiver <[email protected]>
Version 20230806.03. General improvements.

github.com/ArchiveTeam/skyblog-grab - 65914d4218619a8161a2243f928bc5ac54f04cc6 authored about 1 year ago by arkiver <[email protected]>
Version 20230806.02. Fix tracker. Remove \ from HTML.

github.com/ArchiveTeam/skyblog-grab - eb4ca0d7e8c3fc8bb1ae48e3a2762ddd7280b204 authored about 1 year ago by arkiver <[email protected]>
Version 20230806.01. Initial.

github.com/ArchiveTeam/skyblog-grab - 820c1debc444ade2446b2838004d0854391aa527 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #7 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/imgur-grab - 20b7ac4da00c17e12b099792281f53a0d83a2e13 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #8 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/telegram-grab - 7ac5d2c2ed7ea2242eb828489f494e6173f39419 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #10 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/youtube-grab - bdb62190538e345a1ebfec2a254c167dc6ef344b authored about 1 year ago by arkiver <[email protected]>
Merge pull request #1 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/periscope-grab - f63acd1b241af7373ef18a70a16308a1d1dcc544 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #10 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/github-grab - 3ac2d2a45bf99417a47cb9355e8bcc2f2f371b06 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #6 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/mediafire-grab - 627815097f8c7ef4181b8bf0d71383b3adc3c012 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #5 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/pastebin-grab - 506a32a77f7f9c50fc32e9c1f3767ef31d61d375 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #18 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/reddit-grab - d210e659676399a2989a23e3ea70327760807bd8 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #14 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/urls-grab - 364ff907c74bec1c1dc5e4aad7fa6f28b64e1306 authored about 1 year ago by arkiver <[email protected]>
Merge pull request #15 from imerr/master-1

Extra docker container params

github.com/ArchiveTeam/standalone-readme-template - 41ca4004a8d1912063a18e42b9fe824bb035109b authored about 1 year ago by arkiver <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/imgur-grab - e3fc8ec3bcd8f23fb94966f7c79de8410b06e132 authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/telegram-grab - 98390564ffdb6039a6529523944cb7c03725f1cc authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/youtube-grab - 1c49873579bbf14e52d5a7fa95bfa16e70ff0773 authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/periscope-grab - 386d1f4b8de5b533add006437cdff89ed5f89468 authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/github-grab - 7a1283f624027d94c0c08426db9bf2d800ec39ac authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/mediafire-grab - 78858841a482b17f047115cb520c949b8dd5175d authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/pastebin-grab - 1a3db49b3cacc3e6f235a02c14b562126674dcc0 authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/reddit-grab - b7feddc14708f2950c94f383d6250cbd8c118723 authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a ba...

github.com/ArchiveTeam/urls-grab - 7484928673406533146a9a990d3751764e6b41f4 authored about 1 year ago by Robin Rolf <[email protected]>
Extra docker container params

watchtower: `--include-restarting` also update if the container is in a crash loop due to a bad ...

github.com/ArchiveTeam/standalone-readme-template - c00abb6e7c07e1b6a3420150c3005c811fe00fa8 authored about 1 year ago by Robin Rolf <[email protected]>
Version 20230803.01. Queue URLs matching certain patterns to 'onetime' shard instead of main filter.

github.com/ArchiveTeam/urls-grab - a3776c6916c6750b19ca67cbeb7461ca1cbac309 authored about 1 year ago by arkiver <[email protected]>
Do not send x-archive-keep-old-version:1 header upon upload.

github.com/ArchiveTeam/archiveteam-megawarc-factory - e64552e1f57f31316aab496e1958767a863a393c authored about 1 year ago by arkiver <[email protected]>
Version 20230801.01. Queue URLs extracted from new sitemaps to separate tracker.

github.com/ArchiveTeam/urls-grab - 26c6ab229a7242ddab030ba3c2c969d0ded9dfe2 authored about 1 year ago by arkiver <[email protected]>
Version 20230727.03. In the Warrior, do not use GnuTLS compiled Wget-AT.

github.com/ArchiveTeam/reddit-grab - 29a6952edb10f44982cc29dc8c0f0493ff5bd2f1 authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. To compile with latest grab-base-df.

github.com/ArchiveTeam/warrior-dockerfile - 5122517d1637e0a8487355830cbf2b59fd0d94e4 authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. Use GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Remove old Wget files. Update README to latest.

github.com/ArchiveTeam/pastebin-grab - 034b11e7f4ad6e31ef4f1d5b305a8af6b3dfa4e8 authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. Use GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Remove old Wget files. Update README to latest.

github.com/ArchiveTeam/mediafire-grab - 307965228d341caf140e210ea5f65c0e2084a065 authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. Use GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Remove old Wget files. Update README to latest.

github.com/ArchiveTeam/github-grab - f7437a39934f79cf4da07fe3a5638a42ef4e155c authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. Use GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Remove old Wget files. Update README to latest.

github.com/ArchiveTeam/periscope-grab - aa6674459cdf055f1b2d9943fb4138680ad104f5 authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. Use GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Update README to latest.

github.com/ArchiveTeam/youtube-grab - 185bdb20ea66398490b23818aa6010513f6daddd authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. Use GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Remove old Wget files. Update README to latest.

github.com/ArchiveTeam/urls-grab - 14a7eab17ba9b7829f7418782e729f12a0f0149f authored about 1 year ago by arkiver <[email protected]>
Version 20230727.02. Only allow GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Remove old Wget files. Update README to latest.

github.com/ArchiveTeam/reddit-grab - 6e73452ec52e27eb7d8a267be17f4966968f95fb authored about 1 year ago by arkiver <[email protected]>
Version 20230727.02. Only allow GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Remove old Wget files. Update README to latest.

github.com/ArchiveTeam/telegram-grab - 58e85cc02351d76767108525e5ddc41b728c65ee authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. Use GNU Wget 1.21.3-at.20230623.01. Use Wget-AT option --reject-reserved-subnets. Remove old Wget files. Update README to latest.

github.com/ArchiveTeam/imgur-grab - 2b0be75a58167c9f67db8383b365ccface4a4eff authored about 1 year ago by arkiver <[email protected]>
Actually add requirements files.

github.com/ArchiveTeam/grab-base-df - 140870f4ff49a64bf3527d8765ed36b3829857da authored about 1 year ago by arkiver <[email protected]>
Version 20230725.01. Move python and lua packages to requirements files. Clean list of packages to be installed over apt.

github.com/ArchiveTeam/grab-base-df - a4bc4015ddcd667f716f69a458855173896fee84 authored about 1 year ago by arkiver <[email protected]>
Version 20230727.01. Use openssl instead of gnutls.

github.com/ArchiveTeam/reddit-grab - 288c9b731cfba0a2c41467d9c530ad4e8a268de3 authored about 1 year ago by arkiver <[email protected]>