Archive Team issues | Ecosyste.ms: OpenCollective

server-side script should periodically look for items that have gone dark and use git annex rmurl to mark them as unavailable from the web

github.com/ArchiveTeam/IA.BAK - db48x opened this issue about 8 years ago

hash *_files.xml files when creating new shards; assemble and commit this information for existing shards

github.com/ArchiveTeam/IA.BAK - db48x opened this issue about 8 years ago

idea: stats page showing an overview of the shards

github.com/ArchiveTeam/IA.BAK - db48x opened this issue about 8 years ago

connection stats aren't getting updated

github.com/ArchiveTeam/IA.BAK - db48x opened this issue about 8 years ago

adding nzherald to list

github.com/ArchiveTeam/NewsGrabber - sstollenwerk opened this pull request about 8 years ago

Consider using env to find bash / perl for freebsd

github.com/ArchiveTeam/IA.BAK - stephen304 opened this issue about 8 years ago

Warrior appears to be running but web UI doesn't respond to clicks

github.com/ArchiveTeam/seesaw-kit - panicsteve opened this issue about 8 years ago

wget-lua not successfull build

github.com/ArchiveTeam/panoramio-grab - svrnwnsch opened this issue about 8 years ago

Define vine video document format

github.com/ArchiveTeam/vine-multi-ingress - hannahwhy opened this issue about 8 years ago

Add vine video URLs from the vine-discovery Warrior project

github.com/ArchiveTeam/vine-multi-ingress - hannahwhy opened this issue about 8 years ago

Add vine URLs from the @archiveteam Twitter listener

github.com/ArchiveTeam/vine-multi-ingress - hannahwhy opened this issue about 8 years ago

Add vine URLs from Twitter search results

github.com/ArchiveTeam/vine-multi-ingress - hannahwhy opened this issue about 8 years ago

Add created_at timestamp to each collected tweet

github.com/ArchiveTeam/vine-twitter-listener - hannahwhy opened this issue about 8 years ago

harrycross.me doesn't work

github.com/ArchiveTeam/NewsGrabber - rudolphos opened this issue about 8 years ago

When we get Vine URLs from a tweet, provide some feedback

github.com/ArchiveTeam/vine-twitter-listener - hannahwhy opened this issue about 8 years ago

If the plugin script is not valid print the error and exit

github.com/ArchiveTeam/wpull - tylerknott opened this issue about 8 years ago

README example needs -p 8001:8001

github.com/ArchiveTeam/warrior-dockerfile - borisovg opened this issue about 8 years ago

ImportError: No module named 'dns.resolver'

github.com/ArchiveTeam/grab-site - ivan opened this issue about 8 years ago

Add techtimes, venturebeat

github.com/ArchiveTeam/NewsGrabber - km09 opened this pull request about 8 years ago

update scanning of ftp.apple.asimov.net

github.com/ArchiveTeam/ftp-queue - felipesanches opened this pull request over 8 years ago

What's the purpose of trying to fetch non-existing dirs and files ?

github.com/ArchiveTeam/ftp-queue - felipesanches opened this issue over 8 years ago

print usage message

github.com/ArchiveTeam/ftp-queue - felipesanches opened this pull request over 8 years ago

added cloudflare bypass

github.com/ArchiveTeam/dnshistory-grab - Medowar opened this pull request over 8 years ago

Add Dockerfile to simplify installation

github.com/ArchiveTeam/grab-site - notslang opened this pull request over 8 years ago

Update README.md

github.com/ArchiveTeam/standalone-readme-template - MWestfall opened this pull request over 8 years ago

Fix AUR link

github.com/ArchiveTeam/standalone-readme-template - mutoso opened this pull request over 8 years ago

Add new service descriptions; fix filename typo

github.com/ArchiveTeam/NewsGrabber - ethus3h opened this pull request over 8 years ago

Add new service descriptions; fix filename typo

github.com/ArchiveTeam/NewsGrabber - ethus3h opened this pull request over 8 years ago

[FIXED] Changes for handling users whose profile page returns 500

github.com/ArchiveTeam/myvip-grab - bzc6p opened this pull request over 8 years ago

Changes for handling users whose profile page returns 500

github.com/ArchiveTeam/myvip-grab - bzc6p opened this pull request over 8 years ago

0.7 sec sleep time between requests

github.com/ArchiveTeam/yahooanswers-grab - bzc6p opened this pull request over 8 years ago

0.5 sleep time between requests

github.com/ArchiveTeam/yahooanswers-grab - bzc6p opened this pull request over 8 years ago

For ubuntu, it is also needed to install flex

github.com/ArchiveTeam/orkut-grab - tiagofassoni opened this issue over 8 years ago

Add service descriptions: World News Network, Voltaire Network

github.com/ArchiveTeam/NewsGrabber - ethus3h opened this pull request over 8 years ago

Add danish news sites

github.com/ArchiveTeam/NewsGrabber - lucasRolff opened this pull request over 8 years ago

While processing a shard, git-annex prints out things that the IA.BAK user won't necessarily understand

github.com/ArchiveTeam/IA.BAK - db48x opened this issue over 8 years ago

register-helper.pl can fail, and this failure isn't handled well

github.com/ArchiveTeam/IA.BAK - db48x opened this issue over 8 years ago

added 1 second sleep

github.com/ArchiveTeam/myvip-grab - Medowar opened this pull request over 8 years ago

Update worker_script.py

github.com/ArchiveTeam/NewsGrabber - HarryC145 opened this pull request over 8 years ago

HTTP Error

github.com/ArchiveTeam/twitchtv-index - soniconda opened this issue over 8 years ago

Ubuntu 16.04 gs-venv

github.com/ArchiveTeam/NewsGrabber - HarryC145 opened this issue over 8 years ago

wpull 2.0 crawls finish with RuntimeError 'Event loop is closed'

github.com/ArchiveTeam/wpull - ivan opened this issue over 8 years ago

Fix typo

github.com/ArchiveTeam/warrior-dockerfile - nemobis opened this pull request over 8 years ago

Avoiding setting up the trap before the `read confirm` line

github.com/ArchiveTeam/IA.BAK - JesseWeinstein opened this pull request over 8 years ago

Fix closing conditional bracket

github.com/ArchiveTeam/IA.BAK - xperia64 opened this pull request over 8 years ago

Use system git-annex copy if available

github.com/ArchiveTeam/IA.BAK - kyrias opened this pull request over 8 years ago

Move bytesFromSize to before it's used

github.com/ArchiveTeam/IA.BAK - kyrias opened this pull request over 8 years ago

Issue with configuration disk space

github.com/ArchiveTeam/IA.BAK - HarryC145 opened this issue over 8 years ago

edited install instructions to add other bits required.

github.com/ArchiveTeam/olympe-grab - HarryC145 opened this pull request over 8 years ago

Is this python27 or python3.4+?

github.com/ArchiveTeam/NewsGrabber - luckcolors opened this issue over 8 years ago

What are the dependencies required to run get-wget-lua.sh?

github.com/ArchiveTeam/arto-grab - mattrl opened this issue over 8 years ago

Ramp up sleep time to 5 sec

github.com/ArchiveTeam/livejournal-discovery - bzc6p opened this pull request over 8 years ago

Point to a newer version of wget-lua

github.com/ArchiveTeam/arto-grab - ghost opened this issue over 8 years ago

BE sites fixed

github.com/ArchiveTeam/NewsGrabber - sollidius opened this pull request over 8 years ago

BE sites

github.com/ArchiveTeam/NewsGrabber - sollidius opened this pull request over 8 years ago

HLN.be

github.com/ArchiveTeam/NewsGrabber - sollidius opened this pull request over 8 years ago

Switch from dnspython3 to dnspython

github.com/ArchiveTeam/wpull - asergi opened this pull request over 8 years ago

Special characters in name

github.com/ArchiveTeam/gamemaker-sandbox-items - Yambam opened this issue over 8 years ago

Allow starting crawls directly from the dashboard

github.com/ArchiveTeam/grab-site - brandongalbraith opened this issue over 8 years ago

Conerror wget fail

github.com/ArchiveTeam/arto-grab - danielsauceda opened this issue over 8 years ago

If a URL contains a %s the dashboard can't interact with it

github.com/ArchiveTeam/ArchiveBot - tylerknott opened this issue over 8 years ago

Update README.md

github.com/ArchiveTeam/gamefront-grab - HarryC145 opened this pull request over 8 years ago

And even more wikidata links

github.com/ArchiveTeam/NewsGrabber - JesseWeinstein opened this pull request over 8 years ago

New News-Sites suggestions

github.com/ArchiveTeam/NewsGrabber - Medowar opened this issue over 8 years ago

rsync concurrency limit

github.com/ArchiveTeam/NewsGrabber - HarryC145 opened this issue over 8 years ago

Sleep one hour when banned

github.com/ArchiveTeam/livejournal-discovery - bzc6p opened this pull request over 8 years ago

Add a way to stop the script

github.com/ArchiveTeam/NewsGrabber - Medowar opened this pull request over 8 years ago

Fix performance issue with large item logs

github.com/ArchiveTeam/seesaw-kit - ariscop opened this pull request over 8 years ago

finds urls with html in them

github.com/ArchiveTeam/citeseerxpdf-grab - db48x opened this issue over 8 years ago

Option to only download from sites with HTTPS and/or images

github.com/ArchiveTeam/seesaw-kit - plonk264 opened this issue over 8 years ago

Username/Password option doesn't appear to work

github.com/ArchiveTeam/seesaw-kit - ariscop opened this issue over 8 years ago

Australian news websites

github.com/ArchiveTeam/NewsGrabber - rwoodpecker opened this issue over 8 years ago

Added missing services from the Alexa Top 40 News Sites