github.com/ArchiveTeam/IA.BAK commits | Ecosyste.ms: OpenCollective

Start fresh, SHARD1 only

e1cb341c2d184a94ce501ab6abdd7839bf7da06d authored over 4 years ago by km09 <[email protected]>

Revert "we only need to sync once in maint mode"

This reverts commit 1eb0ae10785d36e80558dae812e117f9b087c05f.

a84a124e3d72f5d87bbb564b63fdd9f39eb4a950 authored over 7 years ago by Daniel Brooks <[email protected]>

trigger an fsck if it's been 7 or more days since the last one

The bug is that '-mtime 7' only matches files that are 7 days old, not
7 days or older.

8a5096f80d5f2e12cdb47c6c1f74cc4fb067ff40 authored over 7 years ago by Daniel Brooks <[email protected]>

Merge remote-tracking branch 'origin/master'

e878a3282c1b7d44540e9467a2a899cddcb047f5 authored almost 8 years ago by Daniel Brooks <[email protected]>

update install-git-annex to cope with changes to the .info file that reports the latest available version

5940a37b063a4e707b6fe37b6f62b2aeb47bc2a7 authored almost 8 years ago by Daniel Brooks <[email protected]>

update .info file parser to work with new file format

e8fa680496fff6808921faa5db8bd3cbf4144917 authored almost 8 years ago by Joey Hess <[email protected]>

only update fsck.log weekly

The cron job runs more often than weekly, in order to find a time when
the disk is plugged in, c...

d37238e210912f89a2aca48775d981c9fa5e8a6b authored almost 8 years ago by Joey Hess <[email protected]>

we only need to sync once in maint mode

1eb0ae10785d36e80558dae812e117f9b087c05f authored almost 8 years ago by Daniel Brooks <[email protected]>

these shards seem to have hit their peak; set them to maint mode

4772c9c81f496054f78dcc341599d7a40c688c2e authored almost 8 years ago by Daniel Brooks <[email protected]>

EVEN MOAR ARCHIVEBOT

f1bba684115409e67987e283fe6a7f6261fcffa5 authored almost 8 years ago by HarryC145 <[email protected]>

MOAR ARCHIVEBOT

05a7d698d2762de1cae4809e27eb3bc7125b4482 authored almost 8 years ago by HarryC145 <[email protected]>

Merge pull request #55 from habi/patch-1

Corrected typo

5fce6bbd32683c3c7278f0475c36d357756c805c authored about 8 years ago by Daniel Brooks <[email protected]>

Corrected typo

18f8035cc53c3de70358fd2b25044797bddaa3c8 authored about 8 years ago by David Haberthür <[email protected]>

added 2 more shards of archivebot

d05e6c86bd8ab61ff3aee3ab72ba62f3e681fc0c authored about 8 years ago by HarryC145 <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/IA.BAK

9666b9d513378b866e6b06687a0967c7ad3d4b52 authored about 8 years ago by Daniel Brooks <[email protected]>

simplify the download code so that it only checks for available disk space

It might ultimately be nice to check for other conditions so that we
come up for air more freque...

39e9d16c238f0970cea89ca497796e71149673b6 authored about 8 years ago by Daniel Brooks <[email protected]>

toggle some shards

2e5669132cf23b47d4cb2bd54b433c8c39da7d62 authored about 8 years ago by Daniel Brooks <[email protected]>

gotta love shell scripting

58fe5be454070a70390780501518f0465a563a33 authored about 8 years ago by Daniel Brooks <[email protected]>

take a stab at the system requirements

e53942aca40fa7c363631dac1c8211f1e2fa360e authored about 8 years ago by Daniel Brooks <[email protected]>

Shards 17-19 -> active

4be99452ca629c0e916ee71604a8a64861bc7880 authored about 8 years ago by kurtmclester <[email protected]>

SHARD9 to maint, attempt 2

65079e4a87a5e1e1314fd38bdb87e6517ba46935 authored about 8 years ago by kurtmclester <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/IA.BAK

a7dfb4aec9fa2e9e6ea0abfdac040cedafff44f2 authored about 8 years ago by Daniel Brooks <[email protected]>

always queue at least one file, even if that file is rediculously gigantic

8564a894c26268d37886be0cba52ece13132df6a authored about 8 years ago by Daniel Brooks <[email protected]>

SHARD9 back to active. mainly because I've somehow managed to break my downloads

f6bca906e4b1dac1137b21a2526016db9aea6ca8 authored about 8 years ago by kurtmclester <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/IA.BAK

1020e7fe48dc90fe2928a9b574d286b7b90959e4 authored about 8 years ago by Daniel Brooks <[email protected]>

rewrite stillhavespace because I had accidentally returned the inverse

This has lead to iabak clients exiting early. Also rewriting it
because I can factor out the thi...

5935e05fa8234fc312b69a99ea1ee62436615352 authored about 8 years ago by Daniel Brooks <[email protected]>

add more information to the FAQ

84cc3c4625ef1f8a0e754b0804fba30748526c97 authored about 8 years ago by Daniel Brooks <[email protected]>

SHARD9 to maint

75033e6a202bcd7306ee499912cec1e0882cc2ef authored about 8 years ago by kurtmclester <[email protected]>

Shards 17,18,19 to rserve - now 9 active

d7f366061a02b6e77f9daf6bf4a1d94270bdb9fa authored about 8 years ago by kurtmclester <[email protected]>

SHARD11 to active

49bde987a441a226a51057c8d49226a8d37a0e62 authored about 8 years ago by kurtmclester <[email protected]>

add 1 more shard

687314b9618885557d17fe81794e190d9a6978bf authored about 8 years ago by HarryC145 <[email protected]>

added 2 new shards of archivebot

bbee9104cf9838aff8fd028e6720b33b7bb37dc9 authored about 8 years ago by HarryC145 <[email protected]>

some minor tweaks to the README

1d31c10351459125d071167d01ecc76a906f54b4 authored about 8 years ago by Daniel Brooks <[email protected]>

mention BSD and NFS in the README file

af62a8696ffd760ffaf65fcce00707b9c5672d7b authored about 8 years ago by Daniel Brooks <[email protected]>

use ANNEXGETOPTS when resuming incomplete downloads as well

bd707a82af921f0959c6947807458d7e4a0544fd authored about 8 years ago by Daniel Brooks <[email protected]>

fix a typo that broke ANNEXGETOPTS

ccf95c376c3305a1bfcc629939d05dab88652ed9 authored about 8 years ago by Daniel Brooks <[email protected]>

try to squash stupid errors when there is no annex.diskreserve setting

because you can never get all of those cases ahead of time

0b3c078684ceb6e9f4d29ba117778c09a52ae0d7 authored about 8 years ago by Daniel Brooks <[email protected]>

try not to download more than the available disk space

or for more than 8 hours. This is done by keeping track of the sizes
of the files or items that ...

169aabaa498a7247e8068fb925cee7d35fbed025 authored about 8 years ago by Daniel Brooks <[email protected]>

handle the case of multiple remotes when updating iabak by specifying a branch name

c866a9af3cadf114be170df9e503def20d32737d authored about 8 years ago by Daniel Brooks <[email protected]>

Fix shard15 -> shard16

c463b2f69eb2a0ae3302b7bc76783d78b6af9903 authored about 8 years ago by BuildTools <[email protected]>

Update repolist

9848d7de5a7fbc5802c09c53821913557c01d1a4 authored about 8 years ago by HarryC145 <[email protected]>

add 15

2722cffb804110db647144205565c7226a7fc994 authored about 8 years ago by HarryC145 <[email protected]>

added shard14, first archivebot shard

93c0bf4c06d51fc7e41c6cb58ce51547027930b2 authored about 8 years ago by HarryC145 <[email protected]>

perhaps we should make this file simpler

42f88362ec44da71c78ae37e70fa2f5c8baaf359 authored about 8 years ago by Daniel Brooks <[email protected]>

db48x meant to add shard12, but copied the shard11 line instead, fix it

37480d8246f2644b16f6e62a5fb842ee98f147eb authored about 8 years ago by Joey Hess <[email protected]>

shard12 is a go

461202b540f91ddbe2d28086c222c7e9cfb09317 authored about 8 years ago by Daniel Brooks <[email protected]>

Merge pull request #45 from JesseWeinstein/fix_confirm

Avoiding setting up the trap before the `read confirm` line

6f1655f5b51734caef793a56e2e3494b8a0872ed authored over 8 years ago by Daniel Brooks <[email protected]>

Avoiding setting up the trap before the `read confirm` line

feced90bcff603a4ce721f7388c109a10df65019 authored over 8 years ago by Jesse Weinstein <[email protected]>

fix some mistakes found by xperia64, JesseWeinstein and myself.

My testing of this must not have been very good. Thanks, me-in-the-past.

Fixes #44

1776527ccd27903edf7d7e2397a65bf21a39ffbc authored over 8 years ago by Daniel Brooks <[email protected]>

Merge pull request #42 from kyrias/bytesFromSize-fix

Move bytesFromSize to before it's used

69323f36167e853b37fabe162edd79030c8491f0 authored over 8 years ago by Daniel Brooks <[email protected]>

Move bytesFromSize to before it's used

Fixes #41.

Signed-off-by: Johannes Löthberg <[email protected]>

06c22a9341e311ce03d240f3c893b427093f4588 authored over 8 years ago by Johannes Löthberg <[email protected]>

add 10 (active) and 11 (reserve)

e6091986e08eaa88a256f46bc8caef0d6c5bf774 authored about 9 years ago by Joey Hess <[email protected]>

set 3 and 4 back to active due to expires

886a70d75a8cd948f09773fc5d9ebb9916f3af60 authored over 9 years ago by Joey Hess <[email protected]>

7 and 8 to maint; activate 9 (10 needed!)

5b9340003383ce4172e89926375e81e3e7122a57 authored over 9 years ago by Joey Hess <[email protected]>

print an error message in some cases where we can run out of disk, etc

Of course there are plenty of less likely places for this to happen,
but this is a start. Partly...

045b4563c15ddc64b86cdbc345cf4e782464813d authored over 9 years ago by Daniel Brooks <[email protected]>

fix incorrect variable name in checkoutshard

7631ac8d47c8f1b4f720e0d3e945e86a59f76dfd authored over 9 years ago by Daniel Brooks <[email protected]>

explicitly set permissions on the key file after generating it

fixes #35

fbc5ce46fab061c05a778c187d9ba8b484e61a26 authored over 9 years ago by Daniel Brooks <[email protected]>

Merge branch 'shared-locks'

Fixes #32

7cef481beb5bc7cc042f4d2f949ebf81ddfc753f authored over 9 years ago by Daniel Brooks <[email protected]>

add missing locks.sh

fixes #32

5e88fc936e0c30589fa2078fb46df67d9649a446 authored over 9 years ago by Daniel Brooks <[email protected]>

Merge branch 'always-reserve'

4496eb86c79acdeb16d50c529d8c4d3f61e03e05 authored over 9 years ago by Daniel Brooks <[email protected]>

Merge branch 'replace-numfmt' into always-reserve

883b4d6e2db0297dd022bd922de1e055b969a672 authored over 9 years ago by Daniel Brooks <[email protected]>

always reserve at least 100M of space during setup

72153f54edc2a07547d364831d62301fa445c325 authored over 9 years ago by Daniel Brooks <[email protected]>

shard3 is back to 100%; return to maint

18dce4356c294f112224f2316e52cd361a1b8a9b authored over 9 years ago by Joey Hess <[email protected]>

handle numbers with decimal points slightly better

ce63d5b4e7c864e3e81533d12ed2a400e767a99e authored over 9 years ago by Daniel Brooks <[email protected]>

replace numfmt with a shell function

numfmt isn't always available (macs), and we shouldn't completely fail
to process things like th...

68cacc3d7eab687e234f43d3876e6898ac31005c authored over 9 years ago by Daniel Brooks <[email protected]>

shard3 fixed, reactivate

e30a1030fa248aa559ecf89c2c7a4034320d5d90 authored over 9 years ago by Joey Hess <[email protected]>

SHARD3 is broken somehow; prevent clients from trying to use it

ee12b01515b3ce7d82c0f6cce398d3aa0691cc17 authored over 9 years ago by Daniel Brooks <[email protected]>

new git-annex version released; enable incomplete download resumes and disable use of daily builds

5f030460523ecee990fc7318410baf0838dbd479 authored over 9 years ago by Joey Hess <[email protected]>

add shard9 in reserve, with more prelinger, rare asian books, and google groups

7b3d3584220d5582df25bf6cd7962f268af31913 authored over 9 years ago by Joey Hess <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/IA.BAK

cafeca93f555d0687cc33b16b164084c05368c78 authored over 9 years ago by Joey Hess <[email protected]>

add commented out git annex get --incomplete, to resume interrupted transfers

This is commented out until a newer git-annex with the feature is
available.

Might be better to...

36d3eff4af848e72f1fc03fa16e6c55c3182a855 authored over 9 years ago by Joey Hess <[email protected]>

Merge pull request #34 from billdueber/master

Fix spelling in README.me

f3521aa6b930d7b5a49feebfa2f1ef54d366b949 authored over 9 years ago by Daniel Brooks <[email protected]>

Update README.me

"Adjust to suit" instead of "Adjust to suite"

418db26556136a1737bc19cca650706491b4c82e authored over 9 years ago by Bill Dueber <[email protected]>

set shard3 to active to deal with expires

9e32d9ad68bb96617cd0b689f45b19bf58ff07b2 authored over 9 years ago by Joey Hess <[email protected]>

git pull in randomshard to make sure it's using the current shard list

6adb0bac1dbb9671d25e5c039bba0f819cb9b3af authored over 9 years ago by Joey Hess <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/IA.BAK

Conflicts:
iabak-helper

15541786f8cffb8b07d91ed26948826bc431946a authored over 9 years ago by Daniel Brooks <[email protected]>

temporarily switch to git-annex prerelease, to get ssh-options without sshcaching fix

01ed7b31ab680a536712bdee5970e39350388278 authored over 9 years ago by Joey Hess <[email protected]>

display version of git-annex that iabak is using

ad49b76f162acb1e5586f6f035ac8ca08da9f424 authored over 9 years ago by Joey Hess <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/IA.BAK

f964aacf107c3272f1ee13d6541b85055ab9d9ba authored over 9 years ago by Joey Hess <[email protected]>

shard6 is 99% done; set to maint as it has enough clients to finish soon

5563cae520e0f3dcc34a7e433570aee9a544b554 authored over 9 years ago by Joey Hess <[email protected]>

use shared locks around all git commands

This prevents the helper and the cronjob from removing git-annex (to
install a newer one) while ...

db62b2275f249d2252c9866df3e3596449214d60 authored over 9 years ago by Daniel Brooks <[email protected]>

skip install-fsck-service if its already a service

d55fb9d550ec5aa56129064f191ee72bd4fcac6f authored over 9 years ago by Daniel Brooks <[email protected]>

exponential backoff when registration is failing for some reason, to avoid floods

7710b7fec380f40013ffb254a24b04b94cc18d94 authored over 9 years ago by Joey Hess <[email protected]>

add shard8

8ed92a98e8b38ebcfa1234028a5f0c557f549d68 authored over 9 years ago by Joey Hess <[email protected]>

update message about concurrency

657df051b3bab20152ea8da34e06e20e130582a8 authored over 9 years ago by Joey Hess <[email protected]>

activate shard7 as shard6 probably has enough clients to finish it

76b363cf4209ae0c21ea8995ab18f3a3979327d3 authored over 9 years ago by Joey Hess <[email protected]>

fix rm to delete pid file

0c1ad71479f49c8cc91f24340d22e1a6ad147ad3 authored over 9 years ago by Joey Hess <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/IA.BAK

3cce74a6094fa3e63e19c37f8df49ba7a2e81fb0 authored over 9 years ago by Joey Hess <[email protected]>

if git-annex sync fails, don't exit, just retry later

640b540efcace2662e428acf2a0f34f787c8be96 authored over 9 years ago by Joey Hess <[email protected]>

Merge pull request #30 from zerodogg/systemd-cron-fallback

Fall back to a cron job if systemd fails

e59cacacce889b2d174c522a4184c9cc8d1009ff authored over 9 years ago by Joey Hess <[email protected]>

Fall back to a cron job if systemd fails

60d3305cb0d1911115b5d008bb718a1027c71af8 authored over 9 years ago by Eskild Hustvedt <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/IA.BAK

f763071e7b659430efef734c9e51d2b2d38842a6 authored over 9 years ago by Joey Hess <[email protected]>

fix installation of fsck service in initial run of iabak

Don't do it inside setup, since it's already cd'd to a shard there.
Do it earlier. Closes https:...

da2e022beee266e8038c66bff1d81f179dec72af authored over 9 years ago by Joey Hess <[email protected]>

avoid using $prevshard if its shard doesn't exist

fb17db8f74e50524b6cc7de369f7afa8ebed4eb5 authored over 9 years ago by Joey Hess <[email protected]>

Merge pull request #29 from msasinski/master

Update README.md

781357fa41306b98b3b03bdbd745fe8a094d8d8e authored over 9 years ago by Joey Hess <[email protected]>

Merge pull request #27 from zerodogg/master

Added support for non-i386 architectures (including Raspberry Pi)

094daf2175af4ae2d1660ef6563083d0c6684c04 authored over 9 years ago by Joey Hess <[email protected]>

Update README.md

annex.web-options = sign removed

63bdf179ca561f683ab6ddd7879466c45eca9c7d authored over 9 years ago by Mariusz Sasinski <[email protected]>

Added support for non-i386 architectures

Uses the amd64 build in x86_64 now, and adds support for armel (including Raspberry Pi)

62882cc7836bc76cc0ecf2d6a59160a7f5374a96 authored over 9 years ago by Eskild Hustvedt <[email protected]>

Merge pull request #24 from lhoBas/patch-1

Small tweaks to README markup for GitHub viewing

03aaf6cc748ef8232233a193089b21dfe3f324cb authored over 9 years ago by Daniel Brooks <[email protected]>

Small tweaks to README markup for GitHub viewing

5e5d46e62262db42a011204478feb25e1dd93ce6 authored over 9 years ago by lhoBas <[email protected]>