github.com/ArchiveTeam/mobileme-grab commits | Ecosyste.ms: OpenCollective

Update version number.

bc5224027eb9f094f07b342b160f236e6b5632ea authored over 12 years ago by Alard <[email protected]>

Add accept/reject regexes. (DoubleJ)

cea85fb28156afeb1a84a2695d1b3c13e5ca040d authored over 12 years ago by Alard <[email protected]>

Download seesaw-s3.sh to a temporary file.

17caeb6bc3c277effab5dfc926c272760e467d3a authored over 12 years ago by Alard <[email protected]>

Set the DATA_DIR variable to use a different data/ dir.

de189bca7794c6241efbce47cd05a5979e0c43d5 authored over 12 years ago by Alard <[email protected]>

Seesaw now retries the rsync upload if it fails.

b83b6386090ecff14487f8b8a241b3dd57bf8acc authored almost 13 years ago by Alard <[email protected]>

Added seesaw-s3 scripts. (Ask before use.)

6f2edc5807b7e9a1c7c5bd9ef92170c892483fde authored almost 13 years ago by Alard <[email protected]>

Consistant usage of gibi- vs. giga-.

GNU df reports sizes using powers of 2 unless the -H or --si flags are given.

4fe961e262014b27d1c180d37b6dab7c7d42751a authored almost 13 years ago by yipdw <[email protected]>

Create directory structure more quickly, if Perl is available.

See pull request #1 by qwrrty. (This version uses the previous version
if Perl is not available.)

b32b2ce68f24420b2af83c03d5aca55b0f6af5ed authored almost 13 years ago by Alard <[email protected]>

Reuse filemtime-helper (portable stat) from FortuneCity.

90e77b9fc0a1f722fd855fa92e14c84140cea6ed authored almost 13 years ago by Alard <[email protected]>

Relative urls with http weren't made absolute.

fd19df39c4159eb48af736c7c36e71c43bfeb96b authored almost 13 years ago by Alard <[email protected]>

seesaw: Mark done after uploading, not before.

cfde32dc03367ef7e9a6731bec88d36908109c5f authored almost 13 years ago by Alard <[email protected]>

Retry contact with tracker.

6f19f144fee85607fe49d24743c76c08615a5134 authored almost 13 years ago by Alard <[email protected]>

Upload to the new (and empty) Fortress of Solitude.

5589076b43ee87d23a17c4f8ba74b6bbe1b03bc8 authored almost 13 years ago by Alard <[email protected]>

Wget with support for very large files.

790e6bd1a038783e9f22b3e91aedebec439531f1 authored almost 13 years ago by Alard <[email protected]>

It doesn't hurt to use uniq on the urls.txt for public.me.com.

07a8249d60c3c01b16ed256cbce531785ad42c7b authored almost 13 years ago by Alard <[email protected]>

New seesaw script.

94873e7d81ea68b3f99cfba56d64bd57fd68dcaa authored almost 13 years ago by Alard <[email protected]>

The upload script didn't actually upload to the new module.

7edf533341e317974450e40e0b8ed092df45da7d authored almost 13 years ago by Alard <[email protected]>

Use the same nickname regex as the download script.

ca194a0cec1e8c3003c309af6e4281781c21f231 authored almost 13 years ago by Alard <[email protected]>

Merge branch 'master' of github.com:ArchiveTeam/mobileme-grab

55515bb76ee2554398364853a8c7a3903e8fbe66 authored almost 13 years ago by Alard <[email protected]>

upload-finished should exit on rsync errors.

f2e63eda1953bc39e9db53036150be4846809eb1 authored almost 13 years ago by Alard <[email protected]>

Upload to the mobileme rsync module.

bf87b03ea07a2769e128a2e42ca1e0bc6e596219 authored almost 13 years ago by Alard <[email protected]>

Use the latest wget source. Disable native language support.

977b6c3b01284005b8815d9977f2b12e5ccb7584 authored almost 13 years ago by Alard <[email protected]>

Create target directory if it doesn't exist on the server.

6a8ba3f6de63f2ccca83ab9886da13594f5ff51a authored almost 13 years ago by Alard <[email protected]>

Wrong tracker name variable.

eb65032acc2c4348b6c890f031ccb009717c2b08 authored almost 13 years ago by Alard <[email protected]>

Wrong username variable.

5db493b5cb39bd8eff5beb23bf8bf048394696c6 authored almost 13 years ago by Alard <[email protected]>

Always remove --dry-run before you commit.

f9ee820b782cbe52696262271650c71e0647b4eb authored almost 13 years ago by Alard <[email protected]>

Round-robin trackers.

daea191a1290f65052c224e5dd7c98d9c80381f9 authored almost 13 years ago by Alard <[email protected]>

Notify tracker after upload.

6247eb7476e8bdabe5f700b470a08fcfb3ea94b1 authored almost 13 years ago by Alard <[email protected]>

"...left on your" what?

3322ccc0556724ca25d84ebd28929cd744f98bce authored almost 13 years ago by David Yip <[email protected]>

Remove stray df parameters.

954142c470b3509d6866f0b416e3debe7874aeab authored almost 13 years ago by David Yip <[email protected]>

A script to monitor disk usage.

e262f7d2402151ab7c4f10c667fe74b71069d83d authored almost 13 years ago by David Yip <[email protected]>

New version of the wget tar (fixes zlib 1.2.4 bug).

8ed363f43ef3e90a84bf8877972695822dc21b8c authored about 13 years ago by Alard <[email protected]>

Check for ssl-enabled curl.

e122405eb43d4b915c517dfa7d70fc5ea16f0c91 authored about 13 years ago by Alard <[email protected]>

Only grep for href=" in webdav-feed.xml.

One or two users may have urls their page summaries.

c4cdc7fca2115a81b45c2473c5995738d4ddd4e5 authored about 13 years ago by Alard <[email protected]>

Version number: 20111106.01

12a87384b5cfb71f0aebf0c99421408c819901e4 authored about 13 years ago by Alard <[email protected]>

Add rsync helper script.

ea9eaac51ab6606f7b5ca4fbd6b725ddf6f6a319 authored about 13 years ago by Alard <[email protected]>

Prevent 'Not a directory' errors.

5d3b3131343e2f77c0c6ccd1291b07de57a80b18 authored about 13 years ago by Alard <[email protected]>

Write script version to warc-info.

fdfce7fc07026d64255a473958233df55af47257 authored about 13 years ago by Alard <[email protected]>

Use check-dld.sh to check your downloads.

ffb94dfea2f6ed7d533b79eccadd995415a9e29a authored about 13 years ago by Alard <[email protected]>

Make usage less confusing.

705e9cb418a97becdfcf9c5328e9feeff359e608 authored about 13 years ago by Alard <[email protected]>

Fix fix-dld.sh test for .incomplete (wildcard in quotes).

f1315b5d89ab0e40ada6b1788f5219236f60b607 authored about 13 years ago by Alard <[email protected]>

Give more feedback. Don't duplicate mkdir.

5809a5194de8451b6ecc4fecfa692ca568d026fb authored about 13 years ago by Alard <[email protected]>

Move wget to ArchiveTeam-github.

c02a2fbede6817845b6a329b915548a57883881e authored about 13 years ago by Alard <[email protected]>

Switch to the official wget source (wget-1.13.4-2574).

4b4c395b334bb645665ad2c8fcab68210aae27a7 authored about 13 years ago by Alard <[email protected]>

Check for du --apparent-size (OS X).

04f116bb52a913cd5373223387052d353c783942 authored about 13 years ago by Alard <[email protected]>

Have wget use OpenSSL if GnuTLS is not available.

7d71bf6fabd446408ecb268c7ded73e51cf173cc authored about 13 years ago by Alard <[email protected]>

Use --no-check-certificate when downloading from github.

9d69f230a92198ef56ce28073fecac3c3c178e16 authored about 13 years ago by Alard <[email protected]>

Version number.

50004b0848e4680a15fcee4c8cb54e45fdbf41bb authored about 13 years ago by Alard <[email protected]>

Statistics also if user not found.

567c2798001c05cfe515ae37bc62de51409c9847 authored about 13 years ago by Alard <[email protected]>

More statistics.

7f30679916ccb0e91f34396da87cccd6f34646db authored about 13 years ago by Alard <[email protected]>

Look at modification time of STOP file (makes it easier to upgrade scripts).

ba70a240f4e4885d4b4bfd2b01faf2a6e7a45c90 authored about 13 years ago by Alard <[email protected]>

Send the version number to the tracker.

61d7f3abefb7dfb12b859024800055d66280ec1a authored about 13 years ago by Alard <[email protected]>

Let dld-client call dld-single.

88c7ca591e3dd6885cce5d8d80bdab99db7c46ce authored about 13 years ago by Alard <[email protected]>

Safari says hi.

68d6a4a45aa148cf92d77d8885a3ce0a346fa9b0 authored about 13 years ago by Alard <[email protected]>

Add note about dld-single.sh

75fff85a50bb66f1622c844d27973b07ae810bef authored about 13 years ago by Alard <[email protected]>

Ignore content from non-me.com domains to prevent DNS errors.

a0b1da3c3719117105704304f71d3f8d087600c1 authored about 13 years ago by Alard <[email protected]>

Decode urls before using them as path names.

703caa75333dd918eb5140c3dffb23d0ba3f59d0 authored about 13 years ago by Alard <[email protected]>

Ignore /WebObjects/FileSharing.woa/ on homepage.mac.com (crawler trap, no content).

f271bd3f47386df0bf74b8e496411b46cf4fe919 authored about 13 years ago by Alard <[email protected]>

dld-me-com.sh: Prepare the directory tree for wget.

4ff499f109b604bb1dc7c31885d85a759f0a0c9a authored about 13 years ago by Alard <[email protected]>

Faster downloading without --delete-after: if that option is enabled, wget downloads duplicate files.

9b68382a8a3d9b5b5c54f7840a4ffb5d4f6dfa73 authored about 13 years ago by Alard <[email protected]>

dld-single.sh: Check username, alias.

ef0d922d35059b9e6d07196f44cbcc574f174f1f authored about 13 years ago by Alard <[email protected]>

fix-dld.sh. dld-single.sh now returns nonzero exit code on error.

52f5598e3f6f80d67dfb5f4bab21551ba386b203 authored about 13 years ago by Alard <[email protected]>

Exclude the /g/ directory on web.me.com. It's really slow and doesn't anyway.

b5584db0fa2984f3ccbeab8604574681de6666ba authored about 13 years ago by Alard <[email protected]>

There's also a Sites.rss (sometimes).

a4854cd86aae863407c7bdf116903afbbf75a101 authored about 13 years ago by Alard <[email protected]>

Forgot to add 'done'.

fe86f2ac7b92438c1f0ae8cf4994aba89a0c1351 authored about 13 years ago by Alard <[email protected]>

More complete iWeb downloads from web.me.com.

44db491eeaca031313db52685f9edc1a65d3b6f2 authored about 13 years ago by Alard <[email protected]>

Do not include < in urls.

0fce28fbe8e71edbf6e5fb87d5c142b1f95ffa88 authored about 13 years ago by Alard <[email protected]>

du --aparent-size

63f6fa80fbe6b3ac245989d600dc9127f96a0189 authored about 13 years ago by Alard <[email protected]>

Add dld-single.sh

793c8100d3d325f348ff64ce37ae68964c9062e0 authored about 13 years ago by Alard <[email protected]>

Updated wget version.

4b8ef81f1d723c4eec981f3cc8e0934f29c3b260 authored about 13 years ago by Alard <[email protected]>

UI improvements. Stop at error.

e500c3de4da291ca39e8e3b25126bbd7668e26f5 authored about 13 years ago by Alard <[email protected]>

Accept authorization errors.

b0e7449b3e1e632bea44e43597c4da3c5cd0a156 authored about 13 years ago by Alard <[email protected]>

New: dld-client.sh for distributed downloading.

006bc0388f3ce3867bb3fd654c72c936cec57c02 authored about 13 years ago by Alard <[email protected]>

homepage: Use --delete-after and --no-directories.

05289b9b4e4ca82f877bef1ce380246264d9af60 authored about 13 years ago by Alard <[email protected]>

Skip the derivative images from the gallery.

c8e0746123232c29f646dff200696e92a4ac2922 authored about 13 years ago by Alard <[email protected]>

Better error messages. Handle 404 on web.me.com.

ad5d3e2070fb2f20ad4aadba1202f15999fbbaf2 authored about 13 years ago by Alard <[email protected]>

Add time stats.

c0b247bf14251fd3347abc339aea3bbf2c52d3d6 authored about 13 years ago by Alard <[email protected]>

Add documentation.

35c5a8fc7cca66a594ba73068d009dc4e5a27596 authored about 13 years ago by Alard <[email protected]>

web.me.com should be downloaded from XML, not JSON.

4ca1a817d077aaac8d1fe9d3433a0767e14c77c6 authored about 13 years ago by Alard <[email protected]>

Add homepage.mac.com to the general script.

4fbd6f461b1ac317ed5b8a031333b1bb92177ef6 authored about 13 years ago by Alard <[email protected]>

Combined three download scripts.

5b115046ba72ed1ffdf8b7feeaa9e44da3c74bb5 authored about 13 years ago by Alard <[email protected]>

Make dld very similar.

4054a8967e43805f9fc3b90398e247e3c2e93bb5 authored about 13 years ago by Alard <[email protected]>

Download gallery to WARC.

f66240be1b335839de1e3dd99fce0d979c6b102d authored about 13 years ago by Alard <[email protected]>

Update readme.

96f015f844f5b669c88e573bab9299de1ce2f264 authored about 13 years ago by Alard <[email protected]>

Latest version of wget-warc.

1d2a0134c82f4122c39c073ed813fc3206ab04be authored about 13 years ago by Alard <[email protected]>

Helper script for installing wget-warc.

c698a5b6348377ac1563074df23339f61c641909 authored about 13 years ago by Alard <[email protected]>

gallery: Keep metadata. Do not stop downloading on errors in images.

2d265f42a82d9e0df1ebf0fa3c274eb6e142ec8b authored about 13 years ago by Alard <[email protected]>

public: Download as WARC.

8e6dc69507587ad18349808309a93575b57cbb83 authored about 13 years ago by Alard <[email protected]>

web: Remove .incomplete if not found.

c8b4ec1e52c1af931e9283289010505f32f1cc0a authored about 13 years ago by Alard <[email protected]>

gallery: Remove .incomplete if gallery not found.

f38791c95c623df283d72478315a5c425eb39d0d authored about 13 years ago by Alard <[email protected]>

public: Check exit codes.

6142482234cadd6c411d8954bd57c1e7e9ee1cc2 authored about 13 years ago by Alard <[email protected]>

gallery: exit(0) if gallery not found.

6bacd953b4da0937a826703163fb31d320aea30c authored about 13 years ago by Alard <[email protected]>

public: Error message.

b9d89e4d1e4073c3e808f5a88d55d9367099d45c authored about 13 years ago by Alard <[email protected]>

web: Accept wget exit code 8 as valid result.

eebeb827fe351914cb088b4966dc2ca57e21786e authored about 13 years ago by Alard <[email protected]>

gallery: Better handling of videos.

d1a5f401a60d79fd2e68099f3fa0722c1b917282 authored about 13 years ago by Alard <[email protected]>

homepage: Accept wget exit code 8 as valid result.

d6d189c12705e87b880741b80eb487f00ecb02ef authored about 13 years ago by Alard <[email protected]>

Improved exit codes. Nicer indentation of status messages.

22ef382576bc99e968f725f714068527ad78e403 authored about 13 years ago by Alard <[email protected]>

Update readme.

05cc08fbadf427f3e484c0779ed768a8c3b42465 authored about 13 years ago by Alard <[email protected]>

One script to download everything.

aecfe5badd1b191f5df01daba12ae3ac9c1cf28a authored about 13 years ago by Alard <[email protected]>

Clean up unused files.

309cc07825d1e1a2aef94077f31f26cad7b7e233 authored about 13 years ago by Alard <[email protected]>