github.com/tahoe-lafs/magic-folder commits | Ecosyste.ms: OpenCollective

Replace _lazy_tail with iterative loop, cleanup tests (#2412)

* uses @inlineCallbacks to turn the _lazy_tail recursion into
a "real" looking loop;
* remo...

2443dc584ead77364948b236af9908d0ac2a111b authored over 8 years ago by meejah <[email protected]>

WIP: add close method for MagicFolderDB and make MagicFolderDbTests use it.

Signed-off-by: Daira Hopwood <[email protected]>

c5066df6d416e445f0e0e236f1baec6d6541c9b9 authored over 8 years ago by Daira Hopwood <[email protected]>

WIP and debugging things

Conflicts:
src/allmydata/test/test_magic_folder.py

0e754db041b5fc4d8cf27cde9fa491105b336efb authored over 8 years ago by meejah <[email protected]>

Correct magic-folder use of StorageFarmBroker

When landing the "connected enough" changes on master,
we changed the API; this fixes up usage o...

d8009eba1adf9b6bdcbe08eae3dad77e94c6365c authored over 8 years ago by meejah <[email protected]>

possible less race-y startup

7d7fea2461480172848a87d2ebb3b98cd17b9f25 authored over 8 years ago by meejah <[email protected]>

Expand test for Magic Folder statistics.

014516362a75f091f1af8e72013f6b4fb73a6e69 authored over 8 years ago by Daira Hopwood <[email protected]>

daira points out bug

0de92adb00384c2d12697a1a6a8097853e357be1 authored over 8 years ago by meejah <[email protected]>

Daira's excellent fixes to the uploader from our pairing session

35df7fb710c251f07111fb164f1e423c5d6ead09 authored over 8 years ago by David Stainton <[email protected]>

Improve test for Magic Folder statistics and move it from test_system.py to test_magic_folder.py.

f11571227f6e0a47aaa8a5558733def48f583924 authored over 8 years ago by Daira Hopwood <[email protected]>

remove special-case win32

b198c547da9e47ceff54b2e104aae7c33cfde94c authored over 8 years ago by meejah <[email protected]>

Attempt to test periodic uploader full scan

76efbea06fafe62d9b95dadc43b351f37beeb205 authored over 8 years ago by David Stainton <[email protected]>

more

5d08b4e792f94a4e45c050f61aad155bb21d5600 authored over 8 years ago by meejah <[email protected]>

Daira's fix during session with David and Meejah.

df48d2a27de5fbaff702f92508e4f6e06d3acf29 authored over 8 years ago by David Stainton <[email protected]>

add docstrings

c46d9d17cb1a4e004af8e90ee685b28f26243f7c authored over 8 years ago by meejah <[email protected]>

Change type of mtime and ctime stored in magicfolderdb to integer nanoseconds.

Signed-off-by: Daira Hopwood <[email protected]>

2830085fa0ec0c998795a39cc83d5e5f8a844f63 authored over 8 years ago by Daira Hopwood <[email protected]>

WIP

aebecde2770b0f68aabcb57e5fef776c64435c49 authored over 8 years ago by David Stainton <[email protected]>

Don't use a long path for the [magic_folder]local.directory field.

Signed-off-by: Daira Hopwood <[email protected]>

714c6716e6da37f3cc9feaa74d213276dd78da6f authored over 8 years ago by Daira Hopwood <[email protected]>

Scan our own dmd upon start only

c7be693178c5998e231b44d91bccc3fec8630370 authored over 8 years ago by David Stainton <[email protected]>

Temporarily increase delay to make sure we receive notifications.

Signed-off-by: Daira Hopwood <[email protected]>

aa3479fed76b83e975e55896e32b4562a4039791 authored over 8 years ago by Daira Hopwood <[email protected]>

Correct type for Windows BOOL.

Signed-off-by: Daira Hopwood <[email protected]>

4221577d7807db85e2bcfb5dea0316aee05f5155 authored over 8 years ago by Daira Hopwood <[email protected]>

Fix uploader's _process to extend queue after scan and count stats properly

2340af28b7f58f1620fef3f7efd7161441a3b610 authored over 8 years ago by David Stainton <[email protected]>

Add multi-party-conflict-detection.rst.

Signed-off-by: Daira Hopwood <[email protected]>

a3c09995caf7e29288e371e3248af033dc584250 authored over 8 years ago by Daira Hopwood <[email protected]>

Fix an unused import.

Signed-off-by: Daira Hopwood <[email protected]>

dba433cc134bda17267da4be8e0fb28fba7a4053 authored over 8 years ago by Daira Hopwood <[email protected]>

Improve reporting of assertion failures.

Signed-off-by: Daira Hopwood <[email protected]>

eabf1ab759a7723de8a30e6fb3e181813e703418 authored over 8 years ago by Daira Hopwood <[email protected]>

Add last uploaded timestamp comparison for remote conflict detection

8d527d4ed044a7f25a449619e44c54c0b6f52699 authored over 8 years ago by David Stainton <[email protected]>

New code for Windows drop-upload support. refs #1431

Signed-off-by: Daira Hopwood <[email protected]>

a96a0b568be9b3ca457dc9dcf9ec4d8caa607317 authored over 8 years ago by Daira Hopwood <[email protected]>

Fix test helper _check_version_in_local_db

3b472c2783a9c797a77ef880e883364e9c13934c authored over 8 years ago by David Stainton <[email protected]>

Remove old obsolete/inaccurate statements

d487510e661fd70402661afde2871935c41a639a authored over 8 years ago by David Stainton <[email protected]>

Simplify and fix non-existent-file handling.

Also make the existent and non-existent cases as similar as possible,
with a view to merging them...

cbb38c70a231e21ce2f5c522717b8edecab0db76 authored over 8 years ago by Daira Hopwood <[email protected]>

Create test for last upload uri conflict

0e9ec2dd5976dfd197b0601c00bfe64db81eca28 authored over 8 years ago by David Stainton <[email protected]>

Fix tests by submitting unicode args instead of str

0a5fa0d1a91a320b67a5404724eaddbf512e3eca authored over 8 years ago by David Stainton <[email protected]>

Add link to our cli design doc

6c4f3234100d1c4bb94cc64e109a5fa47442f65c authored over 8 years ago by David Stainton <[email protected]>

Ensure that errors from Alice-and-Bob tests are reported correctly if setup fails.

Signed-off-by: Daira Hopwood <[email protected]>

18d9c148b03afe65f48d252178a6f4a029ea0217 authored over 8 years ago by Daira Hopwood <[email protected]>

Add precondition to Uploader._process.

Signed-off-by: Daira Hopwood <[email protected]>

1b73e7631a1f80a78f2ef3e893bc79ab534ae5e0 authored over 8 years ago by Daira Hopwood <[email protected]>

remove humanize, use internal method, teach internal method to understand timedelta

9da88cf4862ccda0db361eed10f75a2bed8e6792 authored over 8 years ago by meejah <[email protected]>

implement 'delete' functionality, with tests

c8d2dac61171f31a465f3bc3dcd84e54bd5f8da7 authored over 8 years ago by meejah <[email protected]>

Avoid .format, since it is inconsistent between Python 2.6 and 2.7 (and the rest of Tahoe-LAFS doesn't use it).

Signed-off-by: Daira Hopwood <[email protected]>

59eea186341439655425c6481d08573762f8a184 authored over 8 years ago by Daira Hopwood <[email protected]>

Count conflicted objects

e1eabefa4a30ae4e3ae13492239adae9d90cdd52 authored over 8 years ago by David Stainton <[email protected]>

skip all tests w/o inotify support

9a9c48e6f295f04eda6ac226d89ae1e1871f17a4 authored over 8 years ago by meejah <[email protected]>

Fix some path Unixisms.

Signed-off-by: Daira Hopwood <[email protected]>

7d5a07a186f54adb8ce248a0254f49052ac0acb7 authored over 8 years ago by Daira Hopwood <[email protected]>

Don't add subdirectory watches if the platform's notifier doesn't require them. refs #2559

Signed-off-by: Daira Hopwood <[email protected]>

e0363469332431742220e3f1c8b7c7690c000165 authored over 8 years ago by Daira Hopwood <[email protected]>

Improve all of the Windows-specific error reporting.

Also make the Windows function declarations more readable and consistent.

Signed-off-by: Daira H...

90ed07d6919ddfada9ec8f2120cd477235c6af9f authored over 8 years ago by Daira Hopwood <[email protected]>

Don't include [magic_folder]enabled and local.directory fields by default.

Add a comment reminding to do the field modification properly.

Signed-off-by: Daira Hopwood <dai...

af772a95e5edbe0dd2c4090562fc7a7de6cbebcc authored over 8 years ago by Daira Hopwood <[email protected]>

Advance Bob's clock after notifying.

Signed-off-by: Daira Hopwood <[email protected]>

fc8191f7d8d436a4240801dfedccf4e17cdd06a7 authored over 8 years ago by Daira Hopwood <[email protected]>

remove delayedcall debugging

21b5b1dd16a2987a7d874464a43d94d7ac6101b5 authored over 8 years ago by meejah <[email protected]>

Increase timeout for test_alice_bob to 5 minutes.

Signed-off-by: Daira Hopwood <[email protected]>

e7d6105d66106a1da33cf569ba4727d75e5281a5 authored over 8 years ago by Daira Hopwood <[email protected]>

fix/change some assertions

b06b53eb50b8e37b2de62de012c81a732e079745 authored over 8 years ago by meejah <[email protected]>

Add counter for uploader.objects_not_uploaded.

Signed-off-by: Daira Hopwood <[email protected]>

503652799200ea89edc94c9c46e82cbad1325d3c authored over 8 years ago by Daira Hopwood <[email protected]>

tighten delay on windows tests

9c0b819ba75f40fc245a1cd5988d0f0747efa233 authored over 8 years ago by meejah <[email protected]>

Make retry_download test work, and some bonus comments

8b04a26add69e888b19479428fb302043a004087 authored over 8 years ago by meejah <[email protected]>

Fix umask usage bit fiddling and use try finally blocks

63d17d80d001b40ed1b5063000183395dd10237b authored over 8 years ago by David Stainton <[email protected]>

Break out our chmod while loop into fielutils.py

18134aa9da1721429c8c7a9666e7d2f7c54033d9 authored over 8 years ago by David Stainton <[email protected]>

flesh out IQueuedItem

f0457a9c46657d0de6b9130cdc98e72e18d323a3 authored over 8 years ago by meejah <[email protected]>

Add cli stub for magic-folder status command

48dbc682d03ebce1891a0f77df69ca6bae2a954f authored over 8 years ago by David Stainton <[email protected]>

Cosmetics.

Signed-off-by: Daira Hopwood <[email protected]>

11f676b1396298ae55e4f785b70d8ce4c364c490 authored over 8 years ago by Daira Hopwood <[email protected]>

Simplify _scan_remote_* and remove Downloader._download_scan_batch attribute.

Signed-off-by: Daira Hopwood <[email protected]>

89187e76c42322c56ba8de7bb28a75c80b956292 authored over 8 years ago by Daira Hopwood <[email protected]>

more startup waiting

674104a763ffb8bcf40752197ec7c75fe2863546 authored over 8 years ago by meejah <[email protected]>

Add magic-folder test_scan_once_on_startup

3d7ade9e7ba38143b144c75a9eaee82c128b51ee authored over 8 years ago by David Stainton <[email protected]>

Improve the error reporting for 'tahoe magic-folder join/leave'. refs #2568

Signed-off-by: Daira Hopwood <[email protected]>

6c0ab811be95aed45d9c2da21d530b891cbfa98b authored over 8 years ago by Daira Hopwood <[email protected]>

Minor simplification.

Signed-off-by: Daira Hopwood <[email protected]>

cda1a6d78a11ba3a7f0df51ec5b63caf3343aabd authored over 8 years ago by Daira Hopwood <[email protected]>

Add WIP test_download_retry.

Signed-off-by: Daira Hopwood <[email protected]>

c0f6f74076f7b954ff2cea51f220dabe666d798e authored over 8 years ago by Daira Hopwood <[email protected]>

Repair tests after changing the semantics of objects_succeeded.

Signed-off-by: Daira Hopwood <[email protected]>

b22163d080a66b5d3b6f5601ee47e42c8e2b0ce2 authored over 8 years ago by Daira Hopwood <[email protected]>

magic-folder.rst: update introduction.

Signed-off-by: Daira Hopwood <[email protected]>

29dc911537b0ea5f2a90e27649cdea9991eaa720 authored over 8 years ago by Daira Hopwood <[email protected]>

Add file conflict unit test

248b1812d58dfbd6643105f1aae9a2cf23cbbc1f authored over 8 years ago by David Stainton <[email protected]>

Fix call to argv_to_abspath. Also rename localdir to local_dir.

Signed-off-by: Daira Hopwood <[email protected]>

a4474fc91aa1fe10fa44b7287ac7cd974e3d7bce authored over 8 years ago by Daira Hopwood <[email protected]>

WIP: exclude own dirnode from scan. This is not quite right; we shouldn't exclude it on startup. refs #2553

Signed-off-by: Daira Hopwood <[email protected]>

b7768a53b8e5703c791f9a278a549d7b8bb18020 authored over 8 years ago by Daira Hopwood <[email protected]>

Windows path fix.

Signed-off-by: Daira Hopwood <[email protected]>

2411758fb76978182c9cee5c8738584b30c808ca authored over 8 years ago by Daira Hopwood <[email protected]>

Fix test_alice_bob.

Signed-off-by: Daira Hopwood <[email protected]>

57dacd0aa1d9b767e20b95c175265973f84939a5 authored over 8 years ago by Daira Hopwood <[email protected]>

Distinguish deletion of directories.

Signed-off-by: Daira Hopwood <[email protected]>

3d835cd610bb9eef582be1bdf623d93ed4eafc1b authored over 8 years ago by Daira Hopwood <[email protected]>

Attempt to fix cli tests

93289e007b9c306bc7f703f12048371b04a98be0 authored over 8 years ago by David Stainton <[email protected]>

add the 'spurious' notifies

c76979b47a8b1999ce94cfb7e2ca8753119605ee authored over 8 years ago by meejah <[email protected]>

Cosmetics.

Signed-off-by: Daira Hopwood <[email protected]>

55e45ffaa741cd55470952d44ca890f48f52bab5 authored over 8 years ago by Daira Hopwood <[email protected]>

Fix a subtle typo.

Signed-off-by: Daira Hopwood <[email protected]>

271f3729a705be6c30a4d21b777f84fc2c96a8f7 authored over 8 years ago by Daira Hopwood <[email protected]>

Test creation of a subdirectory.

Signed-off-by: Daira Hopwood <[email protected]>

b63be58fd3ad1926f0977baea592a3829613cc69 authored over 8 years ago by Daira Hopwood <[email protected]>

Decode names in the scanned remote.

Signed-off-by: Daira Hopwood <[email protected]>

1a7bc6b5f2d9a3962b3104ebb592d8743056cbd7 authored over 8 years ago by Daira Hopwood <[email protected]>

Refactor and fix race conditions in test_alice_bob.

Signed-off-by: Daira Hopwood <[email protected]>

6c7b7449c96607ff195c4016ff5755fba4ea2ce3 authored over 8 years ago by Daira Hopwood <[email protected]>

More Magic Folder doc updates.

Signed-off-by: Daira Hopwood <[email protected]>

287167f2b13de2e6a75b18903805aa05046fcaff authored over 8 years ago by Daira Hopwood <[email protected]>

Flesh out "tahoe magic-folder status" command

Adds:

- a JSON endpoint
- CLI to display information
- QueuedItem + IQueuedItem for uploader...

b267bfc2d1ee45e94ec62a36cdc56abc83a7dfd7 authored over 8 years ago by meejah <[email protected]>

Teach magic-folder join to use argv_to_abspath

- also we modify argv_to_abspath to through a usage error
if the name starts with a '-'

- add a...

87b2e1609baebd9cb486a783d904f958c2aa307b authored over 8 years ago by David Stainton <[email protected]>

Teach uploader+downloader to use to db schema

here we attempt to fix all the unit tests as well...
however two tests still fail

ed76ffec2739740c21aee65b40abab6443863edc authored over 8 years ago by David Stainton <[email protected]>

Refactoring to allow logging from _write_downloaded_file and _rename_conflicted_file.

Signed-off-by: Daira Hopwood <[email protected]>

b6226b11e0f9131510b8c80245b69cbe44c1b2cc authored over 8 years ago by Daira Hopwood <[email protected]>

Implement creating local directories in downloader.

Signed-off-by: Daira Hopwood <[email protected]>

8ad9a614cb597b9ac3874c3c05fe7465ad8f6e4c authored over 8 years ago by Daira Hopwood <[email protected]>

Make sure that test_move_tree waits until files have been uploaded as well as downloaded.

Signed-off-by: Daira Hopwood <[email protected]>

88cc1d612dd1f44131ba9f973427c077c6db0280 authored over 8 years ago by Daira Hopwood <[email protected]>

Logging/debugging improvements.

Signed-off-by: Daira Hopwood <[email protected]>

ab4d29d14caf4948cb6c0e10f17118cfcee58095 authored over 8 years ago by Daira Hopwood <[email protected]>

Clean up queue loging and add a clock advance in unit test

not yet working

3a36190ebe344728385e5b136950adc51dd85940 authored over 8 years ago by David Stainton <[email protected]>

Add magicfolderdb.py.

Signed-off-by: Daira Hopwood <[email protected]>

786d6361373af67236e26f073ad19b8cf5f1de13 authored over 8 years ago by Daira Hopwood <[email protected]>

Restore a call to increment files_uploaded that was mistakenly removed.

Signed-off-by: Daira Hopwood <[email protected]>

bfe37807f3c89ed0faf1144a6c43b44720b0283f authored over 8 years ago by Daira Hopwood <[email protected]>

Correct a call to did_upload_version in the downloader.

Signed-off-by: Daira Hopwood <[email protected]>

e3e1e4286774c55a1018de211c70ed5b2133ec2d authored over 8 years ago by Daira Hopwood <[email protected]>

WIP

e4c2e2f749304f10bdaca2f7a69aed6bbf7ae3ce authored over 8 years ago by David Stainton <[email protected]>

Make downloader delay a class-variable

This gives the integration-style CLI-based tests a chance
to set the delay to 0 before the first...

f88326fd8c898f7061bbc5bcb5bf53232ffdf62c authored over 8 years ago by meejah <[email protected]>

For all downloaded files ensure parent dir exists

775368eb5418329710cdadf004351842f0bca7e7 authored over 8 years ago by David Stainton <[email protected]>

properly cancel pending-call things in windows inotify

92cc42dfcaab69c3d4e326d7a3e3325156d57215 authored over 8 years ago by meejah <[email protected]>

Teach uploader's _scan to use the deque

1ecdc1371893321c630eb2176cbe6731c1152642 authored over 8 years ago by David Stainton <[email protected]>

Correct a string-type error.

Signed-off-by: Daira Hopwood <[email protected]>

836da04e29f52953c013da888a935bca67ad2688 authored over 8 years ago by Daira Hopwood <[email protected]>

Mention gc is not part of the otf grant and link to the gc ticket

0ed5fa727604881396076580cb3940a742828ed3 authored over 8 years ago by David Stainton <[email protected]>

Prevent magic-folder join if already joined.

45f8bfb9582331eb62041230655534117360d947 authored over 8 years ago by David Stainton <[email protected]>

Teach unit-tests to time-warp

1. Split alice/bob clocks to avoid races conditions
in the tests
2. Wrap ._notify so we can a...

cc7715aff5fcb9d99479a43067c1160ccd348537 authored over 8 years ago by meejah <[email protected]>

Docs for drop-upload on Windows.

Signed-off-by: Daira Hopwood <[email protected]>

2fca83068db4a23e05140c78c85ce5ec8e63d8a8 authored over 8 years ago by Daira Hopwood <[email protected]>

Magic Folder file moves.

Signed-off-by: Daira Hopwood <[email protected]>

f434e09ccdbf9a324f3ce0014079121dd92220c7 authored over 8 years ago by Daira Hopwood <[email protected]>

remove incorrect override

188c40a388472fdfd1f5b3d366306b591982f09c authored over 8 years ago by meejah <[email protected]>