github.com/mwmbl/mwmbl commits | Ecosyste.ms: OpenCollective

Merge pull request #163 from mwmbl/copy-index-app

Copy index app

8c4726fce658e0f449091c4bac369134a87cd16d authored 11 months ago

Add old migrations

8c99cd4419425b79ca0ea7a6393b05e57e69a2e9 authored 11 months ago

Move more paths to settings

e83751894a36a79226ea7f100c3b4eafd65eb112 authored 11 months ago

Revert the index

b5768d8ce6b83fe9c53a4c65a69e81a4fa48e6ed authored 11 months ago

Add old index migration

52f78cd2cab8d6392f264c4a5c62b58090bd3cc2 authored 11 months ago

Simplify old index

f96bd878ca6ffac8895c1d1aa5e7ffb87518d44d authored 11 months ago

Merge branch 'main' into copy-index-app

d1d088fc13c2565e04cc8c222f0b110e714c8aca authored 11 months ago

Merge pull request #162 from mwmbl/update-dependencies

Update dependencies

d5a531821cf5ee94cf634d64914952126cda1b04 authored 11 months ago

Merge pull request #109 from PeterDaveHelloKitchen/Dockerfile

Optimize Dockerfile by cleaning up apt cache

5a54eddb3a5d5acca37595ed9b5830eac7a3b518 authored 11 months ago

Update dependencies

0800f9bad7e33ff9f92dd95b65b84bf56c1963ba authored 11 months ago

Merge branch 'main' into copy-index-app

0f1d846f4fe0fcd280210b5040f4dd26129555b2 authored 11 months ago

Merge pull request #161 from mwmbl/delete-domain-scores-when-getting-batches

Delete domain scores when getting batches

f4ef6235b6fe0849abcbf4a36ff5e34a6b783416 authored 11 months ago

Delete domain scores when getting batches

15bd43eb2fb1041458571c4e9e6a1c14faaa9316 authored 11 months ago

Update the old index info

9719895737ab801ed361ecca0e5a6f46585c597e authored 11 months ago

Merge pull request #160 from mwmbl/move-queue-update-to-separate-app

Move queue update to separate app

d671ca129908ba1ea96e43fd5df810dd1c7e2652 authored 11 months ago

Rename background task update_batches

3ccd4ecb56f5642f1e8a2cd438a46118a220e4d6 authored 11 months ago

Remove run background settings config option

56e8aa3e213a10ec2e8bda506cc6c9a4225fbc93 authored 11 months ago

Delete old URL queue

c0e1f4d1056eee7d3dcb8064be8b20ea9807d270 authored 11 months ago

Run URL update as a separate app

77a9a03faafbff5df87bbaa5677346ba2b725b6d authored 11 months ago

WIP: implement Redis-based queue

5530d03e2e55e46709476109267cd95fe50882db authored 11 months ago

Merge pull request #159 from mwmbl/copy-index

Copy index

6d1e7810c37133fbd742059320d77dbeef27c535 authored 11 months ago

Add a test for copying pages

11d388bfc64859d69dcdba4b56944a8097ed3a84 authored 11 months ago

Refactor and get pages in the right format

bc27518596ba63d2a4d84bb8e61f6005fec354b4 authored 11 months ago

WIP: index pages from old index in new one

393ef7e06fa2cc42501524942c48e17c00981aa7 authored 11 months ago

Merge pull request #157 from mwmbl/catch-exceptions-in-url-queue

Catch exceptions when updating URL queue

7b0392e51142cf2b62de07d97c0007994ad148b4 authored 11 months ago

Catch exceptions when updating URL queue

a585709d0f76d52aaff8d77938d19509d77f874b authored 11 months ago

Merge pull request #155 from mwmbl/fix-more-500-re-errors

Ensure Document title and extract are never None

684c070f935b73be291bfa5f2898c21b90a91607 authored 12 months ago

Add a comment explaining what we're doing

4ba25a77b4333af4d5b08efb393606e1deb3e682 authored 12 months ago

Ensure Document title and extract are never None

f01ae42f6b7fdeadb3d99f58cf07d0c9e19c2b50 authored 12 months ago

Merge pull request #154 from mwmbl/fix-500s-due-to-nones

Handle the case where title or extract are None

423c808d4935d4813a16e2d89a04291b3ee6864d authored 12 months ago

Handle the case where title or extract are None

67c519230e46c69aa1d20cdeb5e069be268cccc4 authored 12 months ago

Merge pull request #153 from mwmbl/extra-logging-for-re-error

Better logging for confusing error

b26576a7f9c13abf9b21d1ddf20c404427c6a587 authored 12 months ago

Better logging for confusing error

0477c27da9d4a8f056a5551333c1b8679136362e authored 12 months ago

Merge pull request #152 from diagonalo/main

Add codeberg.org mirror workflow

b06927f3aeb8dce4c6afd7fce5c2a42c81875b33 authored 12 months ago

Remove cronjob from codeberg-mirror workflow

e7dc535459b9aa041f56ff76de8c7b8b631241a7 authored 12 months ago

Add codeberg.org mirror

7531d694d3fe533c1732a40ba2361262900f1563 authored 12 months ago

Merge pull request #150 from mwmbl/fix-multithreading-decompression-errors

Don't allow the same compressor/decompressor to be used from multiple…

d98787ca0f061281092d1c5630859a5a599237d5 authored about 1 year ago

Don't allow the same compressor/decompressor to be used from multiple threads

87825125e6edee346f4580083f050efe2555cc4d authored about 1 year ago

Merge pull request #148 from diagonalo/readme-update

Change installation instructions to link to book.mwmbl.org

eadbe535e4afc0d0ea070ab4341917aa2e696703 authored about 1 year ago

Change installation instructions to link to book.mwmbl.org

e4b79b39d65ad0fc3eef9b0193cb3cf0c6a5d8b6 authored about 1 year ago

Merge pull request #146 from diagonalo/redis_env_var

Set default redis url to localhost

47d586dd394f205927ccf48de828e6d94182b9e7 authored about 1 year ago

Set default redis url to localhost

ac34bc8fc084ff66929138b17581c5eb11769d4d authored about 1 year ago

Add more logging for preprocessing documents

74fa8d51e0ee434ae35078f3d5f0c678456ce639 authored about 1 year ago

Improve logging for decompression errors

3230149c5858434f1bf96a8db187359f9345f1b5 authored about 1 year ago

faulthandler not working

d1e33aedad73d2e8427e88cea33ed245edadf2e5 authored about 1 year ago

Use stdout for faulthandler

d5961a679215f7a697e7d691127dad5901110144 authored about 1 year ago

Change the key in the setting path

18881662b90f0c6593f13241f3ae36824bf9456f authored about 1 year ago

Enable fault handler

851fe3f45ec44ad31f4fdb0d2839e31b1f20db91 authored about 1 year ago

Merge pull request #143 from mwmbl/use-bloom-filter-instead-of-url-store

Use bloom filter instead of URL store

e3b9e957dd1a5816e8603f7eac7fd103490ce815 authored about 1 year ago

Fix broken tests

a76dfea52f15bd5a10830c35965b337b7771c3c8 authored about 1 year ago

Use domain link scores to prioritise URLs to crawl

cf063e12b14fbe89a8273a747df371af9bf53661 authored about 1 year ago

Update domain links

b3db857eafa34b66c3057a76807df4e80cd5c441 authored about 1 year ago

No need for URL scores any more

cdeb4a08c5838172345b9a43111c89d4d1299f02 authored about 1 year ago

WIP: track links from top domains

ea31d5204b37626da6dec95e58b9bf3d1eb199d6 authored about 1 year ago

Make URLDatabase a context manager

b8ea3066d4d7eb14c031de0420b7e392d80bb4e3 authored about 1 year ago

Track crawled URLs using a bloom filter

5782e26763c359c04da0af32e14657974fd59882 authored about 1 year ago

Merge pull request #137 from mwmbl/disable-curation-for-non-logged-in-users

Disable curation for non-logged in users

e544d45c374c13cdc1a5048dac28b3961d39e7c5 authored about 1 year ago

Disable curation for non-logged in users

0e0b8b49195b05aad41ad134c808876bb70fab88 authored about 1 year ago

Merge pull request #136 from mwmbl/add-link-to-guidelines

Add guidelines link

f25808014443da38849349952555bc71655f7f8c authored about 1 year ago

Add guidelines link

ac9ed70b5c3d65150a9b3d18cd6226a7aedd3b6c authored about 1 year ago

Fix argument order again :facepalm:

ffd24315b9664b5fecbacfc73e1df7b79a09b4b6 authored about 1 year ago

Fix argument order

80100ebb196325cef6aabcd35d54d3a249c88dd1 authored about 1 year ago

Use fewer batches when updating URLs

09ffee046d6e886626ee8dc266cd15f2e3af5901 authored about 1 year ago

Catch errors parsing URLs

09e03427c1cb3d21d2bb71453544154dea6fdbfb authored about 1 year ago

Merge pull request #135 from mwmbl/fix-extension-for-htmx-based-curation

Fix extension for htmx based curation

dd2abe38354715b599c379d274f503fb047e02fd authored about 1 year ago

Copy and use local htmx

b6aed2c8da3bdb113662cd58c7cb2671e74f70d1 authored about 1 year ago

Set up a listener to refresh htmx; send the csrf token from the index, not the results returned by the extension

75ca46dae5e9f281c89de1179605ac83559f20c4 authored about 1 year ago

Remove unused save.js code

ae7e6d26382f8c940ae1c527d4969aaa390f808f authored about 1 year ago

Merge pull request #134 from mwmbl/htmx-for-curation

Use HTMX for curation

02ede46b18795ef42dc01253ebcf771071783dcd authored about 1 year ago

Add timeout for get request

d8642e20329ff6350e861fb7a4f9417ea3a52110 authored about 1 year ago

Remove unused code

6dffe37942fec738a95429d066807cc7a1dfd208 authored about 1 year ago

Replace the right bit of html

820b5f80d132b93be3465811089b28eaf4516414 authored about 1 year ago

Put the form in a better place

4fe2dc9e0587f03b7c1602e3928914864782abaa authored about 1 year ago

Remove some unused code

bb9911fcc0cccf7d3bd13485cd2b3f4130d126c2 authored about 1 year ago

Fix document state in reverting curation

be78d69727c1c1235b48b4e2811652ec5026fc5b authored about 1 year ago

Remove curation from results from other terms

3f41588be4d3e39e238120ad0a10aedb8d8d6b40 authored about 1 year ago

Fix reversion bugs

6d992255e8aae43153edd6ddac432dccebe9adc3 authored about 1 year ago

Minor UI tweaks

1a5cbc9a4b27750ee7473e77ad6256baa8893135 authored about 1 year ago

Implement revert current curation

a84570d16cd031c16e2cb8f80d88cd06c1474f63 authored about 1 year ago

WIP: add revert changes button

73e2884e5f77c7ea152e91d96f8c384ba97a9987 authored about 1 year ago

Add migration for previous commit

2a5ee37a57d9f38f1ba8a2287275bb44d99447fc authored about 1 year ago

Move the add result form to home so that the curation ID is updated appropriately

1552b3bd6b16d4ecfc5b2dac67ccc97cc30ec59c authored about 1 year ago

Store original index state with the curation so that we can revert

d5256fc39a7608b8a2c62e9bdeffdf8f6dc45c23 authored about 1 year ago

Get add URL working with new approach

6fba473ed4bf934553c0d8a57e3b6fe2468ac29c authored about 1 year ago

Add migrations; remove unused code

d7dbb9fda6739efbd11653e2719d546c73289e76 authored about 1 year ago

Use new curation class in activity feed

e149645bab1520fda06f4d1dbde8b557cf09d52d authored about 1 year ago

Store curations to index

05157d674833d935a6ddbf7cfd99388483702ef5 authored about 1 year ago

Save curations

a5fffc9191ef77f1f3bce2a193f41a85021c1452 authored about 1 year ago

Rename parameter

71323d997ba184a1c4f22656cc5f4697438ecc31 authored about 1 year ago

Fix bug with state = 1

a111d0ffbca71fc73a0c949b6c7943dd462a53c1 authored about 1 year ago

Keep track of source

650a62fe89cca3cf2615a6e33f58db87c0e8cfa8 authored about 1 year ago

WIP: change UI so approve button moves item to the top

31dd988da13c6a098b0f364d8abfc54374656668 authored about 1 year ago

Include inputs in results so we can use htmx

1ed8d0cfc00dceecd56c448d45545b90ae757ac5 authored about 1 year ago

Get more curations

082a8771adc7c858d2e2012f7e498c311908375f authored about 1 year ago

Add donate link

90fef578c47203e852b95c5ee716d5a525a21fd5 authored about 1 year ago

Allow reordering results after the extension has loaded new ones

3cfe14c76b984d622a4f8c30e838392cee9390e3 authored about 1 year ago

Block another site

dbec0c4e3b2088e02d270c9029826f979ab026bc authored about 1 year ago

Merge pull request #132 from mwmbl/allow-sending-links-only

Allow items that are not to be indexed but only used for links

c9792163b19e6f8aba3a43bb5a7ca4ae1e62a30a authored about 1 year ago

Allow items that are not to be indexed but only used for links

abb378c4028259386b2b6e3799018c7fe678c03b authored about 1 year ago

Don't be strict on scoring for additional items

563e6b57cb64a1246b15288d6d0ab40cea228dc5 authored about 1 year ago