Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

Mwmbl - a non-profit search engine

We're creating an entirely free, ad-free, open source, non-profit web search engine with a focus on technical users
Collective - Host: opensource - https://opencollective.com/mwmbl - Website: https://mwmbl.org - Code: https://github.com/mwmbl

Merge pull request #163 from mwmbl/copy-index-app

Copy index app

github.com/mwmbl/mwmbl - 8c4726fce658e0f449091c4bac369134a87cd16d authored 10 months ago by Daoud Clarke <[email protected]>
Add old migrations

github.com/mwmbl/mwmbl - 8c99cd4419425b79ca0ea7a6393b05e57e69a2e9 authored 10 months ago by Daoud Clarke <[email protected]>
Move more paths to settings

github.com/mwmbl/mwmbl - e83751894a36a79226ea7f100c3b4eafd65eb112 authored 10 months ago by Daoud Clarke <[email protected]>
Revert the index

github.com/mwmbl/mwmbl - b5768d8ce6b83fe9c53a4c65a69e81a4fa48e6ed authored 10 months ago by Daoud Clarke <[email protected]>
Add old index migration

github.com/mwmbl/mwmbl - 52f78cd2cab8d6392f264c4a5c62b58090bd3cc2 authored 10 months ago by Daoud Clarke <[email protected]>
Simplify old index

github.com/mwmbl/mwmbl - f96bd878ca6ffac8895c1d1aa5e7ffb87518d44d authored 10 months ago by Daoud Clarke <[email protected]>
Merge branch 'main' into copy-index-app

github.com/mwmbl/mwmbl - d1d088fc13c2565e04cc8c222f0b110e714c8aca authored 10 months ago by Daoud Clarke <[email protected]>
Merge pull request #162 from mwmbl/update-dependencies

Update dependencies

github.com/mwmbl/mwmbl - d5a531821cf5ee94cf634d64914952126cda1b04 authored 10 months ago by Daoud Clarke <[email protected]>
Merge pull request #109 from PeterDaveHelloKitchen/Dockerfile

Optimize Dockerfile by cleaning up apt cache

github.com/mwmbl/mwmbl - 5a54eddb3a5d5acca37595ed9b5830eac7a3b518 authored 10 months ago by Daoud Clarke <[email protected]>
Update dependencies

github.com/mwmbl/mwmbl - 0800f9bad7e33ff9f92dd95b65b84bf56c1963ba authored 10 months ago by Daoud Clarke <[email protected]>
Merge branch 'main' into copy-index-app

github.com/mwmbl/mwmbl - 0f1d846f4fe0fcd280210b5040f4dd26129555b2 authored 10 months ago by Daoud Clarke <[email protected]>
Merge pull request #161 from mwmbl/delete-domain-scores-when-getting-batches

Delete domain scores when getting batches

github.com/mwmbl/mwmbl - f4ef6235b6fe0849abcbf4a36ff5e34a6b783416 authored 10 months ago by Daoud Clarke <[email protected]>
Delete domain scores when getting batches

github.com/mwmbl/mwmbl - 15bd43eb2fb1041458571c4e9e6a1c14faaa9316 authored 10 months ago by Daoud Clarke <[email protected]>
Update the old index info

github.com/mwmbl/mwmbl - 9719895737ab801ed361ecca0e5a6f46585c597e authored 10 months ago by Daoud Clarke <[email protected]>
Merge pull request #160 from mwmbl/move-queue-update-to-separate-app

Move queue update to separate app

github.com/mwmbl/mwmbl - d671ca129908ba1ea96e43fd5df810dd1c7e2652 authored 10 months ago by Daoud Clarke <[email protected]>
Rename background task update_batches

github.com/mwmbl/mwmbl - 3ccd4ecb56f5642f1e8a2cd438a46118a220e4d6 authored 10 months ago by Daoud Clarke <[email protected]>
Remove run background settings config option

github.com/mwmbl/mwmbl - 56e8aa3e213a10ec2e8bda506cc6c9a4225fbc93 authored 10 months ago by Daoud Clarke <[email protected]>
Delete old URL queue

github.com/mwmbl/mwmbl - c0e1f4d1056eee7d3dcb8064be8b20ea9807d270 authored 10 months ago by Daoud Clarke <[email protected]>
Run URL update as a separate app

github.com/mwmbl/mwmbl - 77a9a03faafbff5df87bbaa5677346ba2b725b6d authored 10 months ago by Daoud Clarke <[email protected]>
WIP: implement Redis-based queue

github.com/mwmbl/mwmbl - 5530d03e2e55e46709476109267cd95fe50882db authored 10 months ago by Daoud Clarke <[email protected]>
Merge pull request #159 from mwmbl/copy-index

Copy index

github.com/mwmbl/mwmbl - 6d1e7810c37133fbd742059320d77dbeef27c535 authored 10 months ago by Daoud Clarke <[email protected]>
Add a test for copying pages

github.com/mwmbl/mwmbl - 11d388bfc64859d69dcdba4b56944a8097ed3a84 authored 10 months ago by Daoud Clarke <[email protected]>
Refactor and get pages in the right format

github.com/mwmbl/mwmbl - bc27518596ba63d2a4d84bb8e61f6005fec354b4 authored 10 months ago by Daoud Clarke <[email protected]>
WIP: index pages from old index in new one

github.com/mwmbl/mwmbl - 393ef7e06fa2cc42501524942c48e17c00981aa7 authored 10 months ago by Daoud Clarke <[email protected]>
Merge pull request #157 from mwmbl/catch-exceptions-in-url-queue

Catch exceptions when updating URL queue

github.com/mwmbl/mwmbl - 7b0392e51142cf2b62de07d97c0007994ad148b4 authored 11 months ago by Daoud Clarke <[email protected]>
Catch exceptions when updating URL queue

github.com/mwmbl/mwmbl - a585709d0f76d52aaff8d77938d19509d77f874b authored 11 months ago by Daoud Clarke <[email protected]>
Merge pull request #155 from mwmbl/fix-more-500-re-errors

Ensure Document title and extract are never None

github.com/mwmbl/mwmbl - 684c070f935b73be291bfa5f2898c21b90a91607 authored 11 months ago by Daoud Clarke <[email protected]>
Add a comment explaining what we're doing

github.com/mwmbl/mwmbl - 4ba25a77b4333af4d5b08efb393606e1deb3e682 authored 11 months ago by Daoud Clarke <[email protected]>
Ensure Document title and extract are never None

github.com/mwmbl/mwmbl - f01ae42f6b7fdeadb3d99f58cf07d0c9e19c2b50 authored 11 months ago by Daoud Clarke <[email protected]>
Merge pull request #154 from mwmbl/fix-500s-due-to-nones

Handle the case where title or extract are None

github.com/mwmbl/mwmbl - 423c808d4935d4813a16e2d89a04291b3ee6864d authored 11 months ago by Daoud Clarke <[email protected]>
Handle the case where title or extract are None

github.com/mwmbl/mwmbl - 67c519230e46c69aa1d20cdeb5e069be268cccc4 authored 11 months ago by Daoud Clarke <[email protected]>
Merge pull request #153 from mwmbl/extra-logging-for-re-error

Better logging for confusing error

github.com/mwmbl/mwmbl - b26576a7f9c13abf9b21d1ddf20c404427c6a587 authored 11 months ago by Daoud Clarke <[email protected]>
Better logging for confusing error

github.com/mwmbl/mwmbl - 0477c27da9d4a8f056a5551333c1b8679136362e authored 11 months ago by Daoud Clarke <[email protected]>
Merge pull request #152 from diagonalo/main

Add codeberg.org mirror workflow

github.com/mwmbl/mwmbl - b06927f3aeb8dce4c6afd7fce5c2a42c81875b33 authored 11 months ago by Daoud Clarke <[email protected]>
Merge pull request #8 from mwmbl/fix-docker-file

Fix docker file

github.com/mwmbl/crawler-script - bc1a37d4d0b06a8462b4d07a8b38dd8193d381ed authored 11 months ago by Daoud Clarke <[email protected]>
Fix Dockerfile

github.com/mwmbl/crawler-script - e0345bda1f9f3b8b1086c6bda587b3a28a47b5bf authored 11 months ago by Daoud Clarke <[email protected]>
Remove cronjob from codeberg-mirror workflow

github.com/mwmbl/mwmbl - e7dc535459b9aa041f56ff76de8c7b8b631241a7 authored 12 months ago by Diagonalo <[email protected]>
Add codeberg.org mirror

github.com/mwmbl/mwmbl - 7531d694d3fe533c1732a40ba2361262900f1563 authored 12 months ago by Diagonalo <[email protected]>
Merge pull request #150 from mwmbl/fix-multithreading-decompression-errors

Don't allow the same compressor/decompressor to be used from multiple…

github.com/mwmbl/mwmbl - d98787ca0f061281092d1c5630859a5a599237d5 authored 12 months ago by Daoud Clarke <[email protected]>
Don't allow the same compressor/decompressor to be used from multiple threads

github.com/mwmbl/mwmbl - 87825125e6edee346f4580083f050efe2555cc4d authored 12 months ago by Daoud Clarke <[email protected]>
Merge pull request #148 from diagonalo/readme-update

Change installation instructions to link to book.mwmbl.org

github.com/mwmbl/mwmbl - eadbe535e4afc0d0ea070ab4341917aa2e696703 authored 12 months ago by Daoud Clarke <[email protected]>
Merge pull request #9 from diagonalo/development-instructions

Update developer instructions

github.com/mwmbl/book - 5d147a34a2305d253096921aecadc06ec0b02471 authored 12 months ago by Daoud Clarke <[email protected]>
Change installation instructions to link to book.mwmbl.org

github.com/mwmbl/mwmbl - e4b79b39d65ad0fc3eef9b0193cb3cf0c6a5d8b6 authored 12 months ago by Diagonalo <[email protected]>
Update developer instructions

github.com/mwmbl/book - a2272099071be4cd411309ab3fbf297431d3c605 authored 12 months ago by Diagonalo <[email protected]>
Merge pull request #146 from diagonalo/redis_env_var

Set default redis url to localhost

github.com/mwmbl/mwmbl - 47d586dd394f205927ccf48de828e6d94182b9e7 authored 12 months ago by Daoud Clarke <[email protected]>
Set default redis url to localhost

github.com/mwmbl/mwmbl - ac34bc8fc084ff66929138b17581c5eb11769d4d authored 12 months ago by Diagonalo <[email protected]>
Add more logging for preprocessing documents

github.com/mwmbl/mwmbl - 74fa8d51e0ee434ae35078f3d5f0c678456ce639 authored 12 months ago by Daoud Clarke <[email protected]>
Improve logging for decompression errors

github.com/mwmbl/mwmbl - 3230149c5858434f1bf96a8db187359f9345f1b5 authored 12 months ago by Daoud Clarke <[email protected]>
faulthandler not working

github.com/mwmbl/mwmbl - d1e33aedad73d2e8427e88cea33ed245edadf2e5 authored 12 months ago by Daoud Clarke <[email protected]>
Use stdout for faulthandler

github.com/mwmbl/mwmbl - d5961a679215f7a697e7d691127dad5901110144 authored 12 months ago by Daoud Clarke <[email protected]>
Change the key in the setting path

github.com/mwmbl/mwmbl - 18881662b90f0c6593f13241f3ae36824bf9456f authored 12 months ago by Daoud Clarke <[email protected]>
Enable fault handler

github.com/mwmbl/mwmbl - 851fe3f45ec44ad31f4fdb0d2839e31b1f20db91 authored 12 months ago by Daoud Clarke <[email protected]>
Merge pull request #143 from mwmbl/use-bloom-filter-instead-of-url-store

Use bloom filter instead of URL store

github.com/mwmbl/mwmbl - e3b9e957dd1a5816e8603f7eac7fd103490ce815 authored 12 months ago by Daoud Clarke <[email protected]>
Fix broken tests

github.com/mwmbl/mwmbl - a76dfea52f15bd5a10830c35965b337b7771c3c8 authored 12 months ago by Daoud Clarke <[email protected]>
Use domain link scores to prioritise URLs to crawl

github.com/mwmbl/mwmbl - cf063e12b14fbe89a8273a747df371af9bf53661 authored 12 months ago by Daoud Clarke <[email protected]>
Update domain links

github.com/mwmbl/mwmbl - b3db857eafa34b66c3057a76807df4e80cd5c441 authored 12 months ago by Daoud Clarke <[email protected]>
No need for URL scores any more

github.com/mwmbl/mwmbl - cdeb4a08c5838172345b9a43111c89d4d1299f02 authored 12 months ago by Daoud Clarke <[email protected]>
WIP: track links from top domains

github.com/mwmbl/mwmbl - ea31d5204b37626da6dec95e58b9bf3d1eb199d6 authored 12 months ago by Daoud Clarke <[email protected]>
Make URLDatabase a context manager

github.com/mwmbl/mwmbl - b8ea3066d4d7eb14c031de0420b7e392d80bb4e3 authored almost 1 year ago by Daoud Clarke <[email protected]>
Track crawled URLs using a bloom filter

github.com/mwmbl/mwmbl - 5782e26763c359c04da0af32e14657974fd59882 authored almost 1 year ago by Daoud Clarke <[email protected]>
Typo

github.com/mwmbl/blog - 913c7c4adb4720d4b818ef474fd7e9178490f148 authored about 1 year ago by Daoud Clarke <[email protected]>
Add financials etc

github.com/mwmbl/blog - 4b581cf2286b958ce5c585925b0038930bc81c52 authored about 1 year ago by Daoud Clarke <[email protected]>
New article on indexing a billion pages

github.com/mwmbl/blog - a2e793508f5b9a5c2edc940b4684a605838e7b97 authored about 1 year ago by Daoud Clarke <[email protected]>
Merge pull request #137 from mwmbl/disable-curation-for-non-logged-in-users

Disable curation for non-logged in users

github.com/mwmbl/mwmbl - e544d45c374c13cdc1a5048dac28b3961d39e7c5 authored about 1 year ago by Daoud Clarke <[email protected]>
Disable curation for non-logged in users

github.com/mwmbl/mwmbl - 0e0b8b49195b05aad41ad134c808876bb70fab88 authored about 1 year ago by Daoud Clarke <[email protected]>
Merge pull request #136 from mwmbl/add-link-to-guidelines

Add guidelines link

github.com/mwmbl/mwmbl - f25808014443da38849349952555bc71655f7f8c authored about 1 year ago by Daoud Clarke <[email protected]>
Add guidelines link

github.com/mwmbl/mwmbl - ac9ed70b5c3d65150a9b3d18cd6226a7aedd3b6c authored about 1 year ago by Daoud Clarke <[email protected]>
Add explanation of why certain queries are not good to curate

github.com/mwmbl/book - 5ad0e63760be3516c54da367f2e7a40198e79871 authored about 1 year ago by Daoud Clarke <[email protected]>
Separate out mis-spellings comment

github.com/mwmbl/book - 4cc0ec7cba172989cc5a9447a87a4fb5844f1551 authored about 1 year ago by Daoud Clarke <[email protected]>
Add guidelines for curating search results

github.com/mwmbl/book - 99c81bd2051b6015d5f1c01878563b8ab91a1fa5 authored about 1 year ago by Daoud Clarke <[email protected]>
Fix argument order again :facepalm:

github.com/mwmbl/mwmbl - ffd24315b9664b5fecbacfc73e1df7b79a09b4b6 authored about 1 year ago by Daoud Clarke <[email protected]>
Fix argument order

github.com/mwmbl/mwmbl - 80100ebb196325cef6aabcd35d54d3a249c88dd1 authored about 1 year ago by Daoud Clarke <[email protected]>
Use fewer batches when updating URLs

github.com/mwmbl/mwmbl - 09ffee046d6e886626ee8dc266cd15f2e3af5901 authored about 1 year ago by Daoud Clarke <[email protected]>
Catch errors parsing URLs

github.com/mwmbl/mwmbl - 09e03427c1cb3d21d2bb71453544154dea6fdbfb authored about 1 year ago by Daoud Clarke <[email protected]>
Merge pull request #135 from mwmbl/fix-extension-for-htmx-based-curation

Fix extension for htmx based curation

github.com/mwmbl/mwmbl - dd2abe38354715b599c379d274f503fb047e02fd authored about 1 year ago by Daoud Clarke <[email protected]>
Copy and use local htmx

github.com/mwmbl/mwmbl - b6aed2c8da3bdb113662cd58c7cb2671e74f70d1 authored about 1 year ago by Daoud Clarke <[email protected]>
Set up a listener to refresh htmx; send the csrf token from the index, not the results returned by the extension

github.com/mwmbl/mwmbl - 75ca46dae5e9f281c89de1179605ac83559f20c4 authored about 1 year ago by Daoud Clarke <[email protected]>
Remove unused save.js code

github.com/mwmbl/mwmbl - ae7e6d26382f8c940ae1c527d4969aaa390f808f authored about 1 year ago by Daoud Clarke <[email protected]>
Merge pull request #134 from mwmbl/htmx-for-curation

Use HTMX for curation

github.com/mwmbl/mwmbl - 02ede46b18795ef42dc01253ebcf771071783dcd authored about 1 year ago by Daoud Clarke <[email protected]>
Add timeout for get request

github.com/mwmbl/mwmbl - d8642e20329ff6350e861fb7a4f9417ea3a52110 authored about 1 year ago by Daoud Clarke <[email protected]>
Remove unused code

github.com/mwmbl/mwmbl - 6dffe37942fec738a95429d066807cc7a1dfd208 authored about 1 year ago by Daoud Clarke <[email protected]>
Replace the right bit of html

github.com/mwmbl/mwmbl - 820b5f80d132b93be3465811089b28eaf4516414 authored about 1 year ago by Daoud Clarke <[email protected]>
Put the form in a better place

github.com/mwmbl/mwmbl - 4fe2dc9e0587f03b7c1602e3928914864782abaa authored about 1 year ago by Daoud Clarke <[email protected]>
Remove some unused code

github.com/mwmbl/mwmbl - bb9911fcc0cccf7d3bd13485cd2b3f4130d126c2 authored about 1 year ago by Daoud Clarke <[email protected]>
Fix document state in reverting curation

github.com/mwmbl/mwmbl - be78d69727c1c1235b48b4e2811652ec5026fc5b authored about 1 year ago by Daoud Clarke <[email protected]>
Remove curation from results from other terms

github.com/mwmbl/mwmbl - 3f41588be4d3e39e238120ad0a10aedb8d8d6b40 authored about 1 year ago by Daoud Clarke <[email protected]>
Fix reversion bugs

github.com/mwmbl/mwmbl - 6d992255e8aae43153edd6ddac432dccebe9adc3 authored about 1 year ago by Daoud Clarke <[email protected]>
Minor UI tweaks

github.com/mwmbl/mwmbl - 1a5cbc9a4b27750ee7473e77ad6256baa8893135 authored about 1 year ago by Daoud Clarke <[email protected]>
Implement revert current curation

github.com/mwmbl/mwmbl - a84570d16cd031c16e2cb8f80d88cd06c1474f63 authored about 1 year ago by Daoud Clarke <[email protected]>
WIP: add revert changes button

github.com/mwmbl/mwmbl - 73e2884e5f77c7ea152e91d96f8c384ba97a9987 authored about 1 year ago by Daoud Clarke <[email protected]>
Add migration for previous commit

github.com/mwmbl/mwmbl - 2a5ee37a57d9f38f1ba8a2287275bb44d99447fc authored about 1 year ago by Daoud Clarke <[email protected]>
Move the add result form to home so that the curation ID is updated appropriately

github.com/mwmbl/mwmbl - 1552b3bd6b16d4ecfc5b2dac67ccc97cc30ec59c authored about 1 year ago by Daoud Clarke <[email protected]>
Store original index state with the curation so that we can revert

github.com/mwmbl/mwmbl - d5256fc39a7608b8a2c62e9bdeffdf8f6dc45c23 authored about 1 year ago by Daoud Clarke <[email protected]>
Get add URL working with new approach

github.com/mwmbl/mwmbl - 6fba473ed4bf934553c0d8a57e3b6fe2468ac29c authored about 1 year ago by Daoud Clarke <[email protected]>
Add migrations; remove unused code

github.com/mwmbl/mwmbl - d7dbb9fda6739efbd11653e2719d546c73289e76 authored about 1 year ago by Daoud Clarke <[email protected]>
Use new curation class in activity feed

github.com/mwmbl/mwmbl - e149645bab1520fda06f4d1dbde8b557cf09d52d authored about 1 year ago by Daoud Clarke <[email protected]>
Store curations to index

github.com/mwmbl/mwmbl - 05157d674833d935a6ddbf7cfd99388483702ef5 authored about 1 year ago by Daoud Clarke <[email protected]>
Save curations

github.com/mwmbl/mwmbl - a5fffc9191ef77f1f3bce2a193f41a85021c1452 authored about 1 year ago by Daoud Clarke <[email protected]>
Rename parameter

github.com/mwmbl/mwmbl - 71323d997ba184a1c4f22656cc5f4697438ecc31 authored about 1 year ago by Daoud Clarke <[email protected]>
Fix bug with state = 1

github.com/mwmbl/mwmbl - a111d0ffbca71fc73a0c949b6c7943dd462a53c1 authored about 1 year ago by Daoud Clarke <[email protected]>