Mwmbl - a non-profit search engine commits | Ecosyste.ms: OpenCollective

delay slide jumps a few ms

github.com/mwmbl/presentation - 282680e1635b13734a7fc39693fc054aac564414 authored about 2 years ago

Fix pyproject.toml

github.com/mwmbl/crawler-script - c5d2f3b6cfe6800a376e2dbfc404ad46f3d7b52d authored about 2 years ago

add jump-to-slide to help overlay, style tweaks

github.com/mwmbl/presentation - 79e9fdf13f2cb501cc7f29db71497a2141fcfca0 authored about 2 years ago

adds jump-to-slide, press G to activate

github.com/mwmbl/presentation - d146c1ddc1106a50b3013ae32b86953fac19f453 authored about 2 years ago

Create a custom URL queue

github.com/mwmbl/mwmbl - 603fcd4eb2b707a1df3f2baf2f12838cc22e89e4 authored about 2 years ago

Return updated URLs

github.com/mwmbl/mwmbl - 01f08fd88d5205930635c7920541f2171139192a authored about 2 years ago

Use a threadpool instead of a process pool

github.com/mwmbl/crawler-script - 24ae505c86aa2c408abc61f89e8822f1a478380e authored about 2 years ago

Enable multi-process crawling

github.com/mwmbl/crawler-script - c12c794c5ba2b62cb03031ae22ec8ba5214ada0c authored about 2 years ago

Send a batch if it gets interrupted

github.com/mwmbl/crawler-script - b85ac4a5970027dd9e4edd64c12dd5e5d4cc8888 authored about 2 years ago

Add poetry files

github.com/mwmbl/crawler-script - 5a913cbfabcc021fdf1b1162a78a7633d1410a66 authored about 2 years ago

Crawler script ready for testing

github.com/mwmbl/crawler-script - 5eb3c14b6703b75b613f24a4d7ca6099110f3b99 authored about 2 years ago

Get and store user ID, send batch

github.com/mwmbl/crawler-script - c4be7e4a3d7343b366017f6b05f6e5023676cb6b authored about 2 years ago

Crawl batch

github.com/mwmbl/crawler-script - af04eec55d73af3a81f0f45f9a80ee20192468ef authored about 2 years ago

Get links

github.com/mwmbl/crawler-script - 1f06c5d5127f8511d3c248cd07b37e3f2ea30b65 authored about 2 years ago

Check robots.txt

github.com/mwmbl/crawler-script - 4dcc922114ff87b5672df5c8da55749f57896cde authored about 2 years ago

spec updates

github.com/mwmbl/presentation - a815c7d2696f2d68d767217db3aaf180ef92c47f authored about 2 years ago

audit fix

github.com/mwmbl/presentation - 2eb6d1e71c1b72235c6140821538e01643710900 authored about 2 years ago

run tests in node 14

github.com/mwmbl/presentation - 6378df47c0e660d043a079dde9cecf2439d8883d authored about 2 years ago

Don't try and update an empty list of URLs

github.com/mwmbl/mwmbl - bd0cc3863e7fcbb2472a4f84bceaec121f5a4642 authored about 2 years ago

Update URL queue separately from the other background process to speed it up

github.com/mwmbl/mwmbl - d347a17d634773b827f67615f4b37770eb956eb9 authored about 2 years ago

only test one node version

github.com/mwmbl/presentation - 9f629a9d38bafa62767301d2fbfe16bf5143aa5a authored about 2 years ago

2023

github.com/mwmbl/presentation - df355eca3a68a463a8bdff799a050e2a1419a7d4 authored about 2 years ago

Maximum fetch size and timeout

github.com/mwmbl/crawler-script - 1e7848141f5e1dec561a54419f72294a90a28865 authored about 2 years ago

Store the links with the paragraphs

github.com/mwmbl/crawler-script - 67b6671bceb831503a8b17cbbccf1cac64abd29a authored about 2 years ago

Initial commit

github.com/mwmbl/crawler-script - 94e5891411a76da5ffb64f244de7902c08a27053 authored about 2 years ago

Initial commit

github.com/mwmbl/crawler-script - 6dfebf7f5154bcf63273cd3435d0dbe39cc6c362 authored about 2 years ago

Fix some bugs in URL fetching query

github.com/mwmbl/mwmbl - 7bd12c1ead30242b82ee6cd24e1caf5ea79e43ee authored about 2 years ago

Fix postgres install

github.com/mwmbl/mwmbl - a50f1d8ae35d1c2b391f1675a4aa147594d8f9d2 authored about 2 years ago

Install postgres client

github.com/mwmbl/mwmbl - 1ab16b1fb4c0bf68c9662fdb9efad0eab32ad960 authored about 2 years ago

Add core domains

github.com/mwmbl/mwmbl - dda5a25ad0484e0891ebb4cb9cd75b0cc06371d8 authored about 2 years ago

Exclude google plus

github.com/mwmbl/mwmbl - ab37bbe0a5f5d2c135581059d2acd2eedcb45381 authored about 2 years ago

Post links that don't just occur in good paragraphs

github.com/mwmbl/crawler-extension - e03258f55ee78716249ef63076ddb565dacd3393 authored about 2 years ago

Allow posting extra links with lower score weighting

github.com/mwmbl/mwmbl - 2336ed7f7d05bc9a070824aa2af3753ac1d7d382 authored about 2 years ago

Check the domain is correct, potential bug in psql

github.com/mwmbl/mwmbl - 6edf48693b7e8bbef524ef23a4b1b236b4627772 authored about 2 years ago

Tidy, improve logging

github.com/mwmbl/mwmbl - b7984684c9ee6e2641a5292a0b249b6928c1ff83 authored about 2 years ago

Update the URL queue earlier

github.com/mwmbl/mwmbl - 7c14cd99f8336723c44f7d62e3dd60b5e9d1008a authored about 2 years ago

Merge pull request #86 from mwmbl/improve-crawling

Improve crawling

github.com/mwmbl/mwmbl - 0d33b4f68f682c38ca033c493b25d533df295b73 authored about 2 years ago

Reinstate background tasks

github.com/mwmbl/mwmbl - a86e172bf3b93574c1fd2fe2e41413e7074f528c authored about 2 years ago

Get results from other domains

github.com/mwmbl/mwmbl - d9cd3c585b8d3e192a39980293778692011c0f79 authored about 2 years ago

Update URL status

github.com/mwmbl/mwmbl - 77f08d8f0a91e360f66bd17a0cd82553dfcbc2c3 authored about 2 years ago

Sample domains

github.com/mwmbl/mwmbl - 36af579f7cec61bc45bae1a8a8f947e4e8a1a810 authored about 2 years ago

WIP: improve method of getting URLs for crawling

github.com/mwmbl/mwmbl - ea16e7b5cd0207816b62e9b0f2f11b6bf884d374 authored about 2 years ago

WIP: improve method of getting URLs for crawling

github.com/mwmbl/mwmbl - 7dae39b78048e8bbcf03303769b9dbc2362b8e7d authored about 2 years ago

Don't delete an index if the sizes don't match

github.com/mwmbl/mwmbl - c69108cfcc1555a3d386c0734f97b26357c47104 authored about 2 years ago

Number of pages is an int

github.com/mwmbl/mwmbl - bb8a36a612c5764618d1569690a016fdbd76314d authored about 2 years ago

Merge branch 'master' of github.com:mwmbl/mwmbl

github.com/mwmbl/mwmbl - c01129cdb9f7d7658a302f13d2fe14e7e26aa268 authored about 2 years ago

Use the correct storage location in prod

github.com/mwmbl/mwmbl - 26351a10728a7608de825b306f13638d3327fc8d authored about 2 years ago

Merge pull request #83 from omasanori/spacy-deps-rework

Rework installation of spaCy models for clarity

github.com/mwmbl/mwmbl - f3f3831a97d03cc759a43c6d7b81b3a4eb81c9a8 authored about 2 years ago

Rework installation of spaCy models for clarity

- Install the wheel package for compatibility with future pip
- Use `spacy download` for install...

github.com/mwmbl/mwmbl - 71187a393884e4e4a07792f6bd2fd4283a7b28ca authored about 2 years ago

Remove apt command

github.com/mwmbl/mwmbl - d85067ec09310ea38a2fc7d173a9ceedeabeb647 authored about 2 years ago

Put install in correct place

github.com/mwmbl/mwmbl - 1ef60e8d5db39f772b6966e4be968e32f6b12b2f authored about 2 years ago

Install psql client

github.com/mwmbl/mwmbl - 8e613dd36884794b13426278209412416d856aca authored about 2 years ago

Exclude a domain

github.com/mwmbl/mwmbl - 80282cfc7a6d5a8333031f730e72e85fad0912e3 authored about 2 years ago

Format fetched url

github.com/mwmbl/mwmbl - 8676abbc63540528bbed7dc5a2056441c69f0c07 authored about 2 years ago

Bump version

github.com/mwmbl/crawler-extension - 4c6d21dae572e814b59c024e67676928174efe7f authored about 2 years ago

Merge pull request #37 from mwmbl/remove-logging

Remove some logging

github.com/mwmbl/crawler-extension - a1cd8d3ecb842e5cdcaeaed036ee01e352495753 authored about 2 years ago

Remove some logging

github.com/mwmbl/crawler-extension - 822e4e67c81fc449a19685cca06132f6fe6bde25 authored about 2 years ago

Merge pull request #35 from omasanori/accept-language

Specify the Accept-Language field to fetch requests

github.com/mwmbl/crawler-extension - 3cddbe7d0e1b34cfd3bbe780a458114e21a8b3f0 authored about 2 years ago

Specify the Accept-Language field to fetch requests

After multilingual indexing is implemented, the preference should be
configurable. For now, Engl...

github.com/mwmbl/crawler-extension - 6e9f18290dd0445dff79386b97153d420afc5e27 authored about 2 years ago

Update README.md

github.com/mwmbl/mwmbl - 57295846cb3a01573d7d5f9db8f95a7d435abc9d authored about 2 years ago

Add endpoint to fetch a URL and return title and extract

github.com/mwmbl/mwmbl - 0a4e1e4aee25ad13798603ca14fbbb25ff2c61ef authored about 2 years ago

Implement validation

github.com/mwmbl/mwmbl - c7571120cc6d7669c189869a6f027b7d17b5e673 authored about 2 years ago

Separate out the curation to make it easier to store in a comment

github.com/mwmbl/mwmbl - 061462460b6f33e7b93d1df05d832cf32ebc1497 authored about 2 years ago

Fix serialisation issue

github.com/mwmbl/mwmbl - 6cf27fa47f0bf7879fa0b18bd0d67f2e8aeece83 authored about 2 years ago

Require the whole result

github.com/mwmbl/mwmbl - b559a50506df9879e8863ad22b99577c5ee989eb authored about 2 years ago

Merge branch 'master' into user-registration

github.com/mwmbl/mwmbl - 5eab543f3b11a3d4f2a6dbc9a05dbbb2f162de7e authored about 2 years ago

Rename some parameters; return curation ID

github.com/mwmbl/mwmbl - a88a1a3e95119475288354a5ddb472508f3a5911 authored about 2 years ago

Merge pull request #78 from mwmbl/make-dev-easier

Make it easier to run mwmbl locally

github.com/mwmbl/mwmbl - efc8e8e383a4050289bc0cc80cb621bf7bd235ec authored about 2 years ago

Add curations

github.com/mwmbl/mwmbl - 31c27daca4729ca483f8ce3eb3b5e7bce7b22559 authored about 2 years ago

Create a post when beginning curation

github.com/mwmbl/mwmbl - f89e1d6043119ff0b0dca910d8c881906e3a77a7 authored about 2 years ago

Follow a begin curate/update curation workflow

github.com/mwmbl/mwmbl - eadb7f3e2898ae039c5640ac09c99660914829fe authored about 2 years ago

Suggest using dokku instead of docker directly

github.com/mwmbl/mwmbl - f8ab6092b03e7ef817ab28b3bcce742bc4ab6c51 authored about 2 years ago

Allow login

github.com/mwmbl/mwmbl - 8aa51e548bcae89c5c829c3371041a3aa60e0fc4 authored about 2 years ago

Actually allow registration

github.com/mwmbl/mwmbl - cf6ceedfd55d60bacbf4d6a773bc7a364370faa9 authored about 2 years ago

Make it easier to rum mwmbl locally

github.com/mwmbl/mwmbl - a50bc284362c9591ae7c2b1693499f6b9414058f authored about 2 years ago

Merge pull request #3305 from lolmaus/patch-1

Gulp livereload: include subfolders to watch for changes in html and md

github.com/mwmbl/presentation - 4fe3946cb43de57f79aaa7b646aee7e78f4bcc75 authored about 2 years ago

Merge pull request #3324 from iiska/theme-dracula

Add theme 'dracula'

github.com/mwmbl/presentation - 7fbe03946fee3eeff3e6a3dfcfb8f3d9b5c8ef60 authored about 2 years ago

fix: links opening in the same tab

github.com/mwmbl/front-end - b28dfe49f148f0531ce0baade6a9e0270b8e20c9 authored about 2 years ago

Merge pull request #30 from EchedeyLR/extended-browser-support

Extended browser support

github.com/mwmbl/front-end - 16c25a9f0c95ec55da0bbf32b3c8f28e6db4669a authored about 2 years ago

Changed install to clean-install

github.com/mwmbl/front-end - 30bb48b1309d31592f4d892fadc1d1184b199833 authored about 2 years ago

Start to implement user registration using Lemmy as a back end

github.com/mwmbl/mwmbl - d8d7149f4a131601e62c88e15c1b8e5c326f3874 authored about 2 years ago

Removed / and adapted deployment in GitHub pages

github.com/mwmbl/front-end - c95beb0f065c33ba1f1aeebdb132d0b35b53d23a authored about 2 years ago

Fixed name

github.com/mwmbl/front-end - db05252442c9324c14ad1a4e71f5c549cfc51d6d authored about 2 years ago

Removed unused data and modified name

github.com/mwmbl/front-end - 31cf8c01849a520418c95059738d4cba448c04f4 authored about 2 years ago

Adapted README.md

github.com/mwmbl/front-end - 87f7c2233979b717f8638c2eb85f5a89baa89360 authored about 2 years ago

Added support for older browsers

github.com/mwmbl/front-end - 6c6bdaeeb9f826074ea6efb063ce91395d6a8aa6 authored about 2 years ago

Update matrix badge

github.com/mwmbl/mwmbl - c0f89ba6c3dc86af4e1fcb08038e324cb257aa77 authored about 2 years ago

Exclude an annoying web site

github.com/mwmbl/mwmbl - dd4dd8a75236e498c70d54457c4d262e2606dc7d authored about 2 years ago

Add note about publication date

github.com/mwmbl/book - 16dc9756c4f6043a27a53b357197d04a7b81577c authored about 2 years ago

Link to Mwmbl

github.com/mwmbl/book - 34e83d5df0f2ac0372b1c534aaab680715f45516 authored about 2 years ago

Excessive bolding

github.com/mwmbl/book - f60da58afabb7bd52af97a543920efcb503a05da authored about 2 years ago

Add roadmap subsections

github.com/mwmbl/book - 3255578193f4d3c8ebd3baf5ecc96423d969e962 authored about 2 years ago

Add link to home page

github.com/mwmbl/book - 8b416f16cc223308199cbaecea0d2b2cce379120 authored about 2 years ago

Fix some links

github.com/mwmbl/book - 6409a257a9e47593a49a5c79bd638e558edc72e9 authored about 2 years ago

Add youtube link

github.com/mwmbl/book - 0ec7aa17bcb40888b744d2bce6e6b1017c143b63 authored about 2 years ago

Fix links and Twitter

github.com/mwmbl/book - d50f1e597edea57a921e66d5f7a17b8dabadd215 authored about 2 years ago

Fix carets

github.com/mwmbl/book - 6d399ba0a11d29036920cac57ac4b314021916e5 authored about 2 years ago

Merge pull request #3 from mwmbl/add-working-groups

Add working groups

github.com/mwmbl/book - 9f92bb937beaa5ab978a88b65e1da6943d3f965c authored about 2 years ago

Add working groups

github.com/mwmbl/book - f7b85c5fa3c20e2733bc690a889ff6365879a066 authored about 2 years ago

Merge pull request #2 from mwmbl/intro

Add an introduction to Mwmbl

github.com/mwmbl/book - 8fab16844ff22941d5c9dd30d4689842c248d1cb authored about 2 years ago