Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/openfoodfacts/openfoodfacts-query

This extracts key product data from MongoDB into a Postgres database to speed up OFF
https://github.com/openfoodfacts/openfoodfacts-query

feat: Add support for new stream name

john-gom opened this pull request 10 days ago

Support new multi-flavour stream name

john-gom opened this issue 10 days ago

chore(deps): bump @mikro-orm/postgresql from 5.7.13 to 6.4.1

dependabot[bot] opened this pull request 14 days ago

chore(deps): bump @mikro-orm/reflection from 5.7.13 to 6.4.0

dependabot[bot] opened this pull request 21 days ago

chore(deps): bump @mikro-orm/postgresql from 5.7.13 to 6.4.0

dependabot[bot] opened this pull request about 1 month ago

fix: Re-implement changes from PR #104

john-gom opened this pull request about 2 months ago

Create a first API to navigate events

alexgarel opened this issue about 2 months ago

fix: Revert PR104

john-gom opened this pull request about 2 months ago

ci: Create github-projects.yml

teolemon opened this pull request about 2 months ago

fix: Always update product for redis events

john-gom opened this pull request about 2 months ago

Always update product for Redis events

john-gom opened this issue about 2 months ago

More documentation on how it works and troubleshooting

john-gom opened this issue 3 months ago

Fix data for non-standard product codes

john-gom opened this issue 3 months ago

Store products for other product types (OBF, OPF and OPPF)

john-gom opened this issue 3 months ago

Ensure that pro-platform events are not added to the main product history

john-gom opened this issue 3 months ago

Stopped processing events and did not restart

john-gom opened this issue 3 months ago

chore(deps): bump @mikro-orm/postgresql from 5.7.13 to 6.3.13

dependabot[bot] opened this pull request 3 months ago

chore(deps): bump @mikro-orm/postgresql from 5.7.13 to 6.3.11

dependabot[bot] opened this pull request 3 months ago

chore(deps): bump @mikro-orm/postgresql from 5.7.13 to 6.3.10

dependabot[bot] opened this pull request 3 months ago

chore(deps): bump the npm_and_yarn group across 1 directory with 8 updates

dependabot[bot] opened this pull request 3 months ago

chore(deps): bump @nestjs/schedule from 4.0.0 to 4.1.1

dependabot[bot] opened this pull request 3 months ago

fix: Try setting permissions instead

john-gom opened this pull request 3 months ago

fix: Get 403 errors when pushing from dependabot

john-gom opened this pull request 3 months ago

Add memory limits on off-query services

raphael0202 opened this issue 3 months ago

fix: Don't limit select to obsolete / not obsolete

john-gom opened this pull request 3 months ago

fix: Does not recognise deletions when loading data from events

john-gom opened this pull request 3 months ago

Does not deal with product deletions

john-gom opened this issue 3 months ago

chore(deps): bump the npm_and_yarn group with 8 updates

dependabot[bot] opened this pull request 3 months ago

chore(deps): bump @nestjs/schedule from 4.0.0 to 4.1.0

dependabot[bot] opened this pull request 4 months ago

chore(deps): bump @mikro-orm/reflection from 5.7.13 to 6.0.0

dependabot[bot] opened this pull request 4 months ago

chore(deps-dev): bump supertest from 6.3.3 to 7.0.0

dependabot[bot] opened this pull request 4 months ago

chore(deps-dev): bump eslint-config-prettier from 8.8.0 to 9.1.0

dependabot[bot] opened this pull request 4 months ago

chore(deps): bump reflect-metadata from 0.1.13 to 0.1.14

dependabot[bot] opened this pull request 4 months ago

fix: Fix release please

john-gom opened this pull request 4 months ago

fix: Update action versions

john-gom opened this pull request 4 months ago

chore(deps): bump redis from 4.6.11 to 4.7.0

dependabot[bot] opened this pull request 4 months ago

chore(deps-dev): bump @mikro-orm/cli from 5.7.13 to 6.3.8

dependabot[bot] opened this pull request 4 months ago

chore(deps-dev): bump jest and @types/jest

dependabot[bot] opened this pull request 4 months ago

chore(deps-dev): bump @types/node from 18.16.12 to 22.5.4

dependabot[bot] opened this pull request 4 months ago

chore(deps-dev): bump @nestjs/cli from 9.5.0 to 10.4.5

dependabot[bot] opened this pull request 4 months ago

fix: Fix PR naming

john-gom opened this pull request 4 months ago

Bump @types/express from 4.17.17 to 4.17.21

dependabot[bot] opened this pull request 4 months ago

Bump @mikro-orm/migrations from 5.7.13 to 6.3.8

dependabot[bot] opened this pull request 4 months ago

Bump ts-jest from 29.1.0 to 29.2.5

dependabot[bot] opened this pull request 4 months ago

Bump eslint from 8.45.0 to 9.9.1

dependabot[bot] opened this pull request 4 months ago

Bump @testcontainers/postgresql from 10.2.1 to 10.13.0

dependabot[bot] opened this pull request 4 months ago

chore: Update dependabot.yml and CODEOWNERS

john-gom opened this pull request 4 months ago

Bump the npm_and_yarn group across 1 directory with 8 updates

dependabot[bot] opened this pull request 4 months ago

Dump per taxonomy statistics from times to times

alexgarel opened this issue 5 months ago

feat: Log events in a table

john-gom opened this pull request 5 months ago

fix: Prevent errors when there are duplicate product codes

john-gom opened this pull request 5 months ago

Can get errors on import if products have duplicate codes

john-gom opened this issue 5 months ago

fix: Analyze temp table once populated

john-gom opened this pull request 5 months ago

chore: Use shared-services

john-gom opened this pull request 6 months ago

Bump braces from 3.0.2 to 3.0.3

dependabot[bot] opened this pull request 6 months ago

feat: Change ids to integer to use less space

john-gom opened this pull request 6 months ago

feat: Allow shared_buffers and work_mem to be set

john-gom opened this pull request 6 months ago

Switch from json to jsonb

cquest opened this issue 6 months ago

Unconfigured postgresql

cquest opened this issue 6 months ago

Upgrade to postgresql 16

cquest opened this issue 6 months ago

Add a simple way to launch pgtop

alexgarel opened this issue 6 months ago

Transposed staging and production

john-gom opened this pull request 7 months ago

Avoid intermediate commits when importing from Redis

john-gom opened this pull request 7 months ago

Problem with transaction handling

alexgarel opened this issue 7 months ago

Bump express, @nestjs/core, @nestjs/platform-express and @nestjs/testing

dependabot[bot] opened this pull request 8 months ago

Bump ip from 2.0.0 to 2.0.1

dependabot[bot] opened this pull request 8 months ago

ci: new prod deploy

alexgarel opened this pull request 8 months ago

Is there a way to reduce the size of the database ?

teolemon opened this issue 8 months ago

Pass redis url to container

john-gom opened this pull request 10 months ago

Fix environment for deploy

john-gom opened this pull request 10 months ago

chore: always restart in production

alexgarel opened this pull request 10 months ago

Add redis configuration for staging and production

john-gom opened this pull request 10 months ago

Create a openfoodfacts-query for producers data

alexgarel opened this issue 11 months ago

Logs edit events in openfoodfacts-query

alexgarel opened this issue 11 months ago

chore: change prod mongodb address (again)

alexgarel opened this pull request 12 months ago

chore: new mongodb connection through stunnel

alexgarel opened this pull request 12 months ago

Allow log level to be specified

john-gom opened this issue 12 months ago

Skip if already importing and deal with invalid dates

john-gom opened this pull request 12 months ago

Allow time for the Redis testcontainer to start

john-gom opened this pull request about 1 year ago

Support for Ingredients and Redis

john-gom opened this pull request about 1 year ago

Add an OpenAPI file to describe the API

alexgarel opened this issue about 1 year ago

Cope with $in / $nin unknown queries

john-gom opened this pull request about 1 year ago

Handle unknown queries and ignore other arrays in objects correctly

john-gom opened this issue about 1 year ago

Use a different tag to test loaded tags is updated

john-gom opened this pull request about 1 year ago

Add missing tags fields

stephanegigandet opened this issue about 1 year ago

Support $in but not other value objects. Fix NOT on count

john-gom opened this pull request about 1 year ago

Does not cater for $in requests

john-gom opened this issue about 1 year ago

Can run multiple imports concurrently

john-gom opened this issue about 1 year ago

bug: Wrap delete and insert of tags in a transaction

john-gom opened this pull request about 1 year ago

Facets return no data during import

john-gom opened this issue about 1 year ago

bug: Cope with nuls in tags

john-gom opened this pull request about 1 year ago

bug: Can't import data that contains \u0000 characters

john-gom opened this issue about 1 year ago

Support additional tags and query operators

john-gom opened this pull request about 1 year ago

Is the "Recent Changes" page a good use case for openfoodfacts-query ?

teolemon opened this issue about 1 year ago

Bump @babel/traverse from 7.22.8 to 7.23.2

dependabot[bot] opened this pull request about 1 year ago

Fix matching on a product column

john-gom opened this pull request about 1 year ago

feat: Currently a full refresh will result in the service being unavailable

john-gom opened this issue about 1 year ago

feat: Obsolete product handling

john-gom opened this pull request about 1 year ago

add ingredients_original_tags

stephanegigandet opened this issue about 1 year ago

Add select service for testing

john-gom opened this pull request about 1 year ago