github.com/omnivore-app/omnivore commits | Ecosyste.ms: OpenCollective

Fix logging

e06ff24ceaf21f743b08a3c276643d489b213587 authored 12 months ago by Jackson Harper <[email protected]>

Adjust priorities

02818d94a22f93de023b63f8624e1314ec677913 authored 12 months ago by Jackson Harper <[email protected]>

use user provided url for feed added

35805e6e8f5bcf62eea0a66c3dfd17a61eec21ec authored 12 months ago by Hongbo Wu <[email protected]>

Add validation before refreshing feed URLs

84375b7c3602a7ca1425e4c969b3ea44bcd73187 authored 12 months ago by Jackson Harper <[email protected]>

Add some more debug output

2dbff6a6ab274ab9597ab842b01571343e98c006 authored 12 months ago by Jackson Harper <[email protected]>

Improve RSS priorities for refreshing feeds

0e590e53a65e2b853a2d4723ece289d77b3e1613 authored 12 months ago by Jackson Harper <[email protected]>

Merge pull request #3391 from omnivore-app/fix/content-fetch-dockerfile

fix: build content-fetch in dockerfile

d135a7fe6af30750589d6d73110da61e66db626a authored 12 months ago by Hongbo Wu <[email protected]>

Merge pull request #3392 from omnivore-app/fix/backend-svc-endpoint

Fix construction of service endpoint

69541d3e91972321b33a6ded0dad1e4046492e1c authored 12 months ago by Jackson Harper <[email protected]>

fix api endpint

3d42973c5f7b146b804ae027579d2104992bed11 authored 12 months ago by Hongbo Wu <[email protected]>

Fix construction of service endpoint

NEed to fix how we construct all these

f03766d05b1d2652f22ca5ffc6acab472556633b authored 12 months ago by Jackson Harper <[email protected]>

fix pem format

7c25a628d94c217fa661a8dbab0269d3d1ac3741 authored 12 months ago by Hongbo Wu <[email protected]>

create queue on start up

2e8f173879309bf6ac772b8181201c4729adad17 authored 12 months ago by Hongbo Wu <[email protected]>

do not close redis connection

a6d7623cea0fd23939401004346016c6e83020dd authored 12 months ago by Hongbo Wu <[email protected]>

fix: build content-fetch in dockerfile

846d1e3381c5e42c0f50c7c3dfedad894e379001 authored 12 months ago by Hongbo Wu <[email protected]>

Merge pull request #3366 from omnivore-app/feature/separate-fetch-content

feature/separate fetch content

57aca545388904c77716b808cae03cacc56302e6 authored 12 months ago by Hongbo Wu <[email protected]>

validate feed url before adding

c2a084803aab762db09f75398ff7e3b826d7164e authored 12 months ago by Hongbo Wu <[email protected]>

graceful shutdown redis

d2c17f75395706d1915bbe8d1713d2a9e9031c77 authored 12 months ago by Hongbo Wu <[email protected]>

fix tests

3e291d1019a5ce3faec8422980426abdc2106ced authored 12 months ago by Hongbo Wu <[email protected]>

remove debug logs

5136874372b224ac4967b1651fbf1a9ec84b88ca authored 12 months ago by Hongbo Wu <[email protected]>

prioritized jobs

43df5d30a84623cda325fb74483f9331bae09dc5 authored 12 months ago by Hongbo Wu <[email protected]>

convert content-fetch to typescript

d9feb740cb848f664bfe01b2fdfd78f27d4b90a6 authored 12 months ago by Hongbo Wu <[email protected]>

fix dependecies

a03eee5ef7e44579ee910dac761e9bd763124d46 authored 12 months ago by Hongbo Wu <[email protected]>

do not create thumbnail task if the item already has a thumbnail

8a3b50f07f9d221c3f9acfd4cde46ca75d8cd5a6 authored 12 months ago by Hongbo Wu <[email protected]>

remove job id

d4f49dceb65953182c6c4e9df53aae357b48ec41 authored 12 months ago by Hongbo Wu <[email protected]>

feat: group fetch content tasks by url

c297a8dd4e9d6e4f9005c308d3efb5fb03ee472c authored 12 months ago by Hongbo Wu <[email protected]>

separate content-fetch in puppeteer packages from saving page content

51e586ed3dca5b59c1f2097d45692c2300da3718 authored 12 months ago by Hongbo Wu <[email protected]>

fix importer tests

8a91a3c629c090719d8faa626c554742bd8579f8 authored 12 months ago by Hongbo Wu <[email protected]>

rewrite puppeteer in typescript

cd3402b98a79a5a259aa23d52ed7fd68b436731d authored 12 months ago by Hongbo Wu <[email protected]>

add save page job processor

a6f0e2f2d9c22c7c5f180b8044334c67c3fd0b68 authored 12 months ago by Hongbo Wu <[email protected]>

create batch save page jobs after fetching content

0015a946b2e7cc9d76088c932b92612bb84ce9dc authored 12 months ago by Hongbo Wu <[email protected]>

Merge pull request #3389 from omnivore-app/fix/refresh-feed-api-url

Fix endpoint for internal refresh feed API call

3f163a99c7658327c02fa97ac88d8c75e238ef6d authored 12 months ago by Jackson Harper <[email protected]>

Fix checks for env vars

3f707c06f29edf7fc59d3b1ab15bd6ff65a9c8ba authored 12 months ago by Jackson Harper <[email protected]>

Fix endpoint for internal refresh feed API call

This should eventually be replaced.

3b0338967d67eb2f657f350291d06da4faaadfcd authored 12 months ago by Jackson Harper <[email protected]>

Merge pull request #3359 from omnivore-app/feat/backend-bull-job-processor

Use bullmq to process jobs

bffe31bcc7843291ba8c142e1eeeb48882d36e67 authored 12 months ago by Jackson Harper <[email protected]>

Fix typo

6193c7828870d0209f9e23ab552dad916417f2f9 authored 12 months ago by Jackson Harper <[email protected]>

Remove debug

7754139207f5ff30eae2412b4b42530d307ad034 authored 12 months ago by Jackson Harper <[email protected]>

Create new environment variables for tts redis

881a98eb8679415202476847a70685bc0bc53e1e authored 12 months ago by Jackson Harper <[email protected]>

Enqueue new feeds at front

fb28d7b3d15403c0f4843fb104f6f6438819c258 authored 12 months ago by Jackson Harper <[email protected]>

Handle SIGINT in server better by moving DB call to after redis shutdown

ee142d3d7c4b5e99c1ffd19b62bcaa173983dc84 authored 12 months ago by Jackson Harper <[email protected]>

Disconnect one client while quitting the other

bb55137bb4825e583fe6380566673f88008cb9b6 authored 12 months ago by Jackson Harper <[email protected]>

Merge pull request #3385 from se-jaeger/main

Helm Chart for self-hosting

c800114045a4127ac0bf8034bd91ac56d5932dca authored 12 months ago by Jackson Harper <[email protected]>

Tear down redis with disconnect instead of quit

fa685d4a2969d7eab6703313f4ebe15b173c2d9f authored 12 months ago by Jackson Harper <[email protected]>

fix tests

d558fe2b1791bcc0844fa099bf4dbe50e9642f66 authored 12 months ago by Hongbo Wu <[email protected]>

Dont fail whole job if we cant update a subscription group

5a7056b7ec82f07cb408ad08047f73f04a7a0a4f authored 12 months ago by Jackson Harper <[email protected]>

minor improvements

97c1db6e4206e4d4ca579c16cd5435bde3b8c539 authored 12 months ago by Sebastian Jäger <[email protected]>

minor changes and docs

1d4ebb513228c241421ca060f614a47e91b48f8d authored 12 months ago by Sebastian Jäger <[email protected]>

Merge branch 'omnivore-app:main' into main

bce26b9e549ae5fdbde7d7fbeae376fa9e5ae37a authored 12 months ago by Sebastian Jäger <[email protected]>

Use quit when shutting down redis

65347a199628346350b91f823d58e633ef9949b0 authored 12 months ago by Jackson Harper <[email protected]>

Remove server.close call

fd81f65e53dd002a13a801b24efc3e8eaccf1f42 authored 12 months ago by Jackson Harper <[email protected]>

Update error message

9e6b74960455aba5383c9b1a8883ad4dd0c39871 authored 12 months ago by Jackson Harper <[email protected]>

Remove duplicated error

e1e2f86219b57a0cc79145f20c9be04b30923aba authored 12 months ago by Jackson Harper <[email protected]>

REvert some unneeded env changes

dc4126d52c7c588616c6275e18aa48d4ad300906 authored 12 months ago by Jackson Harper <[email protected]>

Remove secrets loading as this is handled by k8s now. Fix redis init

361d57ac1d91c2e90182ed2ca2982b459e6ebbce authored 12 months ago by Jackson Harper <[email protected]>

Remove old code, clean up redis logging

d1438fe800ce653831cefaca513cf96c02b1526a authored 12 months ago by Jackson Harper <[email protected]>

Remove some debug

4f23271f29752fc3bb8f13d36f735ef9049481b7 authored 12 months ago by Jackson Harper <[email protected]>

Clean up redis code, remove connection close in job

7a925f3fdc84eff0c97c986b7d4781a1675150e3 authored 12 months ago by Jackson Harper <[email protected]>

Clean up redis instantiation

d92ee4bcfe9ec0f7aa392f0b33406101a46b3019 authored 12 months ago by Jackson Harper <[email protected]>

More logging

68b7b93586b6827575969ad3cf33dee68a450ba5 authored 12 months ago by Jackson Harper <[email protected]>

Some more logging

ec765c0f5cd2ca543132c2a80e6cfc27a5f7c3bb authored 12 months ago by Jackson Harper <[email protected]>

Remove connect call

0936942378c653509cbeca569b19881409e522f5 authored 12 months ago by Jackson Harper <[email protected]>

Separate worker and client code for redis connections

50b48a4225816fff753f92e879b7543b24f30a35 authored 12 months ago by Jackson Harper <[email protected]>

Simplify connection options

c5e4e2216b9ceca9b52fe87bfbd4579a92243b85 authored 12 months ago by Jackson Harper <[email protected]>

Add logging

49734efec76dd4051eda9458accd972da79fbd24 authored 12 months ago by Jackson Harper <[email protected]>

Fix client imports

7c8304ac155b77e4a4e730273d1767b2639087ec authored 12 months ago by Jackson Harper <[email protected]>

Pull in the newer connection and retry strategy code

7ee3866f348bc65c7e8b55997f979e7c6ccff43b authored 12 months ago by Jackson Harper <[email protected]>

Update job to use ioredis

90a0455c3699be82e9cfc4fb9fd3d0d2e9816e75 authored 12 months ago by Jackson Harper <[email protected]>

Update redis data source

fcf2d07c99d1542851ddea47cde0022467b9385b authored 12 months ago by Jackson Harper <[email protected]>

Clean up post rebase

8580398d6f4875c99f8614087c903d18883d0838 authored 12 months ago by Jackson Harper <[email protected]>

Cleanup after rebase

ba3e5b053d92da78bc15684843cb99d6762ae0ab authored 12 months ago by Jackson Harper <[email protected]>

Some queue admin

f3f9f1a210e8d61365d36f59f8558a2a0e24bd46 authored 12 months ago by Jackson Harper <[email protected]>

Fix for detecting environment

4df9b70c952692f5a6474e25f8d8827cd13b80d5 authored 12 months ago by Jackson Harper <[email protected]>

Fix endpoint

84195f10c2cb02f0833cbf25a6dd79e8287d8dfa authored 12 months ago by Jackson Harper <[email protected]>

Update envar name

9633e7df79281178a957bc42792ecefa2ef06ff6 authored 12 months ago by Jackson Harper <[email protected]>

Fix path

f184c8baff97b8842d8838ffb504a268014df85a authored 12 months ago by Jackson Harper <[email protected]>

MOre on env parsing for k8s

d31d309bc043ac0d036fa1b299a0a541d8b4f804 authored 12 months ago by Jackson Harper <[email protected]>

Add lwn.net to block list

00b72f1c3a6ee0bf3381743aef29c7175779f662 authored 12 months ago by Jackson Harper <[email protected]>

If redis fails assume we need to refetch the item

c7f605d00adedb62c627faa2fcb36ff165349d46 authored 12 months ago by Jackson Harper <[email protected]>

Remove some env vars that are not used

69eb22ae3c211f6abaa0032ed3a2b2d3ed4badf1 authored 12 months ago by Jackson Harper <[email protected]>

Remove azure config from backend

a8e8fe23da6550a13d2f3a9f8ba8c7ebeda13866 authored 12 months ago by Jackson Harper <[email protected]>

Use cloud task function from backend code instead of from rss-handler

26657c561184e91e53c6332fca68fd565f42665e authored 12 months ago by Jackson Harper <[email protected]>

Use createHttpTask for save operation

652f4b6180f81fc5332426aa8765633abd2014b5 authored 12 months ago by Jackson Harper <[email protected]>

Trim URLs from feeds

26d832bb920c91492b9a22b88b164eae36b8d3d3 authored 12 months ago by Jackson Harper <[email protected]>

Add some extra logging

62fdb866a8b7324798db6efadc432f587d17c585 authored 12 months ago by Jackson Harper <[email protected]>

Add more debugging

e050864a9148bba7cacfb03ab178b52daef0fc35 authored 12 months ago by Jackson Harper <[email protected]>

Change around redis initialization so we can pull in secrets from secret manager async on startup

5986bd0a685735d040d0c0381fa24f947a9f3248 authored 12 months ago by Jackson Harper <[email protected]>

Add queue-processor endpoint to the api

819052f51fe4d83cb8feb5ec49f87459a665aeb2 authored 12 months ago by Jackson Harper <[email protected]>

Add missing jobs

7aa76b70fecb3aa4d8faafb4e5f42e676666aa63 authored 12 months ago by Jackson Harper <[email protected]>

Fix linting

7bb6602454910ec861a0aefad95005f1d06e119e authored 12 months ago by Jackson Harper <[email protected]>

Graceful k8s shutdown

0a82e5721eb159a5dc3af649a0853d73afd49e29 authored 12 months ago by Jackson Harper <[email protected]>

Fix creation of redis clients

b4914f534603a55612d46cf220bca09e72c78a91 authored 12 months ago by Jackson Harper <[email protected]>

Fix init

447bba23ba25730b49d8b8d552695da99689cef7 authored 12 months ago by Jackson Harper <[email protected]>

Parse redis cert on load

20df5c621205ef4da12e9b31a15e8c36c149a3f8 authored 12 months ago by Jackson Harper <[email protected]>

Add bull admin panel

1af4bf69287ecf7c6642a7084988315d7061df97 authored 12 months ago by Jackson Harper <[email protected]>

Update redis config

45fcde8ebc66105c71a4fc3b40aa0cb29c088f8a authored 12 months ago by Jackson Harper <[email protected]>

Add ioredis

b3616af783ced467343caf6eab49595dd3903ec4 authored 12 months ago by Jackson Harper <[email protected]>

Update docker base image

181c0253cb1200fb3ce77ad7b2b8edb3e1cf05f5 authored 12 months ago by Jackson Harper <[email protected]>

Fix cert import

bca68372c9a38fb399a4ad5ae385d4be30c59afe authored 12 months ago by Jackson Harper <[email protected]>

Some redis setup

d29c26d93ba1a255e844d0f149a803a6ffb07599 authored 12 months ago by Jackson Harper <[email protected]>

Better handling of cases when redis isnt configured

b4ce07efd3493f63763fffda3368d1436dd70056 authored 12 months ago by Jackson Harper <[email protected]>

Redis config

d98c2c2cf5660d22e79ca36faac71b6f544fef55 authored 12 months ago by Jackson Harper <[email protected]>