Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/planetary-social/nos-event-service

A service which collects various events to pass them to other Nos services e.g. the notification service.
https://github.com/planetary-social/nos-event-service

Changes to hunt timeout issue

f0140a49b5481acb97127a95c02426bb3a4c7384 authored 10 months ago by Daniel Cadenas <[email protected]>
Update README.md with diagrams

16d31bce846c48cff0d1af96a1ef489ff5947b50 authored 10 months ago by Daniel Cadenas <[email protected]>
Aggregate metric by domain

872eb14f0e237f934a0874bffb1e4fc9c4e3bb87 authored 10 months ago by Daniel Cadenas <[email protected]>
Merge pull request #83 from planetary-social/rate-limit-metrics

Add metrics for rate limits

ff78308584b26beaeab2fccd22e30dd59cb0ad6b authored 10 months ago by Daniel Cadenas <[email protected]>
Add metrics for rate limits

813ffcc1a6bb97a06cb4be086cb4b7a225008cad authored 10 months ago by Daniel Cadenas <[email protected]>
Merge pull request #82 from planetary-social/wait-after-server-close

Correctly identify CLOSED messages and rate limit on them too

841cb775374efc4da1f20e94b2ba63c38a2cada2 authored 11 months ago by Daniel Cadenas <[email protected]>
Deal with rate limit requests from CLOSED too

30aca35e38516b2fef5dd0dc5b6c6fdee33b4a5e authored 11 months ago by Daniel Cadenas <[email protected]>
Correctly identify CLOSED messages and rate limit on them too

25278876f3917aff1cb0fedac077277cfa1bc744 authored 11 months ago by Daniel Cadenas <[email protected]>
Merge pull request #81 from planetary-social/shared-rate-limit-manager

Shared rate limiter for multiple conns

6281d72b7a7ce09abb3d82b4bd683435c8871c4d authored 11 months ago by Daniel Cadenas <[email protected]>
Shared rate limiter for multiple conns

6908f7bac4b0bf0d27496e36af337ad4f8918f71 authored 11 months ago by Daniel Cadenas <[email protected]>
Merge pull request #80 from planetary-social/rate-limit-from-notices

Rate limit from notice warnings

fc26bb4cb22c37539d98980387265d39c4cc74fa authored 11 months ago by Daniel Cadenas <[email protected]>
Move func, remove unused var

dd8515ddeaf45894c0e24b3a916d599fa3dc0c1f authored 11 months ago by Daniel Cadenas <[email protected]>
Rate limit from notice warnings

784fb0eafa80621f2f1b8b3a2b89cec64eb1057b authored 11 months ago by Daniel Cadenas <[email protected]>
Merge pull request #79 from planetary-social/more_validations

More validations and check it before push to queue

c109f067466d429a26be9f4b519855ecafc7e0ed authored 11 months ago by Daniel Cadenas <[email protected]>
Update go.mod

5a7a7c031190179372c7d82cae1ce2321647e0d1 authored 11 months ago by Daniel Cadenas <[email protected]>
Remove unused

d8c44258e5a2b587df1964fc502eb9058c5c247b authored 11 months ago by Daniel Cadenas <[email protected]>
More validations and check it before push to queue

e01114ca666a2b1eba1e69aac270f1f3d2e7270d authored 11 months ago by Daniel Cadenas <[email protected]>
Merge pull request #75 from planetary-social/increase_timeout

Increase timeout

377ee26dee31e4e2d85bbf370fb2d6f20604b34a authored 12 months ago by Daniel Cadenas <[email protected]>
Increase timeout

634c639081ae13dc1f76c051a2bdea52303885f5 authored 12 months ago by Daniel Cadenas <[email protected]>
Merge pull request #74 from planetary-social/handle_closed_messages

Handle closed messages

a73f6b310168832d37967620998c8328496db1dd authored 12 months ago by Daniel Cadenas <[email protected]>
Handle closed messages

46c45b94a60ccafee6215bd52d0907277a9b2664 authored 12 months ago by Daniel Cadenas <[email protected]>
Merge pull request #73 from planetary-social/more-comments

Add more comments

dc8a8514213200363164e2b977fa17d337c7b2f3 authored 12 months ago by Daniel Cadenas <[email protected]>
Add more comments

416330ddf27d8b1c3032c2be7958e474b5215c02 authored 12 months ago by Daniel Cadenas <[email protected]>
Merge pull request #72 from planetary-social/dev-flake

Add flake for local development

523185efb34f77f0d7f71d6b5139194ffd63fbb6 authored almost 1 year ago by Zach <[email protected]>
ignore direnv files

adb8d311b9c27751b4d5ab470b8c29c00dd0f9ab authored almost 1 year ago by Zach Mandeville <[email protected]>
Add flake for local go development

6bb24ad363d260a18388467e409208439e54d077 authored almost 1 year ago by Zach Mandeville <[email protected]>
remove whitespace

27d10a5ad83b1fa641e368ef0f492cd67cad63e1 authored almost 1 year ago by Zach <[email protected]>
fix formatting of param

58d70b236343ac75ef7776fd26db8ea0ed87df0e authored almost 1 year ago by Zach Mandeville <[email protected]>
Add _health endpoint

0049a0866396365e16dd86a2803cbf779df57be1 authored about 1 year ago by zachmandeville <[email protected]>
Merge pull request #70 from planetary-social/deployment-readme

Add deployment to readme

2d6479f8bc947acd1687405ee7bf1c4db031efcc authored about 1 year ago by Zach <[email protected]>
Add deployment to readme

1da020f79a016a3bd2bc990d806c46f89db7adad authored about 1 year ago by Zach Mandeville <[email protected]>
Add internal pubsub description

317dd2240a0927df7ab175e471fdd98fdc551ca8 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Fix all generators getting the same parameters

e5e8bd3b154fc2a64a0607910ae4ea88b646df6e authored about 1 year ago by boreq <[email protected]>
Log messages on TRACE

b63b44a4697afdc9a797cdc284d50f900c1e8bb1 authored about 1 year ago by boreq <[email protected]>
Fix tracking incorrect context

6c45d1eb4c9ac7bf28337cd4c98471afbe9b131d authored about 1 year ago by boreq <[email protected]>
Fix panic in test

16a78cbfc5ac12f3d7191aeb7f2d1f37972d3303 authored about 1 year ago by boreq <[email protected]>
Refactor task tracker

Reduce memory usage by not storing unnecessary data and rename things to
make them easier to und...

14544f9183d079439adc46c266d83b96c7f13a50 authored about 1 year ago by boreq <[email protected]>
Optimize memory usage

Also don't die when there is an error updating tasks.

efbd29f788b14ffac852a6f74ca398f7c0d7343d authored about 1 year ago by boreq <[email protected]>
Fix a data race in tests

efb0d0b2250710de35542271caf132af47b898b9 authored about 1 year ago by boreq <[email protected]>
Clearly log when runners terminate (#63)

c4019fc570887ba9dcb78162cb653eab0dd114f9 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Less aggressive task scheduling (#62)

Most of the time there will be nothing to do anyway.

6105ef92c88f7cf03402d9725aadd14c422b7141 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Reduce logging noise (#61)

1ea85c253938e05e7e757a7fdeea58717df4cc57 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Time window based replication (#60)

6ef1a99c313e09155e3e69eb1fcc1a3153d60de9 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Download events p tagging our users

0a04e992be6571b5085790f8da6f30e135b521a3 authored about 1 year ago by boreq <[email protected]>
Rename file which contains sources

886e5e80e6089c7eee6ffe0a8a30c929c9e6330d authored about 1 year ago by boreq <[email protected]>
Update README.md

59944ce12c1025419e19fe8b1226cd7bd9be7a5d authored about 1 year ago by Filip Borkiewicz <[email protected]>
Add uploading pyroscope metrics

36ba78d6308c015b98d089a8a8c0bcbab44e2c67 authored about 1 year ago by boreq <[email protected]>
Allow transactions to timeout

559ac671a8aea110d24292e39aa48f684166ffe9 authored about 1 year ago by boreq <[email protected]>
Optimize downloader

Due to previous incorrect design assumptions we were running individual
public key queries per r...

c40364463a2b47749bd1a4638375dd5a87c8e091 authored about 1 year ago by boreq <[email protected]>
Promote downloader to the domain

It obviously belongs there and we shouldn't get any funny ideas about
databases in its viccinity.

ae58c855a7b9bb56a5155d0eb4e15b434bc6e9bc authored about 1 year ago by boreq <[email protected]>
Reduce memory usage and number of goroutines when sending events

8e3ceef6f29c67ab70af7b77d94ac9bd37e26d46 authored about 1 year ago by boreq <[email protected]>
Lower timeout when pushing events to relay.nos.social

It is pointless to wait more than a couple of seconds if something is
wrong.

d06acc47f3e3dfec7ce253a3c82af6620a053591 authored about 1 year ago by boreq <[email protected]>
Add a program that uploads all events to a relay

fca9ddb7baa60f368b0317c9c46c09a5331d2ed5 authored about 1 year ago by boreq <[email protected]>
Add and endpoint which can be used for listing events

587986d2bdaae03e40fbd73313e07957374f298a authored about 1 year ago by boreq <[email protected]>
Correct error message

bb53523d0ee2fd21a2689a65d290ffe521433786 authored about 1 year ago by boreq <[email protected]>
Add an endpoint returning the number of followers and followees

The endpoint is:

/public-keys/{hex-public-key}

The response looks like this:

{
"follo...

b5738298930689c838b99e1e0ad684fea36d0191 authored about 1 year ago by boreq <[email protected]>
Registration: allow empty relays, check event kind

3ee0956f9aad233fe3b4841290e1fbed8becad2e authored about 1 year ago by boreq <[email protected]>
Verify events as late as possible

Signature verification is expensive and we get disconnected from relays
a lot.

75151ded34489e4e0a5fa084014a28947cbd6118 authored about 1 year ago by boreq <[email protected]>
Avoid loading events for no reason

c4efea20e58153857746237cde266d0e2b8bc0f5 authored about 1 year ago by boreq <[email protected]>
Fix incorrect left join

We can have entries in public_keys but not contacts_events if the public
key is a followee not a...

083ba8daf6247dde5d13297125f4a6fc26e03457 authored about 1 year ago by boreq <[email protected]>
Optimize GetCurrentContactsEvent

0faa0341cb2401b41e3edb34ad61f1f04210b4a3 authored about 1 year ago by boreq <[email protected]>
Lower max backoff when processing events

d982dfcbce8e776544a3b74855e0d6d5bc0c64f0 authored about 1 year ago by boreq <[email protected]>
Don't push events with malformed p tags to strfry

They will be rejected anyway, our previous error-based method of
detecting this was flawed and s...

1709b19e673dcab58a3f88ea452b21a2aa37a557 authored about 1 year ago by boreq <[email protected]>
Add metrics tracking events sent to our relay

4999121bf76e10c090201f8e595d9ef3914cd75d authored about 1 year ago by boreq <[email protected]>
Add oldest message age metrics

1774ddb664d320a8b1b1ddff558d99534039a924 authored about 1 year ago by boreq <[email protected]>
Give up if relay won't accept malformed events

Some events contain malformed p tags and we do our best to try to scan
them and accept them.

686f55bd8d69effb11b9e801596d076921c1b83d authored about 1 year ago by boreq <[email protected]>
Add an endpoint which returns events

f83a707b5c51a3a1e6c3637cee4e3ec909978f89 authored about 1 year ago by boreq <[email protected]>
Suport registering users using nostr events (#32)

The events have type `6666` and the payload looks like this:

{
"relays": [
...

a47b683d61ccbe7b4e6458066c931eed47ee0af5 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Publish selected event kinds to relay.nos.social (#30)

The idea is to make it work like https://purplepag.es/what.

a973cd2acaed1502b81e658ee2cfd06aa42f5178 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Add metrics for the number of stored events

6b51f0755f9f125ddd71465453d045bf7d9eba71 authored about 1 year ago by boreq <[email protected]>
Document what the service does in the README

652ee062f1edc60ef997dcbc2db538befc125af5 authored about 1 year ago by boreq <[email protected]>
Increase backoff till we fix the disconnections or optimize error handling

664a71519a8656c7149a923835c6b60000f65518 authored about 1 year ago by boreq <[email protected]>
Track auth messages in metrics

ee05c1a03a823e012dd868b93a75f1b344f1ec75 authored about 1 year ago by boreq <[email protected]>
Exponential dial backoff

The idea is to make metrics more readable.

289119c580db75c9c978206ba658eb03512ca951 authored about 1 year ago by boreq <[email protected]>
Track disconnections instead of reconnections

149291e47cba97f23ee223eb4ea6a0e245634e18 authored about 1 year ago by boreq <[email protected]>
Fix embedding url broke equality

db5b25a0c77fdd6f632ef0df63c29cb8925cdd46 authored about 1 year ago by boreq <[email protected]>
Reject malformed urls

76faf4b551552597902e3402e82ff6c18ddb1510 authored about 1 year ago by boreq <[email protected]>
Add a metric to README

ddb2f7730230c928330ff62ca8cde656975ae087 authored about 1 year ago by boreq <[email protected]>
Don't bring down the whole connection on message processing errors

01ea930cfc666657bcffe3cac93aad01a61c4c72 authored about 1 year ago by boreq <[email protected]>
Report number of collected relay addresses

7c05306f4a17fed4b4468c211ba6464d9b57d4f1 authored about 1 year ago by boreq <[email protected]>
Get more recent events, collect metrics more rarely

7c03d63569cdc4020c9ea0b2832f298831877770 authored about 1 year ago by boreq <[email protected]>
Fix checks if addresses are local or private not able to handle ports

14d7ed18d97b4fd1ac3bce86284bd06c34d81ff4 authored about 1 year ago by boreq <[email protected]>
Don't connect to private or loopback addresses

This probably doesn't matter but it is pointless to try to connect to
those.

b64be66906ebdba08c604a97f355e5dab63605b7 authored about 1 year ago by boreq <[email protected]>
Add a metric for number of reconnections

547ab938de1fd4af2aeded7ebb48251688058e08 authored about 1 year ago by boreq <[email protected]>
Document metrics

063961e293eac8ae2d5de96af94db7817acd8704 authored about 1 year ago by boreq <[email protected]>
Normalize relay addresses

2cc60dce66ad68016503e4704d5f8a092350dedc authored about 1 year ago by boreq <[email protected]>
more precise wording in gh action

ebe73406b525638839e019da847f1c30f98e75ec authored about 1 year ago by Zach Mandeville <[email protected]>
Add gh action to build/publish image

56795033f9ca5fe9893f04f6e834f9a0caee628d authored about 1 year ago by Zach Mandeville <[email protected]>
Correct Dockerfile

a3a948c3d93618f1e612fef690ed6b24c69d5f74 authored about 1 year ago by boreq <[email protected]>
Fix relays don't like when we open too many subs (#6)

a60d09d8b56d70347390238a7de9cc3caeff118b authored about 1 year ago by Filip Borkiewicz <[email protected]>
Fix save events from monitored public keys

cdf230e2140410953c3edad2aef34ea740c02276 authored about 1 year ago by boreq <[email protected]>
Merge pull request #4 from planetary-social/metrics

Add more metrics

895a27c8df37c817ef3c61c95edce8eaee08a382 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Add more metrics

14b2e54a05a2d8a7b1cea04b70e6c3b375287394 authored about 1 year ago by boreq <[email protected]>
Merge pull request #3 from planetary-social/download-for-public-keys

Download all events for specified public keys and their contacts.

57e0377c19c8f684201fdf786fa6945e725ff336 authored about 1 year ago by Filip Borkiewicz <[email protected]>
Make building pubsub adapters less confusing

07d750a0a851aa01341c07d4f804040f95acc7c5 authored about 1 year ago by boreq <[email protected]>
Download all events for specified public keys and their contacts

a8f91745a7c984c5c8c2a8398926725b4cf41d2a authored about 1 year ago by boreq <[email protected]>
Update Dockerfile to match the one that nos-crossposting-service uses

a697324e1ad7a4c58eb6a1171e4b65e65dfa36db authored about 1 year ago by boreq <[email protected]>
Remove an unused field

2ccfeccfae2c95f337fedf7c13c3eb73c32fe8d2 authored about 1 year ago by boreq <[email protected]>
Add more bootstrap relays

bab9eab99d0666823540609c4344d6e9eafbc38d authored about 1 year ago by boreq <[email protected]>
Add queue length metrics

9bbfcb7aa38860ed89da07d03adface8d43aeb58 authored about 1 year ago by boreq <[email protected]>