Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/getsolus/ferryd

Fast, safe and reliable transit for the delivery of software updates to users.
https://github.com/getsolus/ferryd

jobs: Abort transit job early if the repo doesn't exist

Signed-off-by: Ikey Doherty <[email protected]>

10483ef23a5e7f0c7cda4220505a718755af59ff authored over 7 years ago by Ikey Doherty <[email protected]>
jobs: Fix segfault in transit job (null pointer)

Signed-off-by: Ikey Doherty <[email protected]>

68dcd23148fed4d20f61bf31fd597beacc2de230 authored over 7 years ago by Ikey Doherty <[email protected]>
Add basic TransitManifest processing job (not complete)

Currently this just ensures that the payload itself is valid, and makes
no attempt to actually i...

a246bceacefe532bf1965311d4949691f7082484 authored over 7 years ago by Ikey Doherty <[email protected]>
Add basic file monitoring infrastructure

The new code will monitor the incoming directory for new .tram-suffixed
regular files upon their...

5f2c66501c66b868ff27eafd26ccd09fc2a14191 authored over 7 years ago by Ikey Doherty <[email protected]>
vendor: Add golang.org/x/sys for x/sys/unix in fsnotify

Signed-off-by: Ikey Doherty <[email protected]>

1868f210ec06a7c58b00740cd4cd3f56fa9acf33 authored over 7 years ago by Ikey Doherty <[email protected]>
Only have a single, global upload directory ("incoming")

It makes no sense to have to monitor multiple paths to do per-repo watches,
when we could just u...

4b4956bfddea66a84e800508097a8f6c641a9fe1 authored over 7 years ago by Ikey Doherty <[email protected]>
Implement the Transit Manifest format

This file is always uploaded by the builder after the eopkg files, in a
reliable order. The mani...

661481758b59003f3f5b8656739a48fe46e48c85 authored over 7 years ago by Ikey Doherty <[email protected]>
vendor: Add BurntSushi/toml for TransitManifest

Signed-off-by: Ikey Doherty <[email protected]>

e99d2683ffaf552769837d90d25036bdf73db88f authored over 7 years ago by Ikey Doherty <[email protected]>
Vendor radu-munteanu/fsnotify

This is an up to date fork of fsnotify that actually supports `in_CLOSE`
events - which we sorel...

ed3dccaea5a1343762a1f0b7d223968870ecef5d authored over 7 years ago by Ikey Doherty <[email protected]>
Restore the ability to index the repo (remotely)

Signed-off-by: Ikey Doherty <[email protected]>

a8bf62f1af556cddd78734ec1442034b777404cf authored over 7 years ago by Ikey Doherty <[email protected]>
ctl: Don't say the construction worked, only the backend will know

Signed-off-by: Ikey Doherty <[email protected]>

cd4209d4e40864664d1d62916a05d82a74428213 authored over 7 years ago by Ikey Doherty <[email protected]>
Ensure we begin the job processor when we start serving

Signed-off-by: Ikey Doherty <[email protected]>

392b66a746c4265158a989836e90011fbac54462 authored over 7 years ago by Ikey Doherty <[email protected]>
Add support for async creation of a repository

Signed-off-by: Ikey Doherty <[email protected]>

2d643e354adae8d0cb0756132d4e07eef70b8668 authored over 7 years ago by Ikey Doherty <[email protected]>
Ensure we stop the job processor on exit

Signed-off-by: Ikey Doherty <[email protected]>

fd3553d3a1148dd7f5f64c82ed532370fb320921 authored over 7 years ago by Ikey Doherty <[email protected]>
Make jobs package work again, make ferryd retain processor

Signed-off-by: Ikey Doherty <[email protected]>

6d598606fb2070e012f4e756c8457dbb49acb914 authored over 7 years ago by Ikey Doherty <[email protected]>
Split most of ferryd into new core subpackage to fix circle imports

Signed-off-by: Ikey Doherty <[email protected]>

14d77de66f480cfb0f2a99667ea06617225ebb3b authored over 7 years ago by Ikey Doherty <[email protected]>
Nuke old, no longer needed

Signed-off-by: Ikey Doherty <[email protected]>

5b48dbaea1107b5dd8280b5e89f27634fdfb42d0 authored over 7 years ago by Ikey Doherty <[email protected]>
daemon: Fix derp

Signed-off-by: Ikey Doherty <[email protected]>

cea0a563711be06a81ac880a335edb99d57fff40 authored over 7 years ago by Ikey Doherty <[email protected]>
Cleanup

Signed-off-by: Ikey Doherty <[email protected]>

35541d02267f42535f9408475d036ab812f9efbd authored over 7 years ago by Ikey Doherty <[email protected]>
Get things building again (mostly)

Signed-off-by: Ikey Doherty <[email protected]>

a3148cb20e88e67025b7dffc646cdca85dc02503 authored over 7 years ago by Ikey Doherty <[email protected]>
Restore old ferryctl API methods

Signed-off-by: Ikey Doherty <[email protected]>

45fc018551ee7c8250f45901c65df10ca43fa713 authored over 7 years ago by Ikey Doherty <[email protected]>
ctl: Nuke ferryd specific code

Signed-off-by: Ikey Doherty <[email protected]>

43ec653cfa18ecdfee46b193837c27baa305f54a authored over 7 years ago by Ikey Doherty <[email protected]>
Move all ferryd private into ferryd and leave libferry clean

Signed-off-by: Ikey Doherty <[email protected]>

d4ce34c3cb586c4934f0a1be3d504a9f321313a4 authored over 7 years ago by Ikey Doherty <[email protected]>
Begin splitting ferryctl from ferryd

Now we have the core functionality in place and the all-important JobProcessor
we can once again...

7b8dcf12aa6134be1bba0770583c5db62c5ec36a authored over 7 years ago by Ikey Doherty <[email protected]>
jobs: Ensure we set the closed state

Signed-off-by: Ikey Doherty <[email protected]>

6f9c031e4c579bb46820a3243f79dd1bfadcb3c3 authored over 7 years ago by Ikey Doherty <[email protected]>
Convert "add" subcommand into job processor based

Signed-off-by: Ikey Doherty <[email protected]>

1c87fa9ff4e77b7743c8548aacd6c357bcda8436 authored over 7 years ago by Ikey Doherty <[email protected]>
Add basic logging to our jobs

Signed-off-by: Ikey Doherty <[email protected]>

793f7878d51ed73696610146f64607fd53ff2609 authored over 7 years ago by Ikey Doherty <[email protected]>
main: Incorporate logrus setup hook

Signed-off-by: Ikey Doherty <[email protected]>

c934bba80f2dfa283784e538933aa7055760a4cc authored over 7 years ago by Ikey Doherty <[email protected]>
jobs: Remove debugs, add -1 handler for job count

Signed-off-by: Ikey Doherty <[email protected]>

ae5f282407398c7cd23cefeef820cb9892b86a7d authored over 7 years ago by Ikey Doherty <[email protected]>
Convert index subcommand to use the job processor

Signed-off-by: Ikey Doherty <[email protected]>

d0bfa55404fa2862681ab9c44bc59243cfa3cf00 authored over 7 years ago by Ikey Doherty <[email protected]>
jobs: Move processor into it's own subpackage and make it work

Signed-off-by: Ikey Doherty <[email protected]>

152ed83c0aba13bb54ae0c05538e5b07f7b93f16 authored over 7 years ago by Ikey Doherty <[email protected]>
Add boilerplate for the new ferry JobProcessor

Many of the jobs in ferry can only performed sequentially, because we're
actually bound by the d...

1a2447e05ebf1896d063c241a1ef27a1a5562eee authored over 7 years ago by Ikey Doherty <[email protected]>
repo: Also create the incoming directory for our monitor stuff

Signed-off-by: Ikey Doherty <[email protected]>

7bc8d10fae53888e3870b92a52e7a46c1581d66d authored over 7 years ago by Ikey Doherty <[email protected]>
repo: Create our asset directory on creation

Signed-off-by: Ikey Doherty <[email protected]>

3c3357f1967d990102ae8cb335ead5c93571af7a authored over 7 years ago by Ikey Doherty <[email protected]>
Fix shitting of pants on null pointer

Signed-off-by: Ikey Doherty <[email protected]>

f8371e9de2c526337a857ccc19f320551da99dd8 authored over 7 years ago by Ikey Doherty <[email protected]>
Line count confirmed, turn off pretty printing..

Signed-off-by: Ikey Doherty <[email protected]>

53369ad4a50c64dd70d4623b63362d2e6874f390 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Emit an index exactly as eopkg was (i.e. be dumber)

Instead of being logical, we'll just spit out a massive warning about
the abandoned packages so ...

e723bf72224d204bd4111a403ba121d74a332ae5 authored over 7 years ago by Ikey Doherty <[email protected]>
repo: Scream VERY FUCKING LOUDLY at duplicate release numbers

Signed-off-by: Ikey Doherty <[email protected]>

d241a422fe1133ebbe6b10feec668eda64d6605b authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Add support for Action items

Signed-off-by: Ikey Doherty <[email protected]>

01b2a21704a54dd611541c31ce4f64a66fdf3b04 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Teach index about Replaces/Conflicts

Signed-off-by: Ikey Doherty <[email protected]>

e42729ffa60c6857bc8a7b863ffa697a6e6dd08c authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Thou shalt boogy with the golint

Signed-off-by: Ikey Doherty <[email protected]>

b9e5a38169bf0f8b7cfaced13a9b9d34fde88b95 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Do not include packages in index that depend on obsoletes

Signed-off-by: Ikey Doherty <[email protected]>

770049123c93c452118bbbaaf8078878471dc607 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Include missing field

Signed-off-by: Ikey Doherty <[email protected]>

64acd44b246b194d13d417bf317ceca29341e693 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Don't add unused elements

Signed-off-by: Ikey Doherty <[email protected]>

fd713305cb07990452fa0b7d284bf7910a3820f4 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Skip empty components (lots of them!)

Signed-off-by: Ikey Doherty <[email protected]>

606a2651b4a4a453c406baf1d72d31eb38854439 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Allow empty runtime dependencies

Signed-off-by: Ikey Doherty <[email protected]>

27d1d47102bdda209aaf51e8f0337bf57f1f59b0 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Slightly unfuck that one

Signed-off-by: Ikey Doherty <[email protected]>

536643474d9d0828809db08bea6c0611b5b49699 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Also account for homepage in Source

Signed-off-by: Ikey Doherty <[email protected]>

7a2f4238ed61903b258580046c6601af9d993e86 authored over 7 years ago by Ikey Doherty <[email protected]>
Do not emit obsolete packages in the index

Signed-off-by: Ikey Doherty <[email protected]>

d4007bae36d4c672d94344c3a7270c608635f208 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Strip unnecessary newlines filling up the index

Signed-off-by: Ikey Doherty <[email protected]>

2ea6cbe1ba1214ac17ba7d0f16f0aad4c278a5c7 authored over 7 years ago by Ikey Doherty <[email protected]>
Correcty store Package{Hash,URI,Size} in the index

Signed-off-by: Ikey Doherty <[email protected]>

5684d6bd4427e8d4e779ab04498a4a719cb306fe authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: CDATA the summary/description to prevent Death-By-Go

Signed-off-by: Ikey Doherty <[email protected]>

b2f29fc0cefaf28cd2541cbaaa150fba562e617d authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Add support for Provides (pkgconfig+comar)

Signed-off-by: Ikey Doherty <[email protected]>

390dda8a6535423f88a7ed7ed9321b16126ba884 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Match index output ordering to that of eopkg itself

Signed-off-by: Ikey Doherty <[email protected]>

532f48644384c2df1563e65eb20682b3704f167c authored over 7 years ago by Ikey Doherty <[email protected]>
index: Merge distribution.xml, components.xml and groups.xml in output

This allows the index to be a one stop shop for eopkg to find everything
it needs, and matches t...

6828368526834fb8752430d0edd3ae19df8f8d23 authored over 7 years ago by Ikey Doherty <[email protected]>
util: Fix massive derp

Signed-off-by: Ikey Doherty <[email protected]>

39bff63b673c2ffb4330049b7e40903e9b60160d authored over 7 years ago by Ikey Doherty <[email protected]>
repo: Teach repositories about asset paths

The asset paths will be where we load extra data, such as the .xml files
required for merging in...

c1de5799f9e70e55d5700acf69c1299ddc2ee9bc authored over 7 years ago by Ikey Doherty <[email protected]>
util: Add new helper for determining if a path exists

Signed-off-by: Ikey Doherty <[email protected]>

4a8e507b0e86d9989772e98ccda2e31ec2cf1d97 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Add groups.xml support

Signed-off-by: Ikey Doherty <[email protected]>

da1ca7cf9c7530afdbcc1e0421d95a03b0e44373 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Add support for distribution.xml

Signed-off-by: Ikey Doherty <[email protected]>

88bff69458e75c5daa75f519a3c12e97e5f9d9cb authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Add a new components.xml parser

Signed-off-by: Ikey Doherty <[email protected]>

8d28d870c04c72d4e582f7df5e7908fdb1b744f6 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Don't prettify the index, it's machine-read only

We're only interested in reading as much data in as little time as possible,
so let's cut down o...

6e90f56768a9bdc570ca9817e045d3b7786fb453 authored over 7 years ago by Ikey Doherty <[email protected]>
vendor: Resync

Signed-off-by: Ikey Doherty <[email protected]>

7970b203bcd746f7bc7b242215e556bb025e3863 authored over 7 years ago by Ikey Doherty <[email protected]>
vendor: Sync xzed to underp it (prints, etc)

Signed-off-by: Ikey Doherty <[email protected]>

842ee8fb1a7fad29b14f67ba035833c3f35544a5 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Emit an eopkg-index.xml.xz and eopkg-index.xml.xz.sha1sum file

These are the main repo indexes that a client downloads, as they are obviously
far smaller than ...

ba659fadff88e06d75e54c5c97cecf83481fbd59 authored over 7 years ago by Ikey Doherty <[email protected]>
Include xzed binding for creating .xz files

Signed-off-by: Ikey Doherty <[email protected]>

a8b96fc204b76a681b85ad7eb9bcfb0fa9303439 authored over 7 years ago by Ikey Doherty <[email protected]>
pool: Store each packages sha1sum in the pool entry

Signed-off-by: Ikey Doherty <[email protected]>

4d24f4281c2a5977eb8680136d46b9c4d88e823e authored over 7 years ago by Ikey Doherty <[email protected]>
Add mmap() support for zero-copy hash generation

This speeds up our processing of files for their hashes by mapping them
directly in RAM and pump...

8cb1079811850eb324552a49a6fc22809bf5e019 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Write the oh-so-important sha1sum file

This is required by eopkg to perform update detections, and prevent the
need to constantly downl...

305ac52c84b5b2647d413089a6b31eb1bde1baf4 authored over 7 years ago by Ikey Doherty <[email protected]>
util: Add convenience functions for sha1sum manipulation

Signed-off-by: Ikey Doherty <[email protected]>

9f3cd5669744809b085fd2809855a9a21d14c909 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Make go report card happy using gofmt -s

Signed-off-by: Ikey Doherty <[email protected]>

61cebf306930235988b841cfb798991f00487bbe authored over 7 years ago by Ikey Doherty <[email protected]>
index: Issue repo index updates atomically

A major design flaw with the old binman implementation was rewriting the
eopkg index in place. T...

179fe08509ac56c672bd6fa0b4f814f0ab996ddc authored over 7 years ago by Ikey Doherty <[email protected]>
Remove slow print statements and only hard link our files now

The move from copy to hardlink takes our initial test data run of 23 minutes
for 12,578 eopkgs (...

acff5fc743c0a58d033553ceadeaef3323ce7299 authored over 7 years ago by Ikey Doherty <[email protected]>
Split the main add function from the libeopkg read function

This will allow us to add a simpler batch processing pool by exposing the
database specific code...

f24815c2d099834229a76f4c1b037c9afcb2189e authored over 7 years ago by Ikey Doherty <[email protected]>
index: Do NOT buffer the index emission, it's gonna be too big

Signed-off-by: Ikey Doherty <[email protected]>

9e868395cd68dc597d5c13723af481907a6db549 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Add support for dumping the index out to eopkg-index.xml file

Signed-off-by: Ikey Doherty <[email protected]>

2d656076df49325fcab7f36d4df14a636bca61ad authored over 7 years ago by Ikey Doherty <[email protected]>
Add a new "index" subcommand

Signed-off-by: Ikey Doherty <[email protected]>

09eadac37c16569a6924cffe1602ddc4318fbcf6 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Preserve original raw changelogs by using CDATA

Solus uses very specific changelog formats which need to be preserved
"as is", so we ensure thes...

570966288755ff4a2616fa1bf0245f0d985f5c23 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Now emit (for now) our index to stdout so we can fix it up

Signed-off-by: Ikey Doherty <[email protected]>

f05c251c6c883bac503846bfb89f2f5b97edd465 authored over 7 years ago by Ikey Doherty <[email protected]>
index: Add some basic functions to validate traversal works properly

Signed-off-by: Ikey Doherty <[email protected]>

352467c4057b1083878f8f0725a40ca088ed38de authored over 7 years ago by Ikey Doherty <[email protected]>
pool: Fix corruption issues with reusing gob

Signed-off-by: Ikey Doherty <[email protected]>

7bea5227ff6a5ed8ec164131a0570c102e1c0573 authored over 7 years ago by Ikey Doherty <[email protected]>
Start skeleton for our new Index function

The main purpose of the Index function is to spit out the fresh repository
index from the conten...

637819973365b32857aade9c94281fd01beabcb4 authored over 7 years ago by Ikey Doherty <[email protected]>
Add new lightweight throwaway encoders/decoders

Signed-off-by: Ikey Doherty <[email protected]>

5702ad598897c34bf0334886a97c733d57a2bcdd authored over 7 years ago by Ikey Doherty <[email protected]>
Fix derpy corruption issues

Signed-off-by: Ikey Doherty <[email protected]>

5bf2243ad0f416068b56a59b5560cfc9e7ba2709 authored over 7 years ago by Ikey Doherty <[email protected]>
Add basic add functionality (exposing gob's weaknesses already ..)

Signed-off-by: Ikey Doherty <[email protected]>

720589734d24afd59a6a07652bc0aa703de58ed1 authored over 7 years ago by Ikey Doherty <[email protected]>
repo: Store sub-bucket "package" to allow descended children

Signed-off-by: Ikey Doherty <[email protected]>

8b1770be774e5a57ce12bdc0198e0578f348f196 authored over 7 years ago by Ikey Doherty <[email protected]>
Add basic always-copy pool reffing for "add" subcommand

Signed-off-by: Ikey Doherty <[email protected]>

c5f0ab642aefa0df8574aeb8260ae8c461260082 authored over 7 years ago by Ikey Doherty <[email protected]>
Add some basic parsing of our eopkg to ensure the argument is valid

Signed-off-by: Ikey Doherty <[email protected]>

0f98ae97d97fe039f6d7becbe608dac175b8b9e3 authored over 7 years ago by Ikey Doherty <[email protected]>
libeopkg: Add helpful wrappers for Release + Version fields

Signed-off-by: Ikey Doherty <[email protected]>

3997a327afbf3b479a8ffa102264189ed2b53c6b authored over 7 years ago by Ikey Doherty <[email protected]>
Fix incorrect dir name, validate the repo itself

Signed-off-by: Ikey Doherty <[email protected]>

cbb36723ed95b976bd2a6082bcf8659144c513d9 authored over 7 years ago by Ikey Doherty <[email protected]>
Start working on the new 'add' subcommand

Signed-off-by: Ikey Doherty <[email protected]>

1ab772c443dcd9afefb31a397301dbb39fec72de authored over 7 years ago by Ikey Doherty <[email protected]>
Try to create ferry root directory on startup

Signed-off-by: Ikey Doherty <[email protected]>

4233a50e721056ba28bb3c798fffa893474cc4aa authored over 7 years ago by Ikey Doherty <[email protected]>
Restore create-repo support

Signed-off-by: Ikey Doherty <[email protected]>

2bdf9af7dfe0084391b6af6076fcf961a3bea315 authored over 7 years ago by Ikey Doherty <[email protected]>
Merge the old versioning information into libferry

Signed-off-by: Ikey Doherty <[email protected]>

2e5a70f8e1e4cd68bfb0547aa2cf558db2b97f89 authored over 7 years ago by Ikey Doherty <[email protected]>
Merge slip with libferry to keep things less complicated

Signed-off-by: Ikey Doherty <[email protected]>

da81986beafe22c545bef954eb943deb0de95cef authored over 7 years ago by Ikey Doherty <[email protected]>
Move "ferry" -> "libferry"

Signed-off-by: Ikey Doherty <[email protected]>

161bd43717d0f592fbafa5e6e3211848ae2c5b43 authored over 7 years ago by Ikey Doherty <[email protected]>
Re-absorb slip and ferry libraries in part

Signed-off-by: Ikey Doherty <[email protected]>

e3e08b7641d7655337f4b0b3d069b7c8f4b08feb authored over 7 years ago by Ikey Doherty <[email protected]>
Fix incorrect name

Signed-off-by: Ikey Doherty <[email protected]>

92561ff39b4beb950c091600beb52fdd0ff3969c authored over 7 years ago by Ikey Doherty <[email protected]>
Start working on a drop-in binman replacement ferryd binary

Signed-off-by: Ikey Doherty <[email protected]>

27b9c4db7224d5aee5112bc4735e1a0c531c1c5b authored over 7 years ago by Ikey Doherty <[email protected]>
Move all code to old/ so I can actually work on the internal logic

Signed-off-by: Ikey Doherty <[email protected]>

f848f6aadb067dd43c97653daa6d222eb14a5f03 authored over 7 years ago by Ikey Doherty <[email protected]>