github.com/getsolus/ferryd commits | Ecosyste.ms: OpenCollective

core: Remove old fprintf

Signed-off-by: Ikey Doherty <[email protected]>

96ada6b5c09465d79549563e1cf537ee23d5fb45 authored over 7 years ago

Remove testing hax binary

Signed-off-by: Ikey Doherty <[email protected]>

f7f036df748a193ce88318df5ab1ef051423436a authored over 7 years ago

Nuke old broken transcoder test

Signed-off-by: Ikey Doherty <[email protected]>

438aa3643200ab3ec13f867579ae0022bfe07fb0 authored over 7 years ago

We no longer use xzed as libxz leaks like a bucket

Signed-off-by: Ikey Doherty <[email protected]>

9385af3a8cffe24d08df4f2355a03335a5810bd6 authored over 7 years ago

jobs: Fix cap logic to go higher, not lower

Signed-off-by: Ikey Doherty <[email protected]>

e185f2356ebba909d67313c8239df6005f219586 authored over 7 years ago

jobs: Fix derpy assignment to nil pointer

Signed-off-by: Ikey Doherty <[email protected]>

814ffa31cd27ae261c670944b835546e6ae9acb9 authored over 7 years ago

core: Set the job db path again..

Signed-off-by: Ikey Doherty <[email protected]>

9e293262d1785f17a6671588858a3d03fdd4356b authored over 7 years ago

jobs: Avoid the End Times by checking duped UUIDs

Signed-off-by: Ikey Doherty <[email protected]>

c38ecaffeda23cbf60e09401a0f57f4f1ed78d05 authored over 7 years ago

libdb: Add new HasObject accessor to quickly determine if ID exists

Signed-off-by: Ikey Doherty <[email protected]>

5789e9ccc6ab325aa8b11127bcbc0747cb4533d8 authored over 7 years ago

jobs: Utilise random UUID for jobs

Signed-off-by: Ikey Doherty <[email protected]>

71e68ee88050352625282224f7d1dd5ab568ab5e authored over 7 years ago

vendor: Add google/uuid so we don't reinvent rand.

Signed-off-by: Ikey Doherty <[email protected]>

17780df10dc3abf5b40ecf0b1192b87664925687 authored over 7 years ago

jobs: Protect all ops (funneling) with mutex

Signed-off-by: Ikey Doherty <[email protected]>

8eeae329ca84b11baec2c6afa70385a73944ab16 authored over 7 years ago

jobs: Partial port (need mutex, uuid gen)

Signed-off-by: Ikey Doherty <[email protected]>

a5f746998a2e0cb253d7a5c049293d30617fadb5 authored over 7 years ago

Revert "ferryd: Once again, stop jobs from building.."

This reverts commit 8c1779ad0233a2cd4e6f9982fc6a55647396bb82.

We now want jobs building again s...

f6ecf711edbe6adb1011573554674d242e5bb74c authored over 7 years ago

core: Mild unfuckery, make AddPackages work again

Signed-off-by: Ikey Doherty <[email protected]>

35bc64c9b4160d1c6460f6677e6039d52067f418 authored over 7 years ago

ferryd: Once again, stop jobs from building..

Signed-off-by: Ikey Doherty <[email protected]>

8c1779ad0233a2cd4e6f9982fc6a55647396bb82 authored over 7 years ago

core: And more porting..

Signed-off-by: Ikey Doherty <[email protected]>

57c4739e3c24c565a465340445be959203b246d5 authored over 7 years ago

core: Another round of libdb porting

Signed-off-by: Ikey Doherty <[email protected]>

a74b66dc92146226b228e9913d7d04b74ef98e1f authored over 7 years ago

Round 1 of porting to libdb

Signed-off-by: Ikey Doherty <[email protected]>

42934397dceb7438aee6b9a6eeaaf59b30962e6d authored over 7 years ago

Allow all the things to build (and fail) again

Signed-off-by: Ikey Doherty <[email protected]>

c0dec2de43070178393d805f9d47bb5a15a385ec authored over 7 years ago

libdb: Clarify what View() method is really for (syntax sauce.)

Signed-off-by: Ikey Doherty <[email protected]>

adad8fbaac6f2a2f491291a8206a00c041858a8a authored over 7 years ago

libdb: Deleting things. I hear that's kinda cool.

Signed-off-by: Ikey Doherty <[email protected]>

fce879ad3bf024432adea61e013cb76d73678b32 authored over 7 years ago

libdb: Ensure transaction bucket passes batch, and that it works!

Signed-off-by: Ikey Doherty <[email protected]>

b8df8f18f5acccf5f300f8530eee35c690f54f05 authored over 7 years ago

hax: Ensure reversion actually works

Signed-off-by: Ikey Doherty <[email protected]>

ba6e384deae5165944f7f04413961580530a621c authored over 7 years ago

libdb: Implement 'Update' view, using leveldb.Batch

We'll create a temporary clone of ourselves and insert a batch operation
into this clone, so tha...

3872f8e6b326696597681dbd02d9b0f1a605e548 authored over 7 years ago

libdb: Switch to a compound interface to allow read-only API usage

Signed-off-by: Ikey Doherty <[email protected]>

ecac545e7bffb21a92f2ebe8a59b94ac30a4386c authored over 7 years ago

libdb: Mark special bucket notation as off limits for normal keys

Signed-off-by: Ikey Doherty <[email protected]>

bc472ad4d821acc077414fd493be81f56981ee20 authored over 7 years ago

libdb: Ensure we pass a "clean" key back to the API in foreach

Signed-off-by: Ikey Doherty <[email protected]>

57e3ad3e66d42d5fcf4f35ade2c41106ae69e910 authored over 7 years ago

ldb: Add cheeky implicit bucket support

Signed-off-by: Ikey Doherty <[email protected]>

ac35f1cac358aeba337d4e94f27179771792d9d4 authored over 7 years ago

libdb: Cleanup, expose Decode helper, make ForEach work properly

Signed-off-by: Ikey Doherty <[email protected]>

c744f0fbc2e6fd543ad3bc6131cdfd4a1b6af99c authored over 7 years ago

Remove wishful thinking

Signed-off-by: Ikey Doherty <[email protected]>

0d63ba4334811aedf0b1c95ee2543a9db000f601 authored over 7 years ago

libdb: Add new ForEach and ForEachType functions

Signed-off-by: Ikey Doherty <[email protected]>

b9739ba2e80c58fe2eea4397fb0a25c3434a2a30 authored over 7 years ago

libdb: Add GetObject support

Signed-off-by: Ikey Doherty <[email protected]>

b0d78403203e96c5fa0139c9d9cf7f483f4f44fe authored over 7 years ago

hax: Begin (broken) read test

Signed-off-by: Ikey Doherty <[email protected]>

4229177734f1d1d133ae358f12a86172ff3982de authored over 7 years ago

libdb: Use gob encoder to put objects

Signed-off-by: Ikey Doherty <[email protected]>

9b7ee48758e496b023051db47835b35d37bd9b57 authored over 7 years ago

hax: Try using unimplemented APIs

Signed-off-by: Ikey Doherty <[email protected]>

8dc0e0c0d47d93e93c9cab3973c99ee9b83ce9e7 authored over 7 years ago

ldb: Switch to interface instead of proxy

Signed-off-by: Ikey Doherty <[email protected]>

c83f1689b8e0c99980df767994ddf6bfce614b3e authored over 7 years ago

Ignore test path for our DB

Signed-off-by: Ikey Doherty <[email protected]>

6de5c141d786db4b9734c4277cfd59d9e52c390a authored over 7 years ago

libdb: Make things build ™

Signed-off-by: Ikey Doherty <[email protected]>

e73cc51cc00af423678d97bce3e36e4550ef1733 authored over 7 years ago

vendor: Add golang/snappy for goleveldb

Signed-off-by: Ikey Doherty <[email protected]>

e501b8209fd0c6a0078615dd9ed69db3ecaa4b9d authored over 7 years ago

libdb: Start fleshing out leveldb abstraction

Signed-off-by: Ikey Doherty <[email protected]>

93f92b19cf61e4bf989261aafa6bed5eb7880133 authored over 7 years ago

Start new 'hax' binary to test a new 'libdb' abstraction approach

Signed-off-by: Ikey Doherty <[email protected]>

959d03aadc13fc230702402143ae9c978cdf1b58 authored over 7 years ago

vendor: Let's try out syndtr/goleveldb

Signed-off-by: Ikey Doherty <[email protected]>

39a32cd3c64c49ba69e86e8ea4cd3c8e1d7acfa3 authored over 7 years ago

I have EXORCISED the demons

Signed-off-by: Ikey Doherty <[email protected]>

13557aa54f1a4bbd88d1acc71bac2a05f241f7ee authored over 7 years ago

core: Drop even more locks ..

Signed-off-by: Ikey Doherty <[email protected]>

e2d7c9e714c79f2133339860d64ac2d4fb4d31d5 authored over 7 years ago

jobs: Fight the GOMAXPROCS evil

Signed-off-by: Ikey Doherty <[email protected]>

ac59b624c64335cdd4978a88051bc2aa195d5b4a authored over 7 years ago

jobs: Fix more contention with a separate priority jobs database

Signed-off-by: Ikey Doherty <[email protected]>

ceb8b3ea526a9501868e5f90a6157a58068946d2 authored over 7 years ago

jobs: Kill mutex here

Signed-off-by: Ikey Doherty <[email protected]>

29dc879dc80c3a328de9d96a34d6a355b6b61416 authored over 7 years ago

core: Don't re-compute deltas if we already have them

Signed-off-by: Ikey Doherty <[email protected]>

c7355f055db80a9c45f0693f12c05c78db62d707 authored over 7 years ago

jobs: Stop spawning sync jobs from async and hitting deadlock

We've seen deadlocks when we try to go and hit a sync off an async,
so to alleviate this we're d...

cf251b2f7e303cfed4e6083f0fb6e080709d68c0 authored over 7 years ago

core: Add special protection for the Index job with its own lock

The index may only be emitted in a linear fashion by one job at a time,
as we're dealing with th...

aa1b3208de771b0ecea342bde226e322235b6bf1 authored over 7 years ago

core: Ensure each repository has a RWMutex

We protect mutations to the repository with a RWMutex so that we can
stop spawning sync jobs fro...

0351cc8f037f8aca6dbcc3c658822a0c534cdafd authored over 7 years ago

core: Cache all repository objects

Prior to this commit we duplicated much of the repo handling core, now
we can ensure we cache th...

40204d7b622d0a2a62d6f319b243000880f7f224 authored over 7 years ago

Give JobStore it's own database

We're seeing ugly contention issues between the main database (data) and
the job store (transien...

644d5d53d3679192b4aaa03d6045a661f15a5cdb authored over 7 years ago

jobs: Protect store with a job mutex

Signed-off-by: Ikey Doherty <[email protected]>

a77a5201403c441f96da6469b31ab1a8eae6b941 authored over 7 years ago

jobs: Stop async jobs starving sequential queue

Signed-off-by: Ikey Doherty <[email protected]>

7ac486dfa715528b6ee41471c1430d91530eb53c authored over 7 years ago

TODO: Another one bites the dust (and fix markup)

Signed-off-by: Ikey Doherty <[email protected]>

da3fb84ae5006e2af04b8837b388e8ca28bda613 authored over 7 years ago

jobs: When a delta is included successfully, remove the temp file

Signed-off-by: Ikey Doherty <[email protected]>

4d8136646a8c0082c779feccd2efa3255b693256 authored over 7 years ago

jobs: Only cause index emission when deltas are successfully produced

Signed-off-by: Ikey Doherty <[email protected]>

d2eca8f27712f333dc3446f007812b9963cdbf02 authored over 7 years ago

core: Plug in the final DeltaSkipEntry bits

We'll store both the ID and the original DeltaInformation matrix so
that we have full details on...

afca805a2cc0b69ef172097903d1da52afdbc584 authored over 7 years ago

core: Add framework for marking delta failure (not complete)

We'll store a record inside the pool for a failed delta generation attempt,
which will ensure we...

05d863b2d81e634361f9c82358ff38994bfd1c84 authored over 7 years ago

TODO: Mark delta inclusion as now done

Signed-off-by: Ikey Doherty <[email protected]>

4dd8bb7fde92f627265cbf117fd9295fe7cbc1ae authored over 7 years ago

core: Teach index how to emit DeltaPackages for the index

Quite simply we'll look at our Deltas list within the RepoEntry, and
for each one, determine if ...

302b9de8390bbcc20514584bf79ec3912d033cd5 authored over 7 years ago

jobs: Actually include the delta once we've produced it

Signed-off-by: Ikey Doherty <[email protected]>

330b9198507f122711cad1423d44fe0cc651437b authored over 7 years ago

Hook up a new IncludeDelta job to chain through inclusion of .delta.eopkg

This leverages all parts of the API and will utilise the manager to set
up a locked-update-view ...

319ed6849f4089fb5f8f9d07bffb8ef6fde9d9c6 authored over 7 years ago

core: Add Repo AddDelta code and pass through DeltaInformation in chain

We'll need to take the DeltaInformation from the original caller, as
it requires knowledge of th...

0336a5d83edffb06e6a5ae5b583b8825f705b9ec authored over 7 years ago

core: Stuff a DeltaInformation specifier in delta pool entries

This adds support to the pool for .delta.eopkg files, which simply
just need to retain the FromR...

643c5dfa444e0abab4512e3fae2c9f55886e6256 authored over 7 years ago

core: Rework delta API to pass on error and delta path

The delta functions will now return relevant data back onto the main
DeltaJob API so they can (e...

0d313a5ae45bfb3e9e6a7064ea8da608d094bbc7 authored over 7 years ago

core: Expose a delta staging tree alongside delta build tree

The delta staging tree is where freshly produced delta packages will
be placed, after leaving th...

3d2abbce1283b4e25ad778773b5a15925be76a3f authored over 7 years ago

core: Use a sane path for delta production, not random directories.

Signed-off-by: Ikey Doherty <[email protected]>

a7ddd13cb0d2b4d9f6430e371293e7d0bb01caa3 authored over 7 years ago

jobs: Hook up the DeltaRepo type handler

Signed-off-by: Ikey Doherty <[email protected]>

379dcac983bdf1452d79ceead92ad946a598b3ef authored over 7 years ago

handlers: Re-enable delta command

Signed-off-by: Ikey Doherty <[email protected]>

7cf29629d7d3c68f945647c949d2ad506a041e42 authored over 7 years ago

TODO: Mark 2 done

Signed-off-by: Ikey Doherty <[email protected]>

82575791947a91743075bf0118c289277c20c976 authored over 7 years ago

jobs: Have Transit queue items Delta+Index

Signed-off-by: Ikey Doherty <[email protected]>

67352fe68c98af9c33f9aedca6b84f9a95240d1b authored over 7 years ago

jobs: Add a new Delta+Index type of job

This job will cause a sequential job (Index) to be adding to the main
sequential queue after hav...

12559ae10e36608fcb0a92fa26bd6f28dea258e9 authored over 7 years ago

jobs: Split delta code into shared code for re-use

Signed-off-by: Ikey Doherty <[email protected]>

3b681aa9aa768dc4a9011555cfcb0b3a3e8a6d97 authored over 7 years ago

jobs: Implement the mass-delta-repo operation

As a design decision to retain simplicity, this call will not directly
cause the repository to b...

97078f5c626e41d29ae9e057f8b3c9a69958df03 authored over 7 years ago

jobs: Be less verbose..

Signed-off-by: Ikey Doherty <[email protected]>

e80d9c2e598d5be80479410bf966713b267ad731 authored over 7 years ago

Print out debug statements

Signed-off-by: Ikey Doherty <[email protected]>

70c964b3eb5307efb8c8b4a4ae07ba8d81e08c3a authored over 7 years ago

jobs: You can be debug.

Signed-off-by: Ikey Doherty <[email protected]>

224edd706b40e25fd4474cfea4a6b3356b95556f authored over 7 years ago

jobs: Might help if we store that so its not nil. >_>

Signed-off-by: Ikey Doherty <[email protected]>

91291b37c6f8eb85fa6112473314e7d6c514ca06 authored over 7 years ago

TODO: Another one bites the dust

Signed-off-by: Ikey Doherty <[email protected]>

e0952ad9e30a122f762160804c0d59a4c4e69f39 authored over 7 years ago

jobs: When we finish processing tram upload, fire off delta job

To save having absurdly complex dependency trees, we'll just schedule
a delta job for each new e...

67b6e5cb5411b8aeb8feb5970d3c4f564e084e0a authored over 7 years ago

Well, that guy is done. :P

Signed-off-by: Ikey Doherty <[email protected]>

e0ccf11d41bd3bc6b6ad0df47bad9f0df3845d3a authored over 7 years ago

jobs: Record TODO concerns in the delta job

Signed-off-by: Ikey Doherty <[email protected]>

8de366308558e3d927fa00a020f557cdbaf23b7d authored over 7 years ago

jobs: Restore the Delta operation to create deltas on a name

This job is quite simple and will just batch-attempt the creation of a
group of deltas for a giv...

f6eb93cc72787bb5b942cde6035a444d9722b989 authored over 7 years ago

core: Add read-only API to grab a PoolEntry for an ID

Signed-off-by: Ikey Doherty <[email protected]>

acce1bb8e17baaaf8fe11059754e5b43aeb0ca9f authored over 7 years ago

Fix inverted TODO order

Signed-off-by: Ikey Doherty <[email protected]>

e4658b697e8789a4c1086c8ade08751563b1d415 authored over 7 years ago

The priority was a lie

Signed-off-by: Ikey Doherty <[email protected]>

5b140654cb7947a8ebf5be8909d789ddaf6bd3da authored over 7 years ago

Update README with moar stuff

Signed-off-by: Ikey Doherty <[email protected]>

b9dc16d6b21a8648d6e435858fa487146c6cc08a authored over 7 years ago

Whack in a TODO to hack on during my Spotify session

Signed-off-by: Ikey Doherty <[email protected]>

11f850d9b43a66636d16c45cb299b9a04a8aa0c7 authored over 7 years ago

libeopkg: Enforce stable sort for components.xml groups.xml emission

Signed-off-by: Ikey Doherty <[email protected]>

7796937bb0941c083eae7ec72c8f5bc360b8b9c1 authored over 7 years ago

core: Future-proof index with a sha256sum index asset

Signed-off-by: Ikey Doherty <[email protected]>

235f2b8a708bc48923a9364c1a38b2e1af7428ee authored over 7 years ago

libeopkg: Introduce LocalisedField to dedupe, force "en" lang fallback

This ensures we generate an index compatible with eopkg which also honours
the target language o...

7063d47341d6a5ad9b88f6489b64fc5792e02988 authored over 7 years ago

libeopkg: Fix package metadata to have xml:lang working

Signed-off-by: Ikey Doherty <[email protected]>

645c3a700f222e67c2c33cd48691dadc9661c33c authored over 7 years ago

libeopkg: Fix missing namespace in groups/components

Signed-off-by: Ikey Doherty <[email protected]>

19473d41ea7112a93c904ba17e68cc3a6a32053a authored over 7 years ago

Revert "jobs: Fix crazy bug where go GC's the Job between a function call"

This reverts commit 971b625dbaee372bc741dd7dfc5ca3b993f3c674.
I was wrong. :P

81c36d1a00246cf549116616e6c02c729b806066 authored over 7 years ago

jobs: Ensure we don't break revert transaction (Thanks @DataDrake)

Signed-off-by: Ikey Doherty <[email protected]>

16c14559b2d6cbbbc8d5f903513f8cbac2471b59 authored over 7 years ago

jobs: Explicitly copy the ID into our struct so DB doesn't shit itself

Signed-off-by: Ikey Doherty <[email protected]>

dd7b739cee32d8b40fc7c11ad123d9dce9e2f204 authored over 7 years ago

jobs: Don't try deleting paths that no longer exist

Signed-off-by: Ikey Doherty <[email protected]>

85850258120efb5def11531931a8e456b4d6bc28 authored over 7 years ago