github.com/ScoopInstaller/scoopinstaller.github.io-indexer commits

Add XUnit tests for ManifestCrawler

7d7ddc1b82175845fa75524d33a25db134e2da42 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Better abstraction for git repositories to simplify unit tests

757901afd67107eeb1cb0ba837ae617bdaa17237 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Add XUnit tests for ManifestComparer / KeyGenerator

512927e2f95fa31d98e8621be971c9536d681178 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Add XUnit tests for GitHubClient class

ea4e939443fc5e5ba09b70356d2c65319d47a25f authored almost 2 years ago by Gregoire Pailler <[email protected]>

Add XUnit tests for GitRepository class

fd57d6238b203195b21f915b61c063ad1f7ff9bc authored almost 2 years ago by Gregoire Pailler <[email protected]>

Add ScoopSearch.Functions.Tests project

c0a58ebf3709e47e21f79b2274703c0e3f6d4471 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Always suggest var

dc3ae70722a0259c09ab2b90ec813e2a8a18bde4 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Add .DS_Store in gitignore

37f1fd84e3af78767f893e909a4094b2e7d5ca49 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Exclude rasa/scoop-directory (no manifests inside)

d70798e03d9472d5e88df95f13fe806fd4d45e56 authored almost 2 years ago by Grégoire Pailler <[email protected]>

Follow first parent in git history

229a9aaad144191701acdb13fbd906db762d7d54 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Add first commit to the cache

e0411df42fb7eab4e394e91e8ad548db310e7ed4 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Fix an exception when repository is empty

60b4696fb0359843a629d2365f45dd59e120d51b authored almost 2 years ago by Gregoire Pailler <[email protected]>

Use git.exe to build commits cache (~5x faster than LibGit2Sharp)

5e114dc625fa638d073155cccc8e3140fcb6a6b8 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Enable nullable on the project

0eee20fe59c4a94575143d25d06fe95930704473 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Introduce IGitHubClient/GitHubClient

b3ee296da8ca9fb6cbd1143c5a0f8b104ec3b52d authored almost 2 years ago by Gregoire Pailler <[email protected]>

Revert "Parallelize repositories parsing to stay below the 10min execution timeout when parsing large repositories with 50000+ commits"

This reverts commit 299b604e0a1fa8a36715684cc6cd6bfa3cdf1d32.

5395f6080062bc2e2fa605334a6cc039ef0998da authored almost 2 years ago by Gregoire Pailler <[email protected]>

Parallelize repositories parsing to stay below the 10min execution timeout when parsing large repositories with 50000+ commits

299b604e0a1fa8a36715684cc6cd6bfa3cdf1d32 authored almost 2 years ago by Gregoire Pailler <[email protected]>

Update functionTimeout to the maximum to process very large buckets (>15000 manifests)

52d04279a585c9a0c92052436a00354157488eb3 authored almost 2 years ago by Grégoire Pailler <[email protected]>

Exclude frostming repository (no manifests inside)

d37be40568f8da94de80729f6dcd67ceb04d79b4 authored almost 2 years ago by Grégoire Pailler <[email protected]>

Use project instead of solution in dotnet restore and dotnet publish (fix https://github.com/dotnet/core/issues/8194)

3afe016c9ce291702aad45543d6ea6dfd194fa72 authored almost 2 years ago by Grégoire Pailler <[email protected]>

Add support for subdir in buckets (https://github.com/ScoopInstaller/scoopinstaller.github.io/issues/50)

d78c42c0eafc0b167f506acec21ccf68b7b39173 authored almost 2 years ago by Grégoire Pailler <[email protected]>

Update search queries with a range for 2020-2023 to not hit the 1000 results GitHub limit

3d62458e013bfc92117553a530c6f74dd5d43707 authored almost 2 years ago by Grégoire Pailler <[email protected]>

Update GH action versions

526f21abf3f382728d2e5756f0f833e2a9869a7a authored almost 2 years ago by Grégoire Pailler <[email protected]>

CORS Allow all origins

0044abfbe37fd5155f579c759e3673eaacd9e3a6 authored almost 2 years ago by Grégoire Pailler <[email protected]>

Remove useless CORS host "https://scoopinstaller.github.io/scoopinstaller-dev.github.io"

e117e860460b9cfdf3201123c73a8ea436b88356 authored over 2 years ago by Gregoire Pailler <[email protected]>

Add README.md to explain local configuration and functions purposes

6f3db72838c68914ed8c4ee881baa7e3cb5e2b7c authored over 2 years ago by Gregoire Pailler <[email protected]>

Remove proxies.json (not available for V4 Function apps)

5b2d7990ad134c5666095f86fd35e60211cfb8c4 authored over 2 years ago by Gregoire Pailler <[email protected]>

Tweak scoring to get more accurate results ScoopInstaller/scoopinstaller.github.io#21

52d9b51778763778d4d1443119a1eddc77dd3b95 authored over 2 years ago by Gregoire Pailler <[email protected]>

Update CORS because of moving to ScoopInstaller organization. ScoopInstaller/scoopinstaller.github.io#10

c3d8f9b819c891b5915c2b22c1c13bfbc0f70d6f authored over 2 years ago by Gregoire Pailler <[email protected]>

Create a second HttpClient to not follow redirects for ignored buckets

ce76f59534b8c0f43297fe080fae9a2b934b8453 authored almost 3 years ago by Gregoire Pailler <[email protected]>

Use ignore buckets list to ignore searched GitHub buckets only

e3c5dccfca2c16045170467d61d33711c9fb5f32 authored almost 3 years ago by Gregoire Pailler <[email protected]>

Manually retrieve stars for repositories not found in GitHub search results

2caea7d2737349c46b9383880e8019a21912cbd8 authored almost 3 years ago by Gregoire Pailler <[email protected]>

Skip non-existent buckets and follow redirections to avoid duplicated buckets

371bbe5a787904a515028d49149e802a3019ab2a authored almost 3 years ago by Gregoire Pailler <[email protected]>

Use include.txt/exclude.txt files from https://github.com/rasa/scoop-directory for extra buckets discovery/sanitization.

a4de27b4cbca2e76b09745d16a45c038843ff9b0 authored almost 3 years ago by Gregoire Pailler <[email protected]>

Exclude https://github.com/rivy/scoop.bucket-scoop.main manually

cb1bae692b1bc22d3ff071b790338649caa4f3fb authored almost 3 years ago by Gregoire Pailler <[email protected]>

Update IgnoredBuckets and ManualBuckets using lists from https://github.com/rasa/scoop-directory

19d1ef95da5964c54874fbbc7ff07b4ad9e81f54 authored almost 3 years ago by Gregoire Pailler <[email protected]>

Merge pull request #6 from ScoopSearch/stable-repos-results

Stable repositories search results

663bfe4103504a87c9a5fc9a1a566381c881404b authored about 3 years ago by Grégoire Pailler <[email protected]>

Use sort criteria and don't parallelize crawling of repositories results pages as it gives inconsistent search results

a509a92f06197d9f734c946603ac8c20b699b430 authored about 3 years ago by Gregoire Pailler <[email protected]>

Log GitHub rate-limit response

3e858ef6e4f98543cea2e1563aab6377f9b9b807 authored about 3 years ago by Gregoire Pailler <[email protected]>

Properly select manifests in "bucket" or root folder and not from any other subfolder

6339de551c3cd7ce1490b4e2e2e3faa0bf629b8a authored about 3 years ago by Gregoire Pailler <[email protected]>

Exclude https://github.com/Ash258/Scoop-GithubActions as it doesn't contain any manifest

39e0777864726b8e02603f5d1c8a5ff2f3905ae7 authored about 3 years ago by Gregoire Pailler <[email protected]>

Don't throw an error when the repository is empty

cc7b0afea60e2afbec4ec3595fc614a8f85e654e authored about 3 years ago by Gregoire Pailler <[email protected]>

Merge pull request #3 from rasa/patch-1

Add more buckets to exclude

b228b0d03652efb3ce9382b6e7ff79e552945cbc authored about 3 years ago by Grégoire Pailler <[email protected]>

Merge pull request #5 from ScoopSearch/gitversion

Generate version number during build and expose it with a new http trigger

78fde86a3e0476ebf08c77e49f625c23862e6164 authored about 3 years ago by Grégoire Pailler <[email protected]>

Retrieve full git history for GitVersion

f0320331be0474ddc15d1fbc53b75194a2e52d76 authored about 3 years ago by Gregoire Pailler <[email protected]>

Add version function to know which version is deployed

ec71d5cf1f81862ddef14890665988d6c4fddc6b authored about 3 years ago by Gregoire Pailler <[email protected]>

Add mainline GitVersion config

+semver:major

38a738627a4d85e13a1e374fa62a43443dd43c11 authored about 3 years ago by Gregoire Pailler <[email protected]>

Merge pull request #4 from ScoopSearch/gh-actions-ubuntu [skip ci]

Replace windows-latest with ubuntu-latest (faster execution) [skip ci]

9863ca3b1b66d00d74229676a3b1abb558e57f4e authored about 3 years ago by Grégoire Pailler <[email protected]>

Replace windows-latest with ubuntu-latest (faster execution)

0bd5495db799a58889e4de80fd8c1e6dd97aeebd authored about 3 years ago by Gregoire Pailler <[email protected]>

Add more buckets to exclude

See https://github.com/rasa/scoop-directory/blob/490672b19e5e374feba1d60be6902b364d4f2636/mainte...

8181e5eb6c24d53521f9655b6f8078f480cec2b2 authored about 3 years ago by Ross Smith II <[email protected]>

Merge pull request #1 from rasa/patch-1

Add other buckets to ignore

abe44bb3f54d0b0d8dee6006d1db8cd9a6928850 authored about 3 years ago by Grégoire Pailler <[email protected]>

Update GH workflow (build main/PR/manual, remove skip ci checks, deploy only for pushes on main)

ff31161f33bc1a5ecea51e11ce5f0bf6a96e8790 authored about 3 years ago by Gregoire Pailler <[email protected]>

Merge pull request #2 from ScoopSearch/net60

Convert Azure functions to .NET6 + handle GitHub throttling

75256c7954568f0170ea4b158745bdc6843467cf authored about 3 years ago by Grégoire Pailler <[email protected]>

Install .NET 6.0 during CI

300591a0c94c28add493630e12ddd68edad37927 authored about 3 years ago by Gregoire Pailler <[email protected]>

Properly handle GitHub throttling

9a5870571046e4d19c68f413d04bde43e6067f3a authored about 3 years ago by Gregoire Pailler <[email protected]>

Replace Task.WhenAll and manual tasks creation with Parallel.ForEachAsync

27ea09b8d5a1bcf00f39f1b12f1df0036c5b365c authored about 3 years ago by Gregoire Pailler <[email protected]>

Replace deprecated SHA1Managed with SHA1

2dec8ad16a62f1d70052054432c612937f58f049 authored about 3 years ago by Gregoire Pailler <[email protected]>

Split search queries as GitHub search API returns at most 1000 results

eb219ee157e58aa364813401269c6a74c739f24d authored about 3 years ago by Gregoire Pailler <[email protected]>

Upgrade to .NET 6.0

b82272abc25e2a99fa3ae6b5264d556a5c27ec66 authored about 3 years ago by Gregoire Pailler <[email protected]>

Add other buckets to ignore

Per https://github.com/rasa/scoop-directory/blob/331a47207e419d1e07d85f5b9421bb271eaade91/mainte...

b4d9c3cc16e60c3736e5baec623cf5f8bfdc3063 authored about 3 years ago by Ross Smith II <[email protected]>

Increase boost to get official and most starred repositories first

20ae3374713b6478150d053b3ebcd58395b2ccf3 authored over 4 years ago by Gregoire Pailler <[email protected]>

Rename index fields NameNormalized -> NameSortable and NameStandard -> name

40ef0d1ced1fe2f02086e46860ac6dac3efc39f2 authored over 4 years ago by Gregoire Pailler <[email protected]>

Exclude duplicated repository

cf1630635537a39953f9846ea780cdd55053b8bb authored over 4 years ago by Gregoire Pailler <[email protected]>

Improve Index for partial and suffix matches. Move Azure Index creation in dedicated class.

34eabb77df25b40cad1b52e2a86f2eb245ca6be2 authored over 4 years ago by Gregoire Pailler <[email protected]>

Revert Parallel.Foreach in GetCommitsCache (no benefit)

43894af7741753c6bb1bad5d361660fcf7bb9e54 authored over 4 years ago by Gregoire Pailler <[email protected]>

Try to force MaxDegreeOfParallelism to improve GetCommitsCache performance

e577623e9781eb255b6b293ace76912202a4a50b authored over 4 years ago by Gregoire Pailler <[email protected]>

Add arguments values in TimingInterceptor

9c9d027de6fa70822253763bfc4f9e5de3f9b0b0 authored over 4 years ago by Gregoire Pailler <[email protected]>

Optimize GetCommitsCache by using Parallel.Foreach. Rename some methods and change log levels

cc5669053d1c4f2bd2ceeaab680df5f7186a25da authored over 4 years ago by Gregoire Pailler <[email protected]>

Optimize DispatchBucketsCrawler execution speed by parallelizing network requests. Add Polly to handle transient errors.

7e5fe475c939b2a9efeffc2a7b213b9ea9ddb0db authored over 4 years ago by Gregoire Pailler <[email protected]>

Update log levels to get proper metrics in Azure function dashboard

105a5453ca379dc3dd3694ae197972b76ab61a58 authored over 4 years ago by Gregoire Pailler <[email protected]>

Clean manual buckets list

007979d13b66891cbf487e4740bca13a70cc0547 authored over 4 years ago by Gregoire Pailler <[email protected]>

Use https://scoopsearch.github.io/ for CORS and proxy

7b6c20449bf8ec079b30441e092d5bcc1fd7cf39 authored over 4 years ago by Gregoire Pailler <[email protected]>

Use TEMP directory to clone repositories (instead of a shared folder) and delete repository at the end

c1daf549248ed6dc6082473f3d8680e01edd03c2 authored over 4 years ago by Gregoire Pailler <[email protected]>

Rename workflow [skip ci]

7fbae111207cdffad54a301ad55f366f057c8538 authored over 4 years ago by Gregoire Pailler <[email protected]>

Tweak hosts.json file

35d3d2c72bd471af4df8d420c495a7159a4cd6fb authored over 4 years ago by Gregoire Pailler <[email protected]>

Move .gitignore to root [skip ci]

ba550f4c2db6c40149c96f7a66908d68994346bf authored over 4 years ago by Gregoire Pailler <[email protected]>

Add skip CI support [skip ci]

33cf37cac977432076f1a1b8d4a21be591f3b130 authored over 4 years ago by Gregoire Pailler <[email protected]>

Create LICENSE

7534a74f232848b6ed1dc6c92ab53acd4e4b8643 authored over 4 years ago by Grégoire Pailler <[email protected]>

Run workflow on any branch but deploy only on main

aca0199bb25f0971b7e54dc7074a7e45e4aabed3 authored over 4 years ago by Gregoire Pailler <[email protected]>

Add Azure function deployment to the workflow

3e7c72b8c6507ea1e6765a5caaa3c9190658960f authored over 4 years ago by Gregoire Pailler <[email protected]>

Add worflow to build function app

e656620616cb5ab9dd72af4c1cfa5d6c169a68e7 authored over 4 years ago by Gregoire Pailler <[email protected]>

Add funding

f0c1d9ba26a5b759842fb5baf5f006766ebdfb7d authored over 4 years ago by Gregoire Pailler <[email protected]>

Add Azure function app

883528f920a690757315830aced78ec13500fe79 authored over 4 years ago by Gregoire Pailler <[email protected]>

Ecosyste.ms: OpenCollective

github.com/ScoopInstaller/scoopinstaller.github.io-indexer