Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/cloud-cv/evalai

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
https://github.com/cloud-cv/evalai

Update autoupdate.yaml (#3956)

18d6ec783070689e125d483c1c773121bf030bda authored over 1 year ago by Gunjan Chhablani <[email protected]>
[Frontend] Fix frontend pagination for challenge list (#3953)

* Add recursive get challenge list method

* Fix recursive call

* Fix challenge list contro...

be3493027ddfa266e33c6b3ed00b143009085b5d authored over 1 year ago by Gunjan Chhablani <[email protected]>
[Worker] Fetch logs for all terminated pods for code upload challenge (#3948)

59013e6c37829a649060653408fb230bae57f141 authored over 1 year ago by Gunjan Chhablani <[email protected]>
[BugFix] Fix representation in submission serializer (#3925)

* Fix submission serializer

* Add case for GET request

* Fix created by for all kinds of r...

a78399d3a74bec70969e1e392e133784ee55d89d authored over 1 year ago by Gunjan Chhablani <[email protected]>
[Backend] Add exception handling for get all challenges API (#3931)

923fbf92a9d08c8659e9c548b28ba8196ffe7578 authored over 1 year ago by Gunjan Chhablani <[email protected]>
[Frontend] Remove upload submission through file URL

56be5298fc84b1e317335c6687425b6e4152cfdb authored over 1 year ago by TriveniBhat <[email protected]>
[Worker] Expose Environment Logs for Challenge Hosts (#3879)

fbfc7f04cf8570704fd41808c0c5f5cfed518505 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Add dangling docker image clean up script (#3887)

6321c2d8a9dfb2f37328818cb18a9e2fff5afcdf authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Backend] Add cpu code upload attributes to serializers (#3886)

* Add changes for ChallengeSerializer

* Expose attributes through ZipChallengeSerializer

7bfa94665be8e59ca7961cf9c98c0f31712003b7 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Backend] Add cpu_only_jobs to serializer (#3885)

d5d011ec4073796b6fb0479f8b450c684128c963 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Worker] Upgrade EKS Kubernetes version (#3878)

19130726790e4cb79b0d2e8603dd6817b16dba69 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Docs] Add docs for static code-upload challenge (#3868)

33a55eab8ed542a941e61aa12b21d57c3571cd79 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Docs] Improve docs for code-upload challenges (#3865)

03fd174c73f6c20e4cb706c2a851ff4214b62af5 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Add statsd env variable to code upload task definition (#3875)

b5252ceebd4aafc212673d2a853192f40d82bd68 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Worker] Update code upload worker requirements (#3874)

6e38d22411c10d750a1f410d5b083d2be96f9532 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Worker] Fix statsd increment import (#3872)

7a5237fbfe0be533bedb48b3573cf43274962a48 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Update limits in EKS auto scaling script (#3870)

* Improve EKS auto scaling script

* Make minimum desired size 1

4a07138dbb5f07dc8a6a74dd79f8b09723280928 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Worker] Fix statsd increment in code-upload challenges (#3871)

* Fix statsd increment in code-upload challenges

* Fix formatting

* Import sort

31897a09f2c77b39f4228955325272b1d131e038 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
Fix auto scaling EKS script (#3869)

caefcf652601bbb5a2a7fdb10b31e899c3e5b8ca authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Use phase split in challenge config validaton (#3859)

7057c5848a3b35d53dea3c932c92dfee2bf9893c authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Add EKS auto scaling (#3864)

3e87f3ae15cdebe63c97f057eddba7c7591ed7cc authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Update attributes for challenge phase split (#3866)

929306048c62f7d569225ed4c06ceb982c6b7e4d authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Deployment] Separate monitoring deployment (#3861)

* Separate monitoring deployment to a new option

* Remove extra space

16e94b38430ab20885bcff40e045f2152ae77819 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Error handling in worker scaling (#3858)

baec1563969a8326bf5c79bfcf64b6e198883054 authored almost 2 years ago by matthew-so <[email protected]>
[Docs] Fix typo in remote evaluation challenge docs (#3860)

e465e59c760ae910e3000095b581c9b4f4f5a16f authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Frontend[ Show remote evaluation meta on manage tab (#3854)

96fdfd47dac28681d347621e91b3f8019b3802ef authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[Documentation] Add remote challenge evaluation setup docs (#3841)

072f47127e120acff26f433321e2d764f3aac3d5 authored almost 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Show leaderboard watermark on staging (#3853)

a5bd073457567ea6ee997150e6230f1960b58a7e authored almost 2 years ago by matthew-so <[email protected]>
[BugFix] Fix worker scaling management (#3851)

* Worker scaling UI implemented. WIP

* Django resource scaling functions documented and refor...

a74ffb81b77d2efe3020c3a83e1082779c04b76d authored almost 2 years ago by matthew-so <[email protected]>
[Backend] Improve checks in validate challenge config API (#3816)

* Add check whether file exists for HTML

* Add addition and deletion validation checks
Add a...

f4b510a55a5e2377d755b70f5a4c1886fdcc68a7 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Worker] Rename worker auto stop script (#3852)

1fc2a246fa7b900af96155be6e979057c1ebdc44 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Support deletion of default meta attributes challenge creation (#3849)

46dae0b66f23a998f80e8005103c1e423a69180c authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Worker] Add python 3.8 worker (#3846)

a4f6c9cb088b2d21ec922abcf720a4ff66669b66 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Frontend] Add worker scaling action on manage tab (#3848)

3b65ac043218a6139182985ebac8cb97ac30936e authored about 2 years ago by matthew-so <[email protected]>
Revert "[Frontend] Add worker scaling action on the manage tab (#3830)" (#3847)

This reverts commit f3e7a5a277db17bcccd9e2563f46fff366f49858.

74de5ed63e04f4b815a4ab0c3626e156b54e31c7 authored about 2 years ago by Ram Ramrakhya <[email protected]>
[Frontend] Add worker scaling action on the manage tab (#3830)

f3e7a5a277db17bcccd9e2563f46fff366f49858 authored about 2 years ago by matthew-so <[email protected]>
[Frontend] Update default resource config note on manage tab (#3840)

f0e628aeeabc0acddc473c6ac33ee73bf963182e authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Frontend] Add watermark to challenge leaderboard (#3786)

10b8259ceed5dfe56dd2dbd2782f9b6bda4aa8af authored about 2 years ago by matthew-so <[email protected]>
[Backend] Show latest 1000 logs from the last 72 hours on manage tab (#3832)

46ee7339f7671543d690e56475c62d92ac65a921 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Frontend] Add note about default resources in the manage page (#3766)

bcb86842c2f6b95d9080ed981d60d0265e390d98 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Frontend] Store email address in lowercase (#3776)

937817fad1efb43a2b44480c5a09229cf48b0404 authored about 2 years ago by Gautam Jajoo <[email protected]>
[Frontend] Show challenge queue name and ID on manage tab (#3831)

0cc3596617403a99da52079025c943060e89ff1b authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Frontend] Assign unique id for meta attributes components (#3821)

def9fb7ebfa207f9f5bd7af2a5be5a30a5919d4e authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Frontend] Revert trix version to 1.3.1

9159875816e48fbab1cd1dae601a114cb49690e0 authored about 2 years ago by Eugene Ilyushin <[email protected]>
[Backend] Support deletion of submission meta attributes

09202ad46e31bd721c3cbb0c2fa31e740cd6d19e authored about 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Datetime parsing in auto scaling script (#3829)

1992d69c954de1505d2ebec046f53497728d2f97 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Fix num_of_tasks variable in task definition args (#3828)

79b1211463fceb2679165c32bf4635ddc82afe92 authored about 2 years ago by Ram Ramrakhya <[email protected]>
Revert "[Backend] Add worker scaling support on Manage tab (#3800)" (#3827)

This reverts commit d67da37c69a8bd7dbb184cf8aa7bbe269295782c.

2469bd8cf2a334c402ed9e9fbcfd1217476b760b authored about 2 years ago by Ram Ramrakhya <[email protected]>
[BugFix] Add num_of_tasks in update service API (#3822)

f4f0286159ce4785c2b61d13ca3b0d63317d7c13 authored about 2 years ago by Ram Ramrakhya <[email protected]>
[BugFix] Fix date check in manage worker API (#3826)

165c5802b7cc0279803b06dd8e9337b467f6cf2b authored about 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Remove datetime parser from check in manage worker (#3825)

cfcf253f601d5218905adeeb890359c1bc064ece authored about 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Fix issue with challenge end date in manage worker API

712fab72198c246f52f54a5570c827003dc44bbb authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Backend] Add worker scaling support on Manage tab (#3800)

d67da37c69a8bd7dbb184cf8aa7bbe269295782c authored about 2 years ago by matthew-so <[email protected]>
[Backend] Make migration for increased CPU workers & memory

Co-authored-by: Ram Ramrakhya <[email protected]>

963e33754f66dc69d104de3d521b3195155dbf94 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Allow only downscaling for past challenge workers

* Allow only downscaling for past challenge workers

* Add changes from review

* Update aut...

0a5dacfdcf4eba496f63022c1911f3fe77eb0978 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Backend] Disable manage tab actions for past challenges

* Check actions for past workers in manage worker

* Add missing datetime import

* Update v...

0a4f9f7861b0bbdff6d537425b196d1c3e301d70 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Logging] Add flush method to MultiOut

* Add flush method to MultiOut

* Fix flake8 issues

82c118ef918584f33378ca965fbf613e118ae79d authored about 2 years ago by Gunjan Chhablani <[email protected]>
[FrontendV2] Deprecate nodejs_v2 from dev setup

Co-authored-by: Ram Ramrakhya <[email protected]>

a852ec3cde2a377bede51e4bf486295cfdae547e authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Backend] Add importlib metadata version to common requirements

e7b78fe808642e55ce245f9fd95418fedcc9ff33 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Enable autoscaling for past and future challenge workers

ec7fb98e3401d180edb15676eeaae334301de419 authored about 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Enable auto-scaling for unapproved challenges

aaa555183ae77278436c0299e8884d451d99b79a authored over 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Enable worker auto scaling on prod

698044535c441463cd66a0fe5b46385029f8b963 authored over 2 years ago by Gunjan Chhablani <[email protected]>
[Worker] Increase default CPU and memory config

be865f28ae0a0a70239718ef424644b02d334aa9 authored over 2 years ago by Gunjan Chhablani <[email protected]>
[Worker] Show evaluation script debugging logs on manage tab

2511d1438040fb9b596a032956114d834d6a5b42 authored over 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Add prod challenge queues in auto-scaling script (#3804)

9913efd8d2a130700c14daa54f6e927a14ca486f authored over 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Fix variables in auto-scaling shell script (#3803)

de056a7635f0b77534adc89618146e296e1b257c authored over 2 years ago by Gunjan Chhablani <[email protected]>
[Monitoring] Use prometheus metrics to auto scale workers

55ccb870ee1a09892f45f3222ee5a20ea19b6def authored over 2 years ago by Gunjan Chhablani <[email protected]>
[BugFix] Fix submission visibility check in large file upload API (#3802)

629f40e9d86717cea023365ff4bade959760837e authored over 2 years ago by Ram Ramrakhya <[email protected]>
Backend: Add checks to set submission visibility in large file upload API(#3801)

* Add checks to set submission visibility in large file upload API

* Rearrange code

a977a5aaab35450db059e1e73a2428e0d74a3f44 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Frontend] Set pagination page size to 150 (#3799)

* [Backend] Set pagination page size to 100

* Update limits on frontend

* Update limits on...

139d0c926312424b323af8cd914f926c459323b2 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Code Upload Worker] Add submission time limit env variable in environment docker(#3797)

* [Code Upload Worker] Add submission time limit env variable in environment docker

* Rename ...

601b10d2613c1deaa4004f072a68c94ae27e9b36 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Worker] Add prediction upload worker auto scaling job

6c879b48e8a20c58da9afe82db04967101eb7289 authored over 2 years ago by Gunjan Chhablani <[email protected]>
Revert "[Code Upload Worker] Add worker auto restart for static code upload challenge (#3785)" (#3788)

This reverts commit d6c432a83e95147fef7a39afffa5ca3501b8b5d2.

cb8a736ba93553f2c14896018223f248e1b776d9 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Code Upload Worker] Add worker auto restart for static code upload challenge (#3785)

d6c432a83e95147fef7a39afffa5ca3501b8b5d2 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Code Upload Worker] Increase submission monitoring polling interval (#3784)

582a4cf835ba4ce97f65ff920bd182a277ef9ccd authored over 2 years ago by Ram Ramrakhya <[email protected]>
Code Upload Worker: Add support for CPU only jobs(#3782)

* [CodeUploadWorker] Add CPU only code upload evaluation support

* resolve merge

a2307f0724bfc292b5d423de6e31c073938dd0c0 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Docs: Fix EvalAI Starter links in Docs (#3781)

Co-authored-by: Rishabh Jain <[email protected]>

557152461fba75c01bab7b85994735c8cc0da92a authored over 2 years ago by Gunjan Chhablani <[email protected]>
[Code Upload Worker] Revert GPU constraint for jobs (#3780)

9f2a9ea68a790bcb888489d2a59a1f45b92def45 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Fixes #3772: Add phase in the order of pk on leaderboard (#3773)

abb17a49c15694f9e300da25b3297f2cf6c45daa authored over 2 years ago by Haotian Liu <[email protected]>
Code Upload Worker: Fix worker task definitions and limit title to 20 characters(#3778)

* [BugFix] Fix static code upload worker task definitions

* Limit title

62718d25b7dbf0068763b0b5d43e02596545e22f authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Code upload worker] Remove GPU constraint on job pod (#3770)

da7de6cf37604b4de2f2c537e78744cdbd1c7a53 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Frontend_V1: Switch to frontend v1 for staging deployment (#3769)

3e6eebf079c95c2204fad83b6fae901aa8ce8d08 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Frontend V1] Update to node base image to 14.20.0

6f5a4f85ea01ec8b212c5b11a46f7c4bc8526b27 authored over 2 years ago by Gunjan Chhablani <[email protected]>
Frontend_V1: Add URL redirection for Frontend v2 backward compatibility(#3761)

Co-authored-by: Rishabh Jain <[email protected]>

604d370b42d5acc1d9eea8a1f0165719f9e3458f authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Frontend] Revert to frontend v1 (#3760)

1369ab30c8da47367b80e11b6b174b78fa252a57 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Worker: Increase code upload worker sleep interval(#3758)

* [Backend] Increase API throttle limit for logged in users

* Increase sleep interval to mini...

88b43f4f71afa1b49e191051abf14df0bed708a4 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Frontend] Deprecate challenge creation using zip (#3756)

* [Frontend] Deprecate challenge creation using zip

* Update docs:

b6035c201cc194a054c06572abf1211fdb88f634 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Submission Worker: Update numpy version to latest (#3751)

2877ed5025d9d959f711795ef1eef59472a679b3 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Frontend_V2: Fix submitted file broken link on All submission page (#3750)

* [BugFix] Fix submitted file broken link on All submission page

* remove log

Co-authored-...

66f646a7e3b07720999e8a31f0a8e2f3bdb9bb58 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Frontend_V2: Show challenge and phase id on CLI submission instructions page (#3749)

640cd6c0527dcdc5593aeb344fa7e804a2149b1c authored over 2 years ago by Ram Ramrakhya <[email protected]>
[BugFix] Add cron for auto stopping idle challenge workers(#3747)

* [BugFix] Add cron for auto stopping idle challenge workers

* update

dbb0353baffb5024793a7feb31997e0456d03d2a authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Deployment] Add memcached server in auto deployment (#3745)

Co-authored-by: Rishabh Jain <[email protected]>

1f204051a6990cff1b00f858e2fae1b9eacdd095 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Backend] Add memcache container for throttling cache(#3744)

fddd74004c558750e05c384807e3ee237aced261 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Frontend] Increase leaderboard and submission API polling interval t… (#3742)

94783a484bad397c0342e41f88e96919fb7b00bc authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Backend] Add submission model DB index and reorder query for optimization (#3741)

e255125e5c4b6e149bbd02c3e64a53d8a8d51d16 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Frontend_V2: Enable leaderboard scroll and show method name (#3738)

Co-authored-by: Rishabh Jain <[email protected]>

a3c1ae470a410d60c2ebbe38e59ae05f70983bd0 authored over 2 years ago by Ram Ramrakhya <[email protected]>
Backend: Update submission meta attributes in github challenge creation(#3736)

65095fb3e78939c14eea484dd06db26e10244167 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[BugFix] Fix Frontend V2 redirection route to prod in nginx config (#3734)

187ad4892dbd1f5de0937badfa1f40c09acac8c0 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[BugFix] Show only approved challenges in ongoing,past, future challenge tabs (#3732)

9d9a0b6aa00092acdffd46c9451cee14547c0399 authored over 2 years ago by Ram Ramrakhya <[email protected]>
[Worker] Revert python 3.8 submission worker (#3733)

d15cae9cd96284d29f61e18c17b8e9f6c8257c27 authored over 2 years ago by Ram Ramrakhya <[email protected]>