Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
github.com/OpenDataScotland/opendata.scot_pipeline
Our dataset gathering pipeline job that runs every Friday at lunchtime
https://github.com/OpenDataScotland/opendata.scot_pipeline
Merge pull request #11 from OpenDataScotland/8-replace-main-py
#8 Use main.py and docker
22966050a2615437aedc4404d8ae8c69b80d2ba6 authored over 1 year ago by Jack Gilmore <[email protected]>
Tidy up for Docker
bbcc4c8ac3a1a6e77e00dbe469f8e5adce5c2bd7 authored over 1 year ago by Jack Gilmore <[email protected]>
bbcc4c8ac3a1a6e77e00dbe469f8e5adce5c2bd7 authored over 1 year ago by Jack Gilmore <[email protected]>
Fix path
c33bc5a21c6109d6da81e027a909688a89134e2a authored over 1 year ago by Jack Gilmore <[email protected]>
c33bc5a21c6109d6da81e027a909688a89134e2a authored over 1 year ago by Jack Gilmore <[email protected]>
Fix dodgy flag
a05f5129b398f5b64a9066b61aef14eaf9b39556 authored over 1 year ago by Jack Gilmore <[email protected]>
a05f5129b398f5b64a9066b61aef14eaf9b39556 authored over 1 year ago by Jack Gilmore <[email protected]>
Test docker
1c84e34801163d377771cfe563388ea050f48857 authored over 1 year ago by Jack Gilmore <[email protected]>
1c84e34801163d377771cfe563388ea050f48857 authored over 1 year ago by Jack Gilmore <[email protected]>
Update pipeline.yml
2166537d89259e1b39bbbd2f6344b1f5fdb0fc16 authored over 1 year ago by Jack Gilmore <[email protected]>
2166537d89259e1b39bbbd2f6344b1f5fdb0fc16 authored over 1 year ago by Jack Gilmore <[email protected]>
Comment fix
869532161a7d5735ff25f072255f501fe6dc8733 authored over 1 year ago by Jack Gilmore <[email protected]>
869532161a7d5735ff25f072255f501fe6dc8733 authored over 1 year ago by Jack Gilmore <[email protected]>
Temp comment out
f82b269b9c970141e1a49e55d6edf4ccdc55c3ab authored over 1 year ago by Jack Gilmore <[email protected]>
f82b269b9c970141e1a49e55d6edf4ccdc55c3ab authored over 1 year ago by Jack Gilmore <[email protected]>
Re-run merge and export
f2cf7d64518aea16ae4db316f392efe10f4a2c09 authored over 1 year ago by Jack Gilmore <[email protected]>
f2cf7d64518aea16ae4db316f392efe10f4a2c09 authored over 1 year ago by Jack Gilmore <[email protected]>
Package fix?
94e70ccd335ba1acb2944c0c5bc03250aec93b75 authored over 1 year ago by Jack Gilmore <[email protected]>
94e70ccd335ba1acb2944c0c5bc03250aec93b75 authored over 1 year ago by Jack Gilmore <[email protected]>
Change directory
5e4d35bca57e85a4dfb9497d6a0c4b9f14ddcff9 authored over 1 year ago by Jack Gilmore <[email protected]>
5e4d35bca57e85a4dfb9497d6a0c4b9f14ddcff9 authored over 1 year ago by Jack Gilmore <[email protected]>
Use requirements.txt for packages
f773b6076fceeb018d5d192191aa07953fa08f48 authored over 1 year ago by Jack Gilmore <[email protected]>
f773b6076fceeb018d5d192191aa07953fa08f48 authored over 1 year ago by Jack Gilmore <[email protected]>
feature: #8 changed pipeline to use main.py file
148c81c6e9b73fc9cce0d6a13dca649c4ba1fea9 authored over 1 year ago by Karen Jewell <[email protected]>
148c81c6e9b73fc9cce0d6a13dca649c4ba1fea9 authored over 1 year ago by Karen Jewell <[email protected]>
added SQA scraper to pipeline (#4)
added SQA scraper to pipeline
eebe3408ad89420679550a03b44993e6cf610b27 authored almost 2 years ago by Steffen <[email protected]>
Replace the_od_bods data on pipeline run (#3)
* added commit action for /data in the_od_bods and reduced pipeline to test
* attempt 2 with ...
5d9a7b33d47e7ab2d0e02a383833510c367735b4 authored almost 2 years ago by Karen Jewell <[email protected]>
Add new issue auto-assigner
3a7d4a118ee6dd96cb41f87607039c56b0767b58 authored about 2 years ago by Jack Gilmore <[email protected]>
3a7d4a118ee6dd96cb41f87607039c56b0767b58 authored about 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
1b9a7a601f10a35d5d82a46a0ed1bd6257a9a7d0 authored about 2 years ago by Jack Gilmore <[email protected]>
1b9a7a601f10a35d5d82a46a0ed1bd6257a9a7d0 authored about 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
1bdc29b378435b282a19ed55b881d536698f9279 authored about 2 years ago by Jack Gilmore <[email protected]>
1bdc29b378435b282a19ed55b881d536698f9279 authored about 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
5836e0495085b2323bb6bd73bc251efdf58d2638 authored about 2 years ago by Jack Gilmore <[email protected]>
5836e0495085b2323bb6bd73bc251efdf58d2638 authored about 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
04896c03adf4dccc235b1458a5aecfbc225b9d7f authored about 2 years ago by Jack Gilmore <[email protected]>
04896c03adf4dccc235b1458a5aecfbc225b9d7f authored about 2 years ago by Jack Gilmore <[email protected]>
Test create log file
d31d77ac6cf8fe13948099d2f2764288413b5450 authored about 2 years ago by Jack Gilmore <[email protected]>
d31d77ac6cf8fe13948099d2f2764288413b5450 authored about 2 years ago by Jack Gilmore <[email protected]>
Archive whole workspace and do so if we're not committing to site
51fd2d92f87d914f49a6a434e1141427135ecab7 authored over 2 years ago by Jack Gilmore <[email protected]>
51fd2d92f87d914f49a6a434e1141427135ecab7 authored over 2 years ago by Jack Gilmore <[email protected]>
Add commit switch and failure catch
Commit switch to conditionally commit to JKAN or not (useful during testing)
Failure catch to...
8c08581d2e7fa1ad54c7f4813958114e7c84cae4 authored over 2 years ago by Jack Gilmore <[email protected]>
fixed the sparkql_statistics script run
65040ac6674a3d91fae0a03c18c65b8498e70885 authored over 2 years ago by Manpreet Chawla <[email protected]>
65040ac6674a3d91fae0a03c18c65b8498e70885 authored over 2 years ago by Manpreet Chawla <[email protected]>
Added ScotGov Statistics Sparkql script
e05e7961ca420d08f07fbd9b74f535ea648d404e authored over 2 years ago by Manpreet Chawla <[email protected]>
e05e7961ca420d08f07fbd9b74f535ea648d404e authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yml
60ea7a964769e43dded22bfec1d3b949c5dc12bd authored over 2 years ago by Jack Gilmore <[email protected]>
60ea7a964769e43dded22bfec1d3b949c5dc12bd authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
2ae5609586c252e617899dfff21ac5876c95788f authored over 2 years ago by Jack Gilmore <[email protected]>
2ae5609586c252e617899dfff21ac5876c95788f authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
2915f30cb20c8dea564fc64c2c06a867d37bb8c7 authored over 2 years ago by Jack Gilmore <[email protected]>
2915f30cb20c8dea564fc64c2c06a867d37bb8c7 authored over 2 years ago by Jack Gilmore <[email protected]>
Add NLS scraper to pipeline
066418f2ac388219ce2246f31b7e4d0d1babbac5 authored over 2 years ago by Jack Gilmore <[email protected]>
066418f2ac388219ce2246f31b7e4d0d1babbac5 authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
ca3e5827fd3b4be1e3869b3d614ec46f63317c89 authored over 2 years ago by Jack Gilmore <[email protected]>
ca3e5827fd3b4be1e3869b3d614ec46f63317c89 authored over 2 years ago by Jack Gilmore <[email protected]>
Add condition for Slack output
ada6861176ea80b5de5768522bfc75824d764938 authored over 2 years ago by Jack Gilmore <[email protected]>
ada6861176ea80b5de5768522bfc75824d764938 authored over 2 years ago by Jack Gilmore <[email protected]>
New line addition
be6794b5ed98aa05be856d4923c27ab21189bfd0 authored over 2 years ago by Jack Gilmore <[email protected]>
be6794b5ed98aa05be856d4923c27ab21189bfd0 authored over 2 years ago by Jack Gilmore <[email protected]>
Fix syntax
4438bf73becc5271a0a046c64ba79c3f08dd8263 authored over 2 years ago by Jack Gilmore <[email protected]>
4438bf73becc5271a0a046c64ba79c3f08dd8263 authored over 2 years ago by Jack Gilmore <[email protected]>
Add Slack webhook
81185b1df4cf47946896c21dcb13fb7b89c438c2 authored over 2 years ago by Jack Gilmore <[email protected]>
81185b1df4cf47946896c21dcb13fb7b89c438c2 authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
77302b5cac234b47650e1cf9eecc8dd765772970 authored over 2 years ago by Manpreet Chawla <[email protected]>
77302b5cac234b47650e1cf9eecc8dd765772970 authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yml
4023669c18c7205eb13cf46584b32fc2fcf1ae9e authored over 2 years ago by Manpreet Chawla <[email protected]>
4023669c18c7205eb13cf46584b32fc2fcf1ae9e authored over 2 years ago by Manpreet Chawla <[email protected]>
Adding dependencies for web scrappers
6b61a0e95938470df4a7c24ac7d8b82024ee3eac authored over 2 years ago by Manpreet Chawla <[email protected]>
6b61a0e95938470df4a7c24ac7d8b82024ee3eac authored over 2 years ago by Manpreet Chawla <[email protected]>
Adding Webscrappers feeds for data pull
45bcc554247638636cc082deecfe3a72715a40ad authored over 2 years ago by Manpreet Chawla <[email protected]>
45bcc554247638636cc082deecfe3a72715a40ad authored over 2 years ago by Manpreet Chawla <[email protected]>
Run workflow every friday at 12PM
db42bf9f1a20e006a2c813ac8dec86afc583a2c0 authored over 2 years ago by Jack Gilmore <[email protected]>
db42bf9f1a20e006a2c813ac8dec86afc583a2c0 authored over 2 years ago by Jack Gilmore <[email protected]>
Fix indenting
b6ce10b904c97ce7bdf49042b4950dc974b61155 authored over 2 years ago by Jack Gilmore <[email protected]>
b6ce10b904c97ce7bdf49042b4950dc974b61155 authored over 2 years ago by Jack Gilmore <[email protected]>
Re-add CKAN
45310850aba0e522c11e243dd97522d318111e43 authored over 2 years ago by Jack Gilmore <[email protected]>
45310850aba0e522c11e243dd97522d318111e43 authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
61c0d4d2572a66e005bbce2fb2e99f8f08437fd8 authored over 2 years ago by Jack Gilmore <[email protected]>
61c0d4d2572a66e005bbce2fb2e99f8f08437fd8 authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
46edb20d196acf1890a03a687de8fc6f8f669efa authored over 2 years ago by Jack Gilmore <[email protected]>
46edb20d196acf1890a03a687de8fc6f8f669efa authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
98c9cca6fca57368177aeb411c45d36fa3fcc09c authored over 2 years ago by Jack Gilmore <[email protected]>
98c9cca6fca57368177aeb411c45d36fa3fcc09c authored over 2 years ago by Jack Gilmore <[email protected]>
Change commit token config
d470f6be3060ed024c3fb844b5e9492ecd22c41e authored over 2 years ago by Jack Gilmore <[email protected]>
d470f6be3060ed024c3fb844b5e9492ecd22c41e authored over 2 years ago by Jack Gilmore <[email protected]>
Fix action syntax
31853b8de4ec94b4b5fb6b5eb22c025064f7f604 authored over 2 years ago by Jack Gilmore <[email protected]>
31853b8de4ec94b4b5fb6b5eb22c025064f7f604 authored over 2 years ago by Jack Gilmore <[email protected]>
Fix push
5850db0544331612a841350a028d4333a47c9568 authored over 2 years ago by Jack Gilmore <[email protected]>
5850db0544331612a841350a028d4333a47c9568 authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yml
c4056f1c7cd14e8e7d425dc01503638ec5906446 authored over 2 years ago by Manpreet Chawla <[email protected]>
c4056f1c7cd14e8e7d425dc01503638ec5906446 authored over 2 years ago by Manpreet Chawla <[email protected]>
Dataset pull automation and commit new changes
433558827121db9cdfd6922eac7a495744c01dd2 authored over 2 years ago by Manpreet Chawla <[email protected]>
433558827121db9cdfd6922eac7a495744c01dd2 authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yml
ef18dd2b26b08764b9d5c356fbee69a10ec3f7e7 authored over 2 years ago by Manpreet Chawla <[email protected]>
ef18dd2b26b08764b9d5c356fbee69a10ec3f7e7 authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yml
c9ee59e38a4daaa34241bb5f01b894f36e430a4e authored over 2 years ago by Manpreet Chawla <[email protected]>
c9ee59e38a4daaa34241bb5f01b894f36e430a4e authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yml
552d71d63c2d48638c9d65b2db310c478e7c8f25 authored over 2 years ago by Manpreet Chawla <[email protected]>
552d71d63c2d48638c9d65b2db310c478e7c8f25 authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yml
c940b15d6ae7d94b0348c94e424e69bd6b4fdeda authored over 2 years ago by Manpreet Chawla <[email protected]>
c940b15d6ae7d94b0348c94e424e69bd6b4fdeda authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yml
1c14b7f45bf566547979712aed30e54c49e9e491 authored over 2 years ago by Manpreet Chawla <[email protected]>
1c14b7f45bf566547979712aed30e54c49e9e491 authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yml
51cd577f1b5fa616243a282b3d126cb0d2975a86 authored over 2 years ago by Manpreet Chawla <[email protected]>
51cd577f1b5fa616243a282b3d126cb0d2975a86 authored over 2 years ago by Manpreet Chawla <[email protected]>
Copy script
81f93fbd9ab22c9b1f7683ea0f5239eb7b403f48 authored over 2 years ago by Jack Gilmore <[email protected]>
81f93fbd9ab22c9b1f7683ea0f5239eb7b403f48 authored over 2 years ago by Jack Gilmore <[email protected]>
Add repo clone paths
28a6b97e8bed66effd914273d025777cb0b4ac5a authored over 2 years ago by Jack Gilmore <[email protected]>
28a6b97e8bed66effd914273d025777cb0b4ac5a authored over 2 years ago by Jack Gilmore <[email protected]>
fix name
f8b8245f33f311440158cc345d40baa749a79080 authored over 2 years ago by Jack Gilmore <[email protected]>
f8b8245f33f311440158cc345d40baa749a79080 authored over 2 years ago by Jack Gilmore <[email protected]>
Fix script syntax
21ac451f1d10d87a102a39d26e7b420efad8e604 authored over 2 years ago by Jack Gilmore <[email protected]>
21ac451f1d10d87a102a39d26e7b420efad8e604 authored over 2 years ago by Jack Gilmore <[email protected]>
Check out repoes for pipeline
35c53005564bc004243b5d93578da8c2359c1133 authored over 2 years ago by Jack Gilmore <[email protected]>
35c53005564bc004243b5d93578da8c2359c1133 authored over 2 years ago by Jack Gilmore <[email protected]>
Initial commit
8488c110e4448859472df203db2592ff95af2d26 authored over 2 years ago by Jack Gilmore <[email protected]>
8488c110e4448859472df203db2592ff95af2d26 authored over 2 years ago by Jack Gilmore <[email protected]>