Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/OpenDataScotland/the_od_bods

Collating open data from across Scotland
https://github.com/OpenDataScotland/the_od_bods

added docstrings to convertsize and get_feeds

8707ca3ce12989d7bda3666c4135da418c6e1fa1 authored over 2 years ago by Ludovico <[email protected]>
moved location of produced csv's

508cd8cc91bd6ab427d72fe086b089471af41053 authored over 2 years ago by Hariss Ali Gills <[email protected]>
add council and government

e9e40171d6f1578431af153d6df80940b6ee62f0 authored over 2 years ago by watty62 <[email protected]>
fixed reintroduced bug in categorising tourism

fa79bd2848c78d12df50aa13978b4decf0ed904b authored over 2 years ago by Karen Jewell <[email protected]>
Merge branch 'web-scrapers' of github.com:OpenDataScotland/the_od_bods into web-scrapers

e859e314db27ca8dea9ee7443e8074599f2116db authored over 2 years ago by Hariss Ali Gills <[email protected]>
Documentation complete

8584e82e788ec4f860ea58da422216a029a97f07 authored over 2 years ago by Hariss Ali Gills <[email protected]>
Merge remote-tracking branch 'origin/main' into main

fcecc5181f2af266613bd79a4e3fa19eb506233f authored over 2 years ago by watty62 <[email protected]>
add housing

9e613eed851d0b3050c82ebed8fb6739ffb3232d authored over 2 years ago by watty62 <[email protected]>
Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods

8326ed03c743f044bb548aa102fd92851c642bb7 authored over 2 years ago by Karen Jewell <[email protected]>
fixes to organisation names

6de021f4715c00da2819a65c17047dc0ccab9105 authored over 2 years ago by Karen Jewell <[email protected]>
update categories

74a3a74c1bdc74e60af2a5990b9a7d02ad7206aa authored over 2 years ago by watty62 <[email protected]>
Merge branch 'web-scrapers' of https://github.com/OpenDataScotland/the_od_bods into web-scrapers

18ff0155b056f71477d56605cd4599f880c20f66 authored over 2 years ago by Ludovico <[email protected]>
updated aberdeenshire.csv

68fa1868020211126943e0ef5ad946f875c32edc authored over 2 years ago by Ludovico <[email protected]>
fixed formatting of file size and other null values

24d72c9c354e42e920922ccdd6e448e545023918 authored over 2 years ago by Ludovico <[email protected]>
output aberdeenshire csv

b7af65986ec0246bc82602d66b985d1456ec2112 authored over 2 years ago by Ludovico <[email protected]>
fixed title fetching

b43b30bef8d7c19d5b5e6d304046b2871c2e9137 authored over 2 years ago by Ludovico <[email protected]>
Merge pull request #92 from OpenDataScotland/87-refactor-argis-and-dcat-processors-to-use-shared-code-base

#87 arcgis and dcat processors refactored to use base Processor class

445c6b4371130df35e56ff9990e89fab2ab69e08 authored over 2 years ago by Andrew Sage <[email protected]>
Merge branch 'main' into 87-refactor-argis-and-dcat-processors-to-use-shared-code-base

21ad7e08148b41484594a87d17efa9e7a3449501 authored over 2 years ago by Andrew Sage <[email protected]>
#87 arcgis and dcat processors refactored to use base Processor class

6bfefd64297db8450fba9117de1e1fdccecd4fc7 authored over 2 years ago by Andrew Sage <[email protected]>
Merge branch 'web-scrapers' of github.com:OpenDataScotland/the_od_bods into web-scrapers

1644fb7614a9fa928891ffca1935bb652ea8148c authored over 2 years ago by Hariss Ali Gills <[email protected]>
finished moray scraper

c61e9abe41b7000208fb3ece422c8810932cfba8 authored over 2 years ago by Hariss Ali Gills <[email protected]>
changed arcgis.py to relative source

1d8f89323452df83a9f884d0757dd8a6229b4c3e authored over 2 years ago by Karen Jewell <[email protected]>
created csv output function

077470e17d5b2203c1048052e7ee46cae6345a78 authored over 2 years ago by Ludovico <[email protected]>
Merge pull request #86 from OpenDataScotland/73-create-config-file-listing-source-urls-and-processor

73 create config file listing source urls and processor

7e8d791dd19fbdf2bee6a2045fd44006e236c433 authored over 2 years ago by Andrew Sage <[email protected]>
#73 arcgis processor now uses sources.csv for urls

cb152f8da49a15b09f8d96bde875a92b917bc45e authored over 2 years ago by Andrew Sage <[email protected]>
renamed for clarity

cd6816ea5e2aae895bf73fc6ae60235e12b425b8 authored over 2 years ago by Ludovico <[email protected]>
#73 dcat processor now uses the sources.csv config file

e694814d6a12b1af21d546d794ca15c1d8cb47f2 authored over 2 years ago by Andrew Sage <[email protected]>
Merge branch 'web-scrapers' of https://github.com/OpenDataScotland/the_od_bods into web-scrapers

cea44899f12f2174b23c037369e1cbc239ed659d authored over 2 years ago by Ludovico <[email protected]>
added parsing for final output csv

530e2c3f1016f480a3737c01e2515b79c3963a6d authored over 2 years ago by Ludovico <[email protected]>
Merge branch 'web-scrapers' of github.com:OpenDataScotland/the_od_bods into web-scrapers

60312a4ac5778f35a09544d0effedda3da92d946 authored over 2 years ago by Hariss Ali Gills <[email protected]>
started working on moray_council scraper

122cfb0d57f1caad99e7ce6c31c4f97f41b993bc authored over 2 years ago by Hariss Ali Gills <[email protected]>
setup fetching of filesize and converting to correct unit

3ceb08e351cbdb7735589f369afda65144125b8e authored over 2 years ago by Ludovico <[email protected]>
Merge branch 'improved-ab-scraper' into web-scrapers

fd22fcdb129b2afcc67a2d2cae8dc404939337d4 authored over 2 years ago by Ludovico <[email protected]>
got started on function for adding file metadata

27815f1fb337b01bdcf4343528d2ebc95be8f2d4 authored over 2 years ago by Ludovico <[email protected]>
added function for parsing last updated date for file

2409bfcb78f1596a13cdc76c48f9e508d1a75fa6 authored over 2 years ago by Ludovico <[email protected]>
deleted arrays for csv output column entries

ce0824e651ec5887eb559a373735a7d8633770d7 authored over 2 years ago by Ludovico <[email protected]>
deleted unused function

fd400f3c58581551e7fd44f0d8427b8130ebe9c1 authored over 2 years ago by Ludovico <[email protected]>
created feed processing function

072f963639ab398e11ca23854cc5196952471f7b authored over 2 years ago by Ludovico <[email protected]>
Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods

66bc951bf3a17ae01c6cfba111545cf576b64a32 authored over 2 years ago by Karen Jewell <[email protected]>
change export2jkan to use permanent urls

1561635c3d21eae1f4c00a1dd341eae26c56ed5f authored over 2 years ago by Karen Jewell <[email protected]>
Update pipeline.yaml

589124bcb3a0f0fb3b9eb2cf0f88ab960a9296e9 authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yaml

111140ad86fba73844940a0125ef70697d9b9220 authored over 2 years ago by Manpreet Chawla <[email protected]>
Update pipeline.yaml

58e84bca8666737f04216674f2e9716d587670e2 authored over 2 years ago by Manpreet Chawla <[email protected]>
moved merge_data.py to root

8bec2345b9aac6496a1384309a85610da533ee8c authored over 2 years ago by Karen Jewell <[email protected]>
Update pipeline.yaml

fb2b8a763c22959d819e45ce47605ce34da75867 authored over 2 years ago by Jack Gilmore <[email protected]>
Update pipeline.yaml

f1b882590b9bb65b893a24d3af1e88a3432b6b8c authored over 2 years ago by Manpreet Chawla <[email protected]>
fixed header

425536c3dfe3d1e92f198f29a0de46f7d72f8a5e authored over 2 years ago by Hariss Ali Gills <[email protected]>
Merge branch 'web-scrapers' of github.com:OpenDataScotland/the_od_bods into web-scrapers

049e86d429abbdc69b729981b635323c45c01901 authored over 2 years ago by Hariss Ali Gills <[email protected]>
finished scraper

d10d52bdf0e340e337eb71c609b7d4855ed48b47 authored over 2 years ago by Hariss Ali Gills <[email protected]>
Update pipeline.yaml

f5b3127ec42dd2bd295b2b21b66dbb4b1b6d5b67 authored over 2 years ago by Manpreet Chawla <[email protected]>
scraper complete

bb69bebd438d7594b3aaf086cd79f56f5bfef296 authored over 2 years ago by Hariss Ali Gills <[email protected]>
Update pipeline.yaml

9896853d3764bbcc7ec8671f5293de2de1f473a4 authored over 2 years ago by Manpreet Chawla <[email protected]>
added arrays for output csv column headers

630ec663abb02647fcb5e25ab52d572b2f8a6fc5 authored over 2 years ago by Ludovico <[email protected]>
Revert "arrays for output csv column values title function"

This reverts commit 458f9e006c554be475f7885476a27f3982f10f8a.

2ab7989a68aefd323f24e9b7b61e7bd43cbbc805 authored over 2 years ago by Ludovico <[email protected]>
fix to categorisation

585ab749d9f79e6eb58513537d33a8d8f29ed53e authored over 2 years ago by Karen Jewell <[email protected]>
adding python dependencies

800743c6e34d3f4b4daac65a269878b1ea16674f authored over 2 years ago by Manpreet Chawla <[email protected]>
add tourism category to merge_data.py

92a95b06fd90342b1aa83ae48ed0555bae2c3d3e authored over 2 years ago by watty62 <[email protected]>
Merge pull request #83 from OpenDataScotland/72-monitor-for-datasource-base-url-changing

72 monitor for datasource base url changing

f09b863be496046990f1ef4a4f827041ed0eff4b authored over 2 years ago by Andrew Sage <[email protected]>
#72 Corrupt URLs fixed. Development output removed

53e63e68205a3b367d0e9d9b053d25239f858fb0 authored over 2 years ago by Andrew Sage <[email protected]>
dcat,argis and usmart added to source list

f69982e66ef1d2b1e48858373684ebfe04b24872 authored over 2 years ago by Andrew Sage <[email protected]>
Commenting .NET source

9f92d2e6c2061372d460feadb4550ada7f35ec25 authored over 2 years ago by Manpreet Chawla <[email protected]>
Merge branch 'web-scrapers' of github.com:OpenDataScotland/the_od_bods into web-scrapers

2204500bf0dc19567c8fceb44f577d7c501423dd authored over 2 years ago by Hariss Ali Gills <[email protected]>
Parse all data except file_size

8a8bfc6663368c37acf2e5f3c36892b4f399c549 authored over 2 years ago by Hariss Ali Gills <[email protected]>
Merge branch 'web-scrapers' of https://github.com/OpenDataScotland/the_od_bods into web-scrapers

99e74d790369c4dba3ea558d3c09e824c9e91db8 authored over 2 years ago by Ludovico <[email protected]>
arrays for output csv column values title function

458f9e006c554be475f7885476a27f3982f10f8a authored over 2 years ago by Ludovico <[email protected]>
#72 Only creates issue if no open issue exists. Automatically closes an issue if the URL is now working. Documentation updated.

55de0da9ff31a4dce0f50d3803dfddf20cd3fa15 authored over 2 years ago by Andrew Sage <[email protected]>
Update pipeline.yaml

3c9f5a55c8927ed5ad0e4e6fd6054f33127e8d68 authored over 2 years ago by Manpreet Chawla <[email protected]>
Dataset pull Automation Pipeline creation

afe911e315d81cc61534bc59fd05bc469bcc9340 authored over 2 years ago by Manpreet Chawla <[email protected]>
Merge branch 'web-scrapers' of github.com:OpenDataScotland/the_od_bods into web-scrapers

d7505f173c775c081b104fc301898d5c5b30a33f authored over 2 years ago by Hariss Ali Gills <[email protected]>
Arranged into functions

9d9190858116b8a9248774f5ab64979f0c76c6c5 authored over 2 years ago by Hariss Ali Gills <[email protected]>
#72 Initial working version base on a fake configuration sources.csv file.

eaa3b128ef50c6b26aeba3e35da1a9d99a443c62 authored over 2 years ago by Andrew Sage <[email protected]>
Merge branch 'web-scrapers' of https://github.com/OpenDataScotland/the_od_bods into web-scrapers

dfa38c1ba2cd336cc4a7c704262a6064b029de8f authored over 2 years ago by Ludovico <[email protected]>
Created function for fetching file links

760ccbd9b06b1de5065bc90ca8ec101dbbb0e75b authored over 2 years ago by Ludovico <[email protected]>
Merge branch 'web-scrapers' of github.com:OpenDataScotland/the_od_bods into web-scrapers

bdd80bd2e48186ec262a724f347db8130f355072 authored over 2 years ago by Hariss Ali Gills <[email protected]>
Unfinished Scraper

c1547b6e177ba0e599a1790bbbc4478b5f9a4291 authored over 2 years ago by Hariss Ali Gills <[email protected]>
update categories in merge_data

4b3963c31cbf9aa062a7e8062813d32b17e39cd0 authored over 2 years ago by watty62 <[email protected]>
Added boilerplate

5d10ac356d35c4c12345c1eb129ea6a8afa30636 authored over 2 years ago by Ludovico <[email protected]>
Create aberdeen_council_scraper.py

Initial commit for the Aberdeen City Council website web scraper

0e6313525d237f685361992dcbfd219837c75cb8 authored over 2 years ago by Ludovico Chiavelli <[email protected]>
Updated CKAN output

cb349dbdd0990fab87c3e1622fe54d6bbfd7aa12 authored over 2 years ago by GitHub Actions <>
Create pipeline.yaml

8faa49f0cdbde5bd2220410d5edd762d63dfe874 authored over 2 years ago by Manpreet Chawla <[email protected]>
Run pipeline for new sources

b902d4b0932ba4605799d7fcc11e73d34e92fea4 authored over 2 years ago by Robert McWilliam <[email protected]>
Add new LAs to DCAT

3521fbdd713d791b3229c95a571d9d608b9c40fa authored over 2 years ago by Jack Gilmore <[email protected]>
Switch from arcGIS to DCAT for 3 new LAs

12a5784bb3282496e56d03c98f36faeda9c96ed7 authored over 2 years ago by Jack Gilmore <[email protected]>
Fix highland link

175ed453b413694d55534d70fee2e891ce9974df authored over 2 years ago by Jack Gilmore <[email protected]>
Add URLs for Highland, North Ayrshire, and North Lanarkshire to ArcGIS script

77b715d84320b46c657f347f2c56ee59667a4d5f authored over 2 years ago by Jack Gilmore <[email protected]>
added more keywords to ODScategorisation

f63f752eefa1fc550dbc1ff0cd93bdc0c7c86dcc authored over 2 years ago by Karen Jewell <[email protected]>
assigned more categories to datasets

2a9d541201cfd90db85e8e5c07fce55e9acff1a8 authored over 2 years ago by Karen Jewell <[email protected]>
Deletes JKAN/_datasets before replacing with new

98b833ca710ae284b3842f5bbbde4ceacf8d02c8 authored over 2 years ago by Karen Jewell <[email protected]>
Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods into main

8bc33424b9b58887c41b1021d67bbef108e9d76e authored over 2 years ago by Karen Jewell <[email protected]>
new functions to assign ODSCategories

a4279776029ebf87b87094246d67be154c20bd9c authored over 2 years ago by Karen Jewell <[email protected]>
updated merged_output with new ODSCategories

b1541d57e5c57955645c38ea48d8558ee7f2ea1f authored over 2 years ago by Karen Jewell <[email protected]>
REMOVED /_datasets. export2jkan now writes direct to JKAN repo

86890fa8ac7a56b1d1b3cba147af91e0e92f6a91 authored over 2 years ago by Karen Jewell <[email protected]>
export2jkan now writes direct to JKAN repo and uses ODSCategories instead of dataset tags. If I was a better person I would have split this commit.

8030639e26ccb55828106f91addc91fed9072549 authored over 2 years ago by Karen Jewell <[email protected]>
Updated CKAN output

096302c26c90f63cbf11c188f4617c1798266386 authored almost 3 years ago by GitHub Actions <>
Update CKAN.yml

0373900ff2e1495919f33168afcd2008845ee373 authored almost 3 years ago by Jack Gilmore <[email protected]>
Update CKAN.yml

94cc2959a8cfda271b4c17a025c12b2747a9760d authored almost 3 years ago by Jack Gilmore <[email protected]>
Update CKAN.yml

0736b250dfd3a914784b9672474f6e6ebfb1d693 authored almost 3 years ago by Jack Gilmore <[email protected]>
Update CKAN.yml

a38680d9d1f30bc3fd383eefae7088ed08bd2905 authored almost 3 years ago by Jack Gilmore <[email protected]>
Update CKAN.yml

56826158e1a3ffc3833d00b5406c6061076c4543 authored almost 3 years ago by Jack Gilmore <[email protected]>
Update CKAN.yml

75af288063da89849958995482f04811bf87645f authored almost 3 years ago by Jack Gilmore <[email protected]>