github.com/OpenDataScotland/the_od_bods commits

Update CKAN.yml

00219b89fdda176dc293f5a06a8c05f31da5dae4 authored almost 3 years ago by Jack Gilmore <[email protected]>

CKAN workflow

cb1372a11806a147f800d5a9a2438da576449e4a authored almost 3 years ago by Jack Gilmore <[email protected]>

Add FileName to CKAN output

783271060b007e1ac7366b83e051d728f7fa3679 authored almost 3 years ago by Jack Gilmore <[email protected]>

removed reference to local address which would break for everyone else.

3570694d2c3941f5f33949f5d9c8a6d7e795df9b authored almost 3 years ago by Karen Jewell <[email protected]>

added missing URL Status by council table and added table export to html for URL status, summary matrix and scorecard

c007d5e1a536c3537758eba7aaa4e12c7d1a0544 authored almost 3 years ago by Karen Jewell <[email protected]>

moved analytics image outputs into a folder of its own

3c463fbb9a989ad99ddc4e11bc58b59253d22817 authored almost 3 years ago by Karen Jewell <[email protected]>

added analytics charts export to svg

27372e2861f84564ed9192aaa38b343b29693e11 authored almost 3 years ago by Karen Jewell <[email protected]>

actually saved changes to analytics.ipynb this time. updated .html also

907d279a816c0b90f9f9155c6e1eebd3bfd38433 authored almost 3 years ago by Karen Jewell <[email protected]>

tidied up analytics and added .html version

496400e8e17b2c90bc3ef34eb6d8abca0f511549 authored almost 3 years ago by Karen Jewell <[email protected]>

updated analytics.ipynb to look at local authorities only

e6a5dc5d45640a325772cccaf5650397e15d9378 authored almost 3 years ago by Karen Jewell <[email protected]>

updated dcat.py to use issuedate as dateupdated instead of datecreated

0c070da241f18fa13d8c83010111c5382efe44e1 authored almost 3 years ago by Karen Jewell <[email protected]>

removed index from merged_output

20f061887c48f67917144d752c3987a27e00dd1f authored almost 3 years ago by Karen Jewell <[email protected]>

updated edinburgh in merged_output

57a8f62dcf10e34ea557a398262fb97b0fc5c13b authored almost 3 years ago by Karen Jewell <[email protected]>

Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods into main

881bb8a1431ea9282663d3c3b7c2bb4b7f515c75 authored almost 3 years ago by Karen Jewell <[email protected]>

separated clean_data() from merge_data()

f1bf165f3ec433e45927404612b2728f7d3c41f4 authored almost 3 years ago by Karen Jewell <[email protected]>

Drop mapping from publisher for Edinburgh

4ca47d6a65f784de5635ed6e2af6ffbf3ff860a8 authored almost 3 years ago by Robert McWilliam <[email protected]>

Add Edinburgh data to output.

58b0c694cee00189662aaf43f4886a9dfd40825d authored almost 3 years ago by Robert McWilliam <[email protected]>

Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods into main

288dceca1afd6f9042f75b417910c7d2bddaed8b authored almost 3 years ago by Karen Jewell <[email protected]>

fixed labelling of license to licence

bb5c1735c631eb2712c852c9665647b16dfc4cad authored almost 3 years ago by Karen Jewell <[email protected]>

Merge branch 'main' of github.com:OpenDataScotland/the_od_bods into main

de15c23d3716e73ec87bc3c4faa7ac2ba05262b9 authored almost 3 years ago by Robert McWilliam <[email protected]>

Add pulling from Edinburgh DCAT feed.

eddb2593519792bbd409c4b00b06a59761a9dec9 authored almost 3 years ago by Robert McWilliam <[email protected]>

actually added merged_untidy data

91008c1e7bd7ab9d80597351a5855ee1c3480806 authored almost 3 years ago by Karen Jewell <[email protected]>

Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods into main

8411432b3512b4c82af9ef3e39e80fc5f216f683 authored almost 3 years ago by Karen Jewell <[email protected]>

added merged_untidy data and fixed missing scotgov

82fa434fde197a8e73d5a604c916a9cd054fe4fe authored almost 3 years ago by Karen Jewell <[email protected]>

Add Glasgow DCAT feed to merge and run export.

62b8cba6d3e5c72a115ea1cdd57547b730be85c1 authored almost 3 years ago by Robert McWilliam <[email protected]>

added function to tidy licenses in merge_data.py

f9b55b5d2b16861b2cc40c5d5f0638fc72b30c02 authored almost 3 years ago by Karen Jewell <[email protected]>

Update datasets.

58d0b65f7e9b0628b719240041d5ae85efd4ae21 authored almost 3 years ago by Robert McWilliam <[email protected]>

Add script to pull from Glasgow DCAT feed.

baec0e65c4c635f19898f35c2e84752a5a2f0984 authored almost 3 years ago by Robert McWilliam <[email protected]>

Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods into main

57b09d7e11593b7aa039c794c322d37fe3ef0f3b authored almost 3 years ago by Karen Jewell <[email protected]>

moved scotgov data into merge_data.py

143c4bc408b346e0490f817c2b9ff92337b61a7d authored almost 3 years ago by Karen Jewell <[email protected]>

Update filenames to have unique number rather than dataset title.

86481273790c248960cf9d83feb4231483b0dd4f authored almost 3 years ago by Robert McWilliam <[email protected]>

removed nan categories

d90ca07343c594133d6f48311def18b75e3f635d authored almost 3 years ago by Karen Jewell <[email protected]>

Run merge and export.

e5464a47e7541496222277d61940338b82405a34 authored almost 3 years ago by Robert McWilliam <[email protected]>

reran USMART

18bfaef2f518bb09d85c69ee60e72217ebd1a925 authored almost 3 years ago by Karen Jewell <[email protected]>

Merge branch 'main' of https://github.com/CodeTheCity/the_od_bods into main

452106f9ef4b719c4b3dbf3a3aa32d87f45b69e7 authored almost 3 years ago by Karen Jewell <[email protected]>

added description back into USMART data

5e40f0cb339cb51d2d1e9263dc7bf0daa9d65006 authored almost 3 years ago by Karen Jewell <[email protected]>

Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods

a2197a9387cbdf757f7130667f88215e0cc19628 authored almost 3 years ago by Jack Gilmore <[email protected]>

Update datasets.

6fbd844630f27193a3b904e27910743790c9bdad authored almost 3 years ago by Robert McWilliam <[email protected]>

analytics on latest data

30145132cfd02fabcb0f3bba10a42252dea55562 authored almost 3 years ago by Karen Jewell <[email protected]>

Merge branch 'main' of https://github.com/CodeTheCity/the_od_bods into main

93e34975e0c91dcae6bca90e35104b4ba3516dcb authored almost 3 years ago by Karen Jewell <[email protected]>

fixed USMART titles

ba185c405f5b43a372b3f927f29e51e0f94331c3 authored almost 3 years ago by Karen Jewell <[email protected]>

Add PHS CKAN datasets

026db02f60045052b5b5598cb5212896bbb063b9 authored almost 3 years ago by Jack Gilmore <[email protected]>

Give max length for filenames and run pipeline.

f641e8dfaed5af2bfd5914d75ed7cd92a60f321f authored almost 3 years ago by Robert McWilliam <[email protected]>

Cleanup CKAN scraper code

43efcdacd8a602c14e986b339a366218c7d8745f authored almost 3 years ago by Jack Gilmore <[email protected]>

Remove CKAN instances that are now ArcGIS

dfa425ddfe17de72f80919e4295d1b0dbf24c505 authored almost 3 years ago by Jack Gilmore <[email protected]>

Merge branch 'main' of https://github.com/OpenDataScotland/the_od_bods

db56f4e0715f079f1e37677e7235ab519c5326b3 authored almost 3 years ago by Jack Gilmore <[email protected]>

Fix ckan output date swapping

33639e9f55b1809402d7d2cf7ee31dcc6edc9574 authored almost 3 years ago by Jack Gilmore <[email protected]>

Merge branch 'main' of https://github.com/CodeTheCity/the_od_bods into main

5e0b43aacbe0a8dae9736bfb16ed38056eac01fa authored almost 3 years ago by Karen Jewell <[email protected]>

tidied data categories, removed trailing seperator

55e8377089af325e92e123f7d423d90a2a779d5e authored almost 3 years ago by Karen Jewell <[email protected]>

Move page_url to new field rather than being part of resources.

13214eaf6533530f0625b7e98cb1272b0264828e authored almost 3 years ago by Robert McWilliam <[email protected]>

Merge branch 'main' of github.com:OpenDataScotland/the_od_bods into main

7ed43f76a08bca39e778d7821de3170826bcbc13 authored almost 3 years ago by Robert McWilliam <[email protected]>

Update arcgis scraper to go through all 4 sources, capture license URL when there, and data from running it now.

491e4b264aa183e42a1485a0c2c20a64de7772ac authored almost 3 years ago by Robert McWilliam <[email protected]>

moved USMART output to /data

d431927c3e310955714c2c00f1c580bd32a0f29e authored almost 3 years ago by Karen Jewell <[email protected]>

moved scotgov data to /data, updated jkan export

856bb578520dfe9a4ceb856f670847322a20643e authored almost 3 years ago by Karen Jewell <[email protected]>

removed more redundant display files because JKAN

b24cfbb9aae5f66f4250814da8a016116b3d21b1 authored almost 3 years ago by Karen Jewell <[email protected]>

removed od_bods folder as redundant now we have JKAN frontend

488105956f3dec0a403e24447484645548c5a582 authored almost 3 years ago by Karen Jewell <[email protected]>

added archive folder in /data to allow storing of data snapshots over time

0e9e7e03a8c8e4fdf7920d51111b39142dd75a0d authored almost 3 years ago by Karen Jewell <[email protected]>

Fix spelling mistake

a71cab5320c93be8b1a3e668fb2cceb471049407 authored about 3 years ago by Robert McWilliam <[email protected]>

Move SPARQL walkthrough to docs/ to get served on github.io

2fbee5e4cfe414bcba0a7a4cbb61dc2cc7d941b3 authored about 3 years ago by Robert McWilliam <[email protected]>

Merge pull request #47 from ash-mcc/sparql-scotgov-import

An exploration of the datasets available at the Scot gov's SPARQL end…

461ce93f36731da49b9242b2957bdc1b77267f14 authored about 3 years ago by ormiret <[email protected]>

An exploration of the datasets available at the Scot gov's SPARQL endpoint

b9f3e37b2493fd3c71143742a9eebd50829a65d2 authored about 3 years ago by ash-mcc <[email protected]>

Some more cleanup of organisation strings

085bf60095d513aee3eaff3657fe8d142bd8cc2b authored about 3 years ago by Robert McWilliam <[email protected]>

Add datasets from statistics.gov.scot

596610603f1f085493b9f3ddc95563172f747d81 authored about 3 years ago by Robert McWilliam <[email protected]>

Add some clean up for organisations

16b2dce59062d0179f0f3543712e99e92dab8572 authored about 3 years ago by Robert McWilliam <[email protected]>

remove SEPA dataset fiels

926ded6d8bce1058463df28366b7ac5855381b6d authored about 3 years ago by Robert McWilliam <[email protected]>

updated analytics to use 27 Jun 2021 not current date for last x days info

f8618792d811e0ba906ca3c2617149f032bfd611 authored about 3 years ago by Karen Jewell <[email protected]>

fixed README with proper opendata.scot link this time

110b5a9451b6758aa313ebce760a1194f3381f05 authored about 3 years ago by Karen Jewell <[email protected]>

Updated README with opendata.scot and slack links

5d70417a4786c8fb30b4c1ef210ca576ddad325c authored about 3 years ago by Karen Jewell <[email protected]>

Update record counts to handle float

391bb57b57f28e627901238df00bdcd86bf57a32 authored about 3 years ago by Robert McWilliam <[email protected]>

Some more license string -> URL translations

0b7b4f5bf88ac00c9af8b12f339dae84b4f0b303 authored about 3 years ago by Robert McWilliam <[email protected]>

Add some more fields to jkan datasets

dd5f9dd9cf57dd278aef9d84fab8146aa8d218c3 authored about 3 years ago by Robert McWilliam <[email protected]>

Merge pull request #40 from OpenDataScotland/jkan-generation-test

Jkan dataset files generation

b0d3358b112fd62ee9bb1cdb9c0efbd816cf4eb2 authored about 3 years ago by ormiret <[email protected]>

Add markdown rendering of notes and change name of script

9bd1973ebd46e3b7ea4c0995167b0ae59815ddf1 authored about 3 years ago by Robert McWilliam <[email protected]>

Merge branch 'main' of https://github.com/CodeTheCity/the_od_bods into main

6a580cfcdaa57e3a8f3bbf9e6489d4f50521a8b3 authored about 3 years ago by Karen Jewell <[email protected]>

fixed index issue that cause the scorecard to fail. analysis also now has URL status info

c210b3326a5868c87807913b226e474fe90222ec authored about 3 years ago by Karen Jewell <[email protected]>

switch to using pyyaml to generate the block of YAML for datasets

e9cd4b1b4f1a5326fef6b0df725bd4e5de231a2d authored about 3 years ago by Robert McWilliam <[email protected]>

Clean up rendering of _datasets/

f29cd0803e8e2b4f45b7f61dba665a01552dddc4 authored about 3 years ago by Robert McWilliam <[email protected]>

First pass at switchign render.py to produce markdown that JKAN can use.

fdb8adfe8125a454a18df19dc1fc9308c0fcf56c authored about 3 years ago by Robert McWilliam <[email protected]>

Updated the README

Moved the original README to the wiki to preserve it: https://github.com/OpenDataScotland/the_od...

a9ef02ec5dea0976d216743e1edd8190869c0bc6 authored about 3 years ago by Karen Jewell <[email protected]>

Rework file links to take out superfluous file_type when there is a URL

432344c25f1bf71e47447b2e4fe846e23c660bef authored over 3 years ago by Robert McWilliam <[email protected]>

Some cleaning up of page rendering (closes #2)

d0a52c2636f595b34f403eb262bbf68a69aff836 authored over 3 years ago by Robert McWilliam <[email protected]>

Add link to analytics

85757459e20e6eb86c04b1a5b1c7ff08a9f73068 authored over 3 years ago by Robert McWilliam <[email protected]>

update to issue 5 - changes were missing + added better comments

3711662ba174ff0452011c11d98a6e3af03bc593 authored over 3 years ago by Karen Jewell <[email protected]>

Add bash script to run analytics

8512c1c15467359749ef722f317fe7b968bcd215 authored over 3 years ago by Robert McWilliam <[email protected]>

Merge branch 'main' of https://github.com/CodeTheCity/the_od_bods into main

4e7044b1ac86270fb7726ee67750912f794597c0 authored over 3 years ago by Karen Jewell <[email protected]>

issue 5 - separated data merging function from the analysis notebook and calling it back in the analysis.ipynb file

cf05264fac175bb2b5eb409b61b1435a3de24bd1 authored over 3 years ago by Karen Jewell <[email protected]>

Fix sorting to put datasets wtihout dates at the end.

56c623c2211affa85d6db2a7548ec6b66dcce150 authored over 3 years ago by Robert McWilliam <[email protected]>

minor styling changes to make html file more human-readable friendly

1d2ea057b2bc66a810c48505fe910c9f6030e29b authored over 3 years ago by Karen Jewell <[email protected]>

Merge branch 'main' of https://github.com/CodeTheCity/the_od_bods into main

920a46a340ef35590ddf4f231efb69b4888f5fe3 authored over 3 years ago by Karen Jewell <[email protected]>

last of the analysis commentary and newest versions of all outputs

c19d8e0bbf73ea31872a243db8e7634f49d7dacf authored over 3 years ago by Karen Jewell <[email protected]>

added usmart source

4c6b683b7fa397b2fa241807bf708a1992ffe729 authored over 3 years ago by Karen Jewell <[email protected]>

Add percentage to progress bar (makes it a bit clearer it's a progress bar)

628fe2d990041bc73b6e878f1f6207ecfa51e303 authored over 3 years ago by Robert McWilliam <[email protected]>

Merge branch 'main' of https://github.com/CodeTheCity/the_od_bods into main

7e6e6a780a12448a1bc4ab68f65d4936c5eef0e4 authored over 3 years ago by Karen Jewell <[email protected]>

Merge pull request #1 from ormiret/main

Delete index.md

05e8a297ca0c48d2839674599cc60e65409e0427 authored over 3 years ago by ormiret <[email protected]>

Delete index.md

5332e4c178bd4c68b953e65eda805a30268568a5 authored over 3 years ago by ormiret <[email protected]>

Some tweaks to rendering.

0f6e7fdea4520da2634cff062546a4336e73d83b authored over 3 years ago by Robert McWilliam <[email protected]>

Somre more work on rendering list

86db54c342c98bb92c873f3d00bd569ddb5d1f80 authored over 3 years ago by Robert McWilliam <[email protected]>

Add (start of) notes for things wrong with rendered list.

1871ff096838d4dff29297942a376e1ae6d27015 authored over 3 years ago by Robert McWilliam <[email protected]>

Move things around to put rendered list in docs/

67d10b1046e38b56713fbb7253ea9aa2b2a91133 authored over 3 years ago by Robert McWilliam <[email protected]>

add USMART data exports

f515383befbd7307b2c0d8cfb54600824dd90783 authored over 3 years ago by watty62 <[email protected]>

Ecosyste.ms: OpenCollective

github.com/OpenDataScotland/the_od_bods