add wikidata portal QID

add wikidata portal QID

add wikidata portal qid

add wikidata portal QID

add portal QID

add wikidata aid for OD portal

Added ScorRail audio

adding tests for api scrapers

This avoid link list style urls which were messing up the mock data and pytest.

genererate_new_...

Testing:
32 passed in 11.24s

generate_new_mock_data.py will get all the data it can from sources.csv and generate the json an...

Due to differences between unix & windows system the csv line endings need to be enforced.

Test...

Due to issues found between differences in unix and windows systems the file encoding needs to b...

Fix incorrect date parsing for Aberdeenshire data

Add opendatascotland R package

If a number or year appeared in the dataset name then it would be
considered as an incomplete da...

replace deprecated pd.DataFrame.append() method calls

format python files using black

Testing:
None - no code changes

"tests" is the more conventional name for a pytest folder. so just following convention.

Testin...

Now if test/output/ doesn't exits it will be added.

Testing:
ran pytest both with and without "...

minor changes to arcgis to allow for testing.

Testing:
ran pytest 100% pass
24 passed in 1.71s

in order to allow arrest errors to propagate correctly they must be inside conftest.py (or impor...

dcat_test & usmart_test both use the same csv validator test - so it makes sense to group this c...

To pass url validator spaces should be changed for %20

Testing:
ran pytest 100% pass
23 passed ...

Test added for umsmart.py (similar to dcat).

usmart modified slightly to allow for testing.
Thi...

import incorrectly added by my editor. removed.

ignoring the whole mockdata/output folder.

Testing:
Ran pytest - ensured files generate in corr...

this test ensures the csv output is the same as expected - (read as the same output as when this...

This is a fairly simple set of tests for dcat.py. It doesn't not cover everything in detail but ...

previous code may have allowed write_csv to pass without writing a file if the file previously e...

On windows the previous code add "\r\r\n" when writing lines to the csv. specifying the newline ...

This is a fairly simple test but is highlighting a windows based newline error.
On windows the c...

sudo was used incorrectly to name mock items. the word mock is better for this.

find/replace al...

This tests the processor.py script. most functions tested, but not great coverage.
notably - wri...

Sample test will lead to confusion if left, removing

Testing:
None - literally just removed the...

__init__.py required to allow pytest to search for python files.

Testing:
None - nothing to tes...

init.py files should have 2 underscores before and after.

Testing:
None - nothing to test

pytest will allow this project to be tested.
This is an important step before refectoring.
Addin...