Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
github.com/astropy/learn-astropy-librarian
The content crawler that supplies Learn Astropy's web search.
https://github.com/astropy/learn-astropy-librarian
Bump actions/setup-python from 3 to 4
714e62c932d74352ab3c22464cac0bed8ea367cf authored over 2 years ago by Jonathan Sick <[email protected]>
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 3 to 4.
- [Release no...
ce0f4871b2e5531bf6657a52072a0568263b8c6b authored over 2 years ago by Jonathan Sick <[email protected]>
Bumps [pre-commit/action](https://github.com/pre-commit/action) from 2.0.3 to 3.0.0.
- [Release ...
Update for new nbconvert html format
f6a7cbd42ce0323b6d62f842a67eeeb7c31160b2 authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
The latest nbconvert HTML template (used by nbcollection) no longer makes
.jp-RenderedHTMLCommon...
Update pre-commit hooks
9eba9e26b305fbc8b323f83a29bb52d6b355b5ac authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
In particular, the black update is needed to resolve an incompatibility
with click.
Bump actions/cache from 2 to 3
59f9350b8112b1c1e3e4a91dba1fa06c2f510612 authored almost 3 years ago by Jonathan Sick <[email protected]>
Bumps [actions/cache](https://github.com/actions/cache) from 2 to 3.
- [Release notes](https://g...
Bump actions/setup-python from 2 to 3
9ba04053d4598051006ae28407170b72bec4606e authored almost 3 years ago by Adrian Price-Whelan <[email protected]>Bump actions/checkout from 2 to 3
71343f3419aa4aa38984abaa4733acf6e8d1ddec authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 2 to 3.
- [Release no...
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3.
- [Release notes](htt...
Fixes and improvements for tutorial indexing
6c60345cf10ae6a2340a5df4873c3641ed4079fd authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
The maximum record size in the free plan is 10KB, so we need to split
records that are larger th...
89c159014e819b2c8de98838c99c7a374f3b17de authored almost 3 years ago by Jonathan Sick <[email protected]>
The previous reducer was doing extra recursion of content elements,
resulting in bloated Algolia...
3835a9b3192af8bf5c2333d9c6ebf4001290d7b2 authored almost 3 years ago by Jonathan Sick <[email protected]>
43603d9f62894dbbb88d2bff2bbbd129cc304c37 authored almost 3 years ago by Jonathan Sick <[email protected]>
This was accidentally left as a typing-only import, whereas the
index_tutorial_from_path workflo...
Add ability to index tutorials from local files
d6c5f4ba6e9baeff4fa5813aba9ddf6fea7c50ea authored almost 3 years ago by Jonathan Sick <[email protected]>e22db88ba4a58aa7cd451a2f59b0ab88bd9c03cd authored almost 3 years ago by Jonathan Sick <[email protected]>
This allows us to run a single command in a CI environment that points
to the rendered tutorials...
Passing --path allows the index tutorial command to get HTML from a
local build, rather than sou...
This provides a built-in way of creating the HtmlPage resource from
locally-available data.
Ref...
dba8615b8cd58984d0d1e203c0c4a1a65e701692 authored about 3 years ago by Jonathan Sick <[email protected]>
This splits the index_tutorial workflow into an index_tutorial core
workflow that takes a pre-do...
Index nbcollection-built tutorial pages
4dd16609df165e35b02f1d86a99c7f5adfc0de15 authored about 3 years ago by Adrian Price-Whelan <[email protected]>119f13796107da9d29125cadaa14aac2bb1da36b authored about 3 years ago by Jonathan Sick <[email protected]>
This is an nbcollection-generated version of the Coordinates-Transforms
tutorial. Note that this...
c2365f4a53b0bc133a6f9b2bf8c78021565ac8a1 authored about 3 years ago by Jonathan Sick <[email protected]>
Different notebook-to-html converters will have different HTML
structures, so it makes sense to ...
Add Priority field
a6a2ba4dd9822d0f1410e23eca2bb8cf3108f825 authored about 3 years ago by Adrian Price-Whelan <[email protected]>58328087c13e566d0ade5630424bf2dfffee2b49 authored about 3 years ago by Jonathan Sick <[email protected]>
Adjust "importance" field for Guides
815011b3185318288fa6d844c9a7c65c19d36029 authored over 3 years ago by Adrian Price-Whelan <[email protected]>
Before a user starts to enter a search term on the Learn Astropy
homepage, we want the search re...
This is now possible because JupyterBookMetadata contains the homepage's
URL.
The first record of the guides homepage now exclusively has an
importance of 1; the first record...
This will allow us to know if a page is actually the homepage, and thus
should be treated with a...
Initial JupyterBook ingest feature
68f6b34b59ac03bfaf5cec7c4f8a25f128701cc5 authored over 3 years ago by Jonathan Sick <[email protected]>
The mock hasn't been fully developed so it currently doesn't count
network requests. We'll docum...
738bee75801deaa2eb2ea78817bcd2c443dc659c authored over 3 years ago by Jonathan Sick <[email protected]>
Co-authored-by: Adrian Price-Whelan <[email protected]>
c3512ca8cb25549b826bf6ae88b37cab36930f19 authored over 3 years ago by Jonathan Sick <[email protected]>Co-authored-by: Adrian Price-Whelan <[email protected]>
9ea5d0f75389854fd989f3f5afd2402665565a91 authored over 3 years ago by Jonathan Sick <[email protected]>37c7537a49cef3db820d207bcafb7d711913c8be authored over 3 years ago by Jonathan Sick <[email protected]>
New tutorials now use <section> tags around each content chunk, rather
than <div> tags with a cl...
Previously we were also accidentally selecting from the on-page nav. Now
by explicitly selecting...
2bd0c71bf061260e859455089a12bd33a6a548d6 authored over 3 years ago by Jonathan Sick <[email protected]>
This is the same content as the original color excess tutorial, but the
HTML structure is now di...
At the end of an indexing workflow, now run the expire_old_records
workflow that finds records f...
The index_epoch field in the Algolia record schemas is for associating a
unique identifier for a...
9d1b07832cf74238ab9cd5b6ed429a9e05453abf authored over 3 years ago by Jonathan Sick <[email protected]>
The issue is that algoliasearch's save_objects() wants python objects
rather than JSON-encoded s...
This command enables us to delete all records associated with a root_url
(useful for debugging).
The logging at "info" level (-v) provides summaries of what URLs are
indexed and how many record...
This is a decision we might want to re-address, but for this this commit
effectively omits Jupyt...
e1027e5162ee52a2211df64733203e3a26ec69ee authored over 3 years ago by Jonathan Sick <[email protected]>
12b6522c2a6c819edcda70df3143fc402ab44e8a authored over 3 years ago by Jonathan Sick <[email protected]>
This context manager does a few things for us:
1. Rather than needing to pass around both the S...
a38fc22aee0bf0f0d4ee077ddf910034a121afdb authored over 3 years ago by Jonathan Sick <[email protected]>
The HtmlComment type is generating a ValueError from .text_content().
For now, handle this excep...
The precise name "objectID" is required by Algolia.
2c0d69d6abbae312a89b7ed68fec906bcb2cfa9e authored over 3 years ago by Jonathan Sick <[email protected]>Includes both "index tutorial" and "index guide" subcommands.
53f2ab1fc1b157531cf7bbe4e4a87ad247b88b3a authored over 3 years ago by Jonathan Sick <[email protected]>f43dc4259c706e43d13be654e3ffa595a9db3ffe authored over 3 years ago by Jonathan Sick <[email protected]>
The new CLI replaces this argparse-based command and will incorporate
the functionality of inges...
Add this static method to the base AlgoliaRecord so that any record
being built from a Section c...
f473ce2ba0d2d1c54519bea29da6b58dbc918097 authored over 3 years ago by Jonathan Sick <[email protected]>
- Use typer framework, which is adds annotations to click
- Design the CLI are commands. There's...
The index_jupyterbook workflow identifies pages in a JupyterBook, and
for each page, launches an...
Similar to TutorialRecord, the GuideRecord is a pydantic model for an
Algolia record of a piece ...
Since Jupyter Book is based on Sphinx, we can use the same
iter_sphinx_sections function as we u...
This field is the overall summary for a documentation project (a
tutorial or a guide). Each reco...
And move to astropylibrarian.reducers. This dataclass now becomes the
basis for reducing content...
This replaces TutorialSectionRecord with the pydantic model,
TutorialRecord.
This change allows...
79eaae6544edd7bdd4de0f8c28e034deb5d74444 authored over 3 years ago by Jonathan Sick <[email protected]>
I'm having trouble with aliases in sub-models. For now I'm dropping
aliases, but may bring them ...
282e24fa18cbe4ff8c93afd06b09034fe0aa2737 authored over 3 years ago by Jonathan Sick <[email protected]>
AlgoliaRecord will serve as a base model that individual content types
can subclass to provide a...
This metadata provides context while indexing individual pages from a
JupyterBook.
New class Ju...
a1b1dad840e2fdea0e7f9c6cbcc4b97be491f428 authored over 3 years ago by Jonathan Sick <[email protected]>
The new HtmlPage class provides context and utilities around a
downloaded HTML page, such as the...
The key problem this workflow is tackling at first is that the
"homepage" of a Jupyter Book is n...
Get the URLs of all pages in a Jupyter Book from the 'nav' element.
f258654d4735ed298bac20b01283835b89b82fe0 authored over 3 years ago by Jonathan Sick <[email protected]>
This test dataset is from [A guide to CCD data reduction and stellar
photometry using astropy an...
1923a76b0cedd2b37b08020887e14f04d07bb581 authored over 3 years ago by Jonathan Sick <[email protected]>
Format code with Black and isort
1e90f01e98a139abbb3f347d22fdedad5ef145e5 authored over 3 years ago by Adrian Price-Whelan <[email protected]>ef28e1df1e1b5cea1181dcee4c9c88f8f96c6649 authored over 3 years ago by Jonathan Sick <[email protected]>
Black formats code and isort formats imports. Both run via pre-commit.
Flake8 runs after these t...
Update testing around tox
7c9a3a3008ca2181fe0e68ac5aba561399bdcd7f authored over 3 years ago by Jonathan Sick <[email protected]>3dfe1bd974b56ea682756d809a148e1a2a6254c8 authored over 3 years ago by Jonathan Sick <[email protected]>
This splits the CI up so that linting and type checking are separate
from running unit tests; un...
This will help us keep up to date with our dependencies and their bug
fixes a bit better.
This handles some intricacies of the pre-commit and tox set up: namely
that pre-commit hooks nee...
55e18292301dadfd009eaeea72edc2fdfa2c5ee1 authored over 3 years ago by Jonathan Sick <[email protected]>
40ea9ecc78be3335c813818a4331077f21d120ce authored over 3 years ago by Jonathan Sick <[email protected]>
e06b3be383f00572d66576b87a437c2ae5cffe87 authored over 3 years ago by Jonathan Sick <[email protected]>
This is my go-to configuration.
e5a2f798fe2c7916a4cbc3633d3bbd6d05a4c041 authored over 3 years ago by Jonathan Sick <[email protected]>4be578ff06ea3fc9bfbf2bf8c9b8d90840498ef5 authored over 3 years ago by Jonathan Sick <[email protected]>
The tests were missing return types and also types for the pytest
fixture.
This also adds flake8 to the "linting" tox environment, from the unit
test environment. This is ...
This lint environment is a front-end for running pre-commit on all
files.
Tox will let us improve our testing and CI workflow.
1bf7be4c123957d2854dba296161a69e96ff86c8 authored over 3 years ago by Jonathan Sick <[email protected]>Sort tutorial keywords into types with a keyword vocabulary
bf473cc4f41bce4289b4caa880bcbc15c90de179 authored over 3 years ago by Adrian Price-Whelan <[email protected]>