Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/astropy/learn-astropy-librarian

The content crawler that supplies Learn Astropy's web search.
https://github.com/astropy/learn-astropy-librarian

Merge pull request #30 from astropy/dependabot/github_actions/actions/setup-python-4

Bump actions/setup-python from 3 to 4

714e62c932d74352ab3c22464cac0bed8ea367cf authored over 2 years ago by Jonathan Sick <[email protected]>
Bump actions/setup-python from 3 to 4

Bumps [actions/setup-python](https://github.com/actions/setup-python) from 3 to 4.
- [Release no...

6103fe5a10f5e0d0b5387ca6a437849322119bb2 authored over 2 years ago by dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Merge pull request #29 from astropy/dependabot/github_actions/pre-commit/action-3.0.0

ce0f4871b2e5531bf6657a52072a0568263b8c6b authored over 2 years ago by Jonathan Sick <[email protected]>
Bump pre-commit/action from 2.0.3 to 3.0.0

Bumps [pre-commit/action](https://github.com/pre-commit/action) from 2.0.3 to 3.0.0.
- [Release ...

451b36bf8d26dc37b8854e147aaec3552b999dce authored over 2 years ago by dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Merge pull request #28 from jonathansick/update-nbconvert-html-parser

Update for new nbconvert html format

f6a7cbd42ce0323b6d62f842a67eeeb7c31160b2 authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
Update for new nbconvert html format

The latest nbconvert HTML template (used by nbcollection) no longer makes
.jp-RenderedHTMLCommon...

09fc81af61c2b847e6b8a3cc428e4c9d1a36df52 authored almost 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #27 from jonathansick/update-precommit

Update pre-commit hooks

9eba9e26b305fbc8b323f83a29bb52d6b355b5ac authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
Update pre-commit hooks

In particular, the black update is needed to resolve an incompatibility
with click.

7f7863a40e71bc023fc7cc5a54ce42688c54561e authored almost 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #26 from astropy/dependabot/github_actions/actions/cache-3

Bump actions/cache from 2 to 3

59f9350b8112b1c1e3e4a91dba1fa06c2f510612 authored almost 3 years ago by Jonathan Sick <[email protected]>
Bump actions/cache from 2 to 3

Bumps [actions/cache](https://github.com/actions/cache) from 2 to 3.
- [Release notes](https://g...

fc090dcbcac38915d1b72a0054d7f221255c2e45 authored almost 3 years ago by dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Merge pull request #25 from astropy/dependabot/github_actions/actions/setup-python-3

Bump actions/setup-python from 2 to 3

9ba04053d4598051006ae28407170b72bec4606e authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
Merge pull request #24 from astropy/dependabot/github_actions/actions/checkout-3

Bump actions/checkout from 2 to 3

71343f3419aa4aa38984abaa4733acf6e8d1ddec authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
Bump actions/setup-python from 2 to 3

Bumps [actions/setup-python](https://github.com/actions/setup-python) from 2 to 3.
- [Release no...

0348889676d1931ba2517f6009be66fdad9e1de3 authored almost 3 years ago by dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bump actions/checkout from 2 to 3

Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3.
- [Release notes](htt...

571ab2018dbb33204f9567171e6ec07f1d436f01 authored almost 3 years ago by dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Merge pull request #23 from jonathansick/fix-local-indexing

Fixes and improvements for tutorial indexing

6c60345cf10ae6a2340a5df4873c3641ed4079fd authored almost 3 years ago by Adrian Price-Whelan <[email protected]>
Split records for Algolia size limit

The maximum record size in the free plan is 10KB, so we need to split
records that are larger th...

5bfe9b2c77f20580f9602251733062964c533768 authored almost 3 years ago by Jonathan Sick <[email protected]>
Fix typo in getting object IDs from Algolia resp

89c159014e819b2c8de98838c99c7a374f3b17de authored almost 3 years ago by Jonathan Sick <[email protected]>
Fix reducer for nbcollection-based tutorials

The previous reducer was doing extra recursion of content elements,
resulting in bloated Algolia...

2b714eafd114f8ff1c865e45d801491f2c2faaf9 authored almost 3 years ago by Jonathan Sick <[email protected]>
Fix missing await in CLI

3835a9b3192af8bf5c2333d9c6ebf4001290d7b2 authored almost 3 years ago by Jonathan Sick <[email protected]>
Improve logging of the index_tutorial workflow

43603d9f62894dbbb88d2bff2bbbd129cc304c37 authored almost 3 years ago by Jonathan Sick <[email protected]>
Fix import for HtmlPage

This was accidentally left as a typing-only import, whereas the
index_tutorial_from_path workflo...

79ef336107f3bb4c144f9573af5b95ddadb2b4b4 authored almost 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #22 from jonathansick/index-from-files

Add ability to index tutorials from local files

d6c5f4ba6e9baeff4fa5813aba9ddf6fea7c50ea authored almost 3 years ago by Jonathan Sick <[email protected]>
Fix API links

e22db88ba4a58aa7cd451a2f59b0ab88bd9c03cd authored almost 3 years ago by Jonathan Sick <[email protected]>
Add index tutorial-site command

This allows us to run a single command in a CI environment that points
to the rendered tutorials...

e93b82999950424591802f8999ec243411031ede authored almost 3 years ago by Jonathan Sick <[email protected]>
Add --path option to index tutorial CLI

Passing --path allows the index tutorial command to get HTML from a
local build, rather than sou...

99c45bdffbc9bb1b160d9ed4e8d5e1a54ecee7fc authored about 3 years ago by Jonathan Sick <[email protected]>
Add HtmlPage.from_path classmethod

This provides a built-in way of creating the HtmlPage resource from
locally-available data.

Ref...

dba8615b8cd58984d0d1e203c0c4a1a65e701692 authored about 3 years ago by Jonathan Sick <[email protected]>
Refactor downloading from index_tutorial

This splits the index_tutorial workflow into an index_tutorial core
workflow that takes a pre-do...

c57429c130c465bec06c6edb2a80462229ab1ed7 authored about 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #19 from jonathansick/index-nbcollection-pages

Index nbcollection-built tutorial pages

4dd16609df165e35b02f1d86a99c7f5adfc0de15 authored about 3 years ago by Adrian Price-Whelan <[email protected]>
Implement iterator for nbcollection sections

119f13796107da9d29125cadaa14aac2bb1da36b authored about 3 years ago by Jonathan Sick <[email protected]>
Add nbcollection-generated coordinates-transform

This is an nbcollection-generated version of the Coordinates-Transforms
tutorial. Note that this...

f2c44536d5484d7f5552a3de24157709c7111132 authored about 3 years ago by Jonathan Sick <[email protected]>
Start developing reducer for nbcollection pages

c2365f4a53b0bc133a6f9b2bf8c78021565ac8a1 authored about 3 years ago by Jonathan Sick <[email protected]>
Make ReducedTutorial a base for specialists

Different notebook-to-html converters will have different HTML
structures, so it makes sense to ...

23ae6f23eddf1ede9152d4a59da237ae5f20bc8a authored about 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #18 from jonathansick/priority-field

Add Priority field

a6a2ba4dd9822d0f1410e23eca2bb8cf3108f825 authored about 3 years ago by Adrian Price-Whelan <[email protected]>
Add priority field to README docs

58328087c13e566d0ade5630424bf2dfffee2b49 authored about 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #16 from jonathansick/guides-importance

Adjust "importance" field for Guides

815011b3185318288fa6d844c9a7c65c19d36029 authored over 3 years ago by Adrian Price-Whelan <[email protected]>
Add a priority field to records

Before a user starts to enter a search term on the Learn Astropy
homepage, we want the search re...

ac08ce63a37e7a13628f7421af1999b032c905a3 authored over 3 years ago by Jonathan Sick <[email protected]>
Refactor building list of all guide pages

This is now possible because JupyterBookMetadata contains the homepage's
URL.

3e31f7ac0cb52069a5868bdb175b0189b49b69a6 authored over 3 years ago by Jonathan Sick <[email protected]>
Elevate importance of guide homepage record

The first record of the guides homepage now exclusively has an
importance of 1; the first record...

465293d674d04591a5e89f1982f3f2b34c74e117 authored over 3 years ago by Jonathan Sick <[email protected]>
Record the homepage_url with JupyterBookMetadata

This will allow us to know if a page is actually the homepage, and thus
should be treated with a...

ceea253016a6cdc66cae9023e09740bb86274f43 authored over 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #13 from jonathansick/jupyter-book-ingest

Initial JupyterBook ingest feature

68f6b34b59ac03bfaf5cec7c4f8a25f128701cc5 authored over 3 years ago by Jonathan Sick <[email protected]>
Improve docstring for MockAlgoliaIndex

The mock hasn't been fully developed so it currently doesn't count
network requests. We'll docum...

98b6ba0ddee10fd59e48221dfa3dfc58f2df10ea authored over 3 years ago by Jonathan Sick <[email protected]>
Add note to get thumbnails from metadata

738bee75801deaa2eb2ea78817bcd2c443dc659c authored over 3 years ago by Jonathan Sick <[email protected]>
Fix typo in AlgoliaRecord docstring

Co-authored-by: Adrian Price-Whelan <[email protected]>

c3512ca8cb25549b826bf6ae88b37cab36930f19 authored over 3 years ago by Jonathan Sick <[email protected]>
Fix docstring typo

Co-authored-by: Adrian Price-Whelan <[email protected]>

9ea5d0f75389854fd989f3f5afd2402665565a91 authored over 3 years ago by Jonathan Sick <[email protected]>
Add documentation for the CLI

37c7537a49cef3db820d207bcafb7d711913c8be authored over 3 years ago by Jonathan Sick <[email protected]>
Adapt sphinx section iterator to section tags

New tutorials now use <section> tags around each content chunk, rather
than <div> tags with a cl...

6c4493a95577138a20955a475975967bfe64f7f5 authored over 3 years ago by Jonathan Sick <[email protected]>
Get JupyterBook URLs from main nav only

Previously we were also accidentally selecting from the on-page nav. Now
by explicitly selecting...

d63e4f0f448d2cb9b943a037fb4e6ec067d02ac6 authored over 3 years ago by Jonathan Sick <[email protected]>
Parse metadata from section-based tutorials

2bd0c71bf061260e859455089a12bd33a6a548d6 authored over 3 years ago by Jonathan Sick <[email protected]>
Add color-excess-v2 tutorial test dataset

This is the same content as the original color excess tutorial, but the
HTML structure is now di...

a1b3f257586fadce6ab7113ed8bc16d73021ee72 authored over 3 years ago by Jonathan Sick <[email protected]>
Implement object expiration with index_epoch key

At the end of an indexing workflow, now run the expire_old_records
workflow that finds records f...

b58d8779ef67c3e8f812642e03e4cd59e02ab0ec authored over 3 years ago by Jonathan Sick <[email protected]>
Add index_epoch record field

The index_epoch field in the Algolia record schemas is for associating a
unique identifier for a...

55e602f5dab7817a85ba2a91de1ecb81a9e5968a authored over 3 years ago by Jonathan Sick <[email protected]>
Add type stubs for pkg_resources and PyYAML

9d1b07832cf74238ab9cd5b6ed429a9e05453abf authored over 3 years ago by Jonathan Sick <[email protected]>
Add iter_algolia_objects() to records

The issue is that algoliasearch's save_objects() wants python objects
rather than JSON-encoded s...

159ab84cea9e64b836d134ad323966ff7fd79a9b authored over 3 years ago by Jonathan Sick <[email protected]>
Implement delete command

This command enables us to delete all records associated with a root_url
(useful for debugging).

d31c1e7e43286940d456074025370781417907fb authored over 3 years ago by Jonathan Sick <[email protected]>
Improve logging in workflows

The logging at "info" level (-v) provides summaries of what URLs are
indexed and how many record...

6f3f59f0186b78fa1acaae17b450bd40b46b2b52 authored over 3 years ago by Jonathan Sick <[email protected]>
Omit cell_output from ingest

This is a decision we might want to re-address, but for this this commit
effectively omits Jupyt...

77aae48704ceb0f94c5ec5f16a074c14f55df742 authored over 3 years ago by Jonathan Sick <[email protected]>
Update because of object_id to ObjectID

e1027e5162ee52a2211df64733203e3a26ec69ee authored over 3 years ago by Jonathan Sick <[email protected]>
Switch workflows to use the AlgoliaIndex

12b6522c2a6c819edcda70df3143fc402ab44e8a authored over 3 years ago by Jonathan Sick <[email protected]>
Create an Algolia index context manager

This context manager does a few things for us:

1. Rather than needing to pass around both the S...

a38fc22aee0bf0f0d4ee077ddf910034a121afdb authored over 3 years ago by Jonathan Sick <[email protected]>
Work around issue with HtmlComment

The HtmlComment type is generating a ValueError from .text_content().
For now, handle this excep...

838f9f9603794073c0a1f6208baea84c69c91c5b authored over 3 years ago by Jonathan Sick <[email protected]>
Switch object_id to objectID

The precise name "objectID" is required by Algolia.

2c0d69d6abbae312a89b7ed68fec906bcb2cfa9e authored over 3 years ago by Jonathan Sick <[email protected]>
Implement astropylibrarian index commands

Includes both "index tutorial" and "index guide" subcommands.

53f2ab1fc1b157531cf7bbe4e4a87ad247b88b3a authored over 3 years ago by Jonathan Sick <[email protected]>
More conversion of workflows to AlgoliaIndex

f43dc4259c706e43d13be654e3ffa595a9db3ffe authored over 3 years ago by Jonathan Sick <[email protected]>
Delete the demo CLI

The new CLI replaces this argparse-based command and will incorporate
the functionality of inges...

a8eed75f2110212a80fd2e1b40a4fd31c1352431 authored over 3 years ago by Jonathan Sick <[email protected]>
Refactor computation of object ID

Add this static method to the base AlgoliaRecord so that any record
being built from a Section c...

c5f9d930c4b77fec8b74f3ae6f84fc38250d40b9 authored over 3 years ago by Jonathan Sick <[email protected]>
Configure logging for astropylibrarian app

f473ce2ba0d2d1c54519bea29da6b58dbc918097 authored over 3 years ago by Jonathan Sick <[email protected]>
Sketch out astropylibrarian CLI

- Use typer framework, which is adds annotations to click
- Design the CLI are commands. There's...

f651b77113d619f6482b6187af91345331be8e7a authored over 3 years ago by Jonathan Sick <[email protected]>
index_jupyterbook triggers workflow for page

The index_jupyterbook workflow identifies pages in a JupyterBook, and
for each page, launches an...

a3b379158d9dcbe5fb0249f89fac7082bdbf3632 authored over 3 years ago by Jonathan Sick <[email protected]>
Create Algolia GuideRecord

Similar to TutorialRecord, the GuideRecord is a pydantic model for an
Algolia record of a piece ...

e71cb1bbb68366c952ccb95f140097ec917d2267 authored over 3 years ago by Jonathan Sick <[email protected]>
Iterate over sections in a Jupyter Book page

Since Jupyter Book is based on Sphinx, we can use the same
iter_sphinx_sections function as we u...

a5494d715827b1bea7d48b83db6c6ce9b67e8f06 authored over 3 years ago by Jonathan Sick <[email protected]>
Add root_summary field to Algolia record

This field is the overall summary for a documentation project (a
tutorial or a guide). Each reco...

8516f771c3801bf1bba35bd9b4408ee11207f62f authored over 3 years ago by Jonathan Sick <[email protected]>
Refactor JupyterBookHomepage -> JupyterBookPage

And move to astropylibrarian.reducers. This dataclass now becomes the
basis for reducing content...

9bd22a78663bc20d40ebaab4fa4a8f74bbc66601 authored over 3 years ago by Jonathan Sick <[email protected]>
Refactor tutorial indexing around pydanic model

This replaces TutorialSectionRecord with the pydantic model,
TutorialRecord.

This change allows...

79eaae6544edd7bdd4de0f8c28e034deb5d74444 authored over 3 years ago by Jonathan Sick <[email protected]>
Drop aliases from pydantic model

I'm having trouble with aliases in sub-models. For now I'm dropping
aliases, but may bring them ...

f73ed60e46684a5d5770e29346f009edaa99d0c0 authored over 3 years ago by Jonathan Sick <[email protected]>
Create TutorialRecord pydantic model

282e24fa18cbe4ff8c93afd06b09034fe0aa2737 authored over 3 years ago by Jonathan Sick <[email protected]>
Create a Pydantic model for algolia records

AlgoliaRecord will serve as a base model that individual content types
can subclass to provide a...

88581946863ee072b4ce93314981dc0f1729847c authored over 3 years ago by Jonathan Sick <[email protected]>
Extract metadata from the JupyterBook homepage

This metadata provides context while indexing individual pages from a
JupyterBook.

New class Ju...

a1b1dad840e2fdea0e7f9c6cbcc4b97be491f428 authored over 3 years ago by Jonathan Sick <[email protected]>
Refactor download_html to return HtmlPage

The new HtmlPage class provides context and utilities around a
downloaded HTML page, such as the...

5fa651313e5ede5d5e1a265f907d60991f2dd6be authored over 3 years ago by Jonathan Sick <[email protected]>
Start workflow for ingesting jupyter books

The key problem this workflow is tackling at first is that the
"homepage" of a Jupyter Book is n...

26076b834fe764448c4e268a039b79298db6502a authored over 3 years ago by Jonathan Sick <[email protected]>
Add extract_page_urls

Get the URLs of all pages in a Jupyter Book from the 'nav' element.

f258654d4735ed298bac20b01283835b89b82fe0 authored over 3 years ago by Jonathan Sick <[email protected]>
Add test files from ccd-guide

This test dataset is from [A guide to CCD data reduction and stellar
photometry using astropy an...

1e9558b023eb9cb6eea91a18b379d4958df1eee9 authored over 3 years ago by Jonathan Sick <[email protected]>
Enable doctest testing through pytest

1923a76b0cedd2b37b08020887e14f04d07bb581 authored over 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #12 from jonathansick/black

Format code with Black and isort

1e90f01e98a139abbb3f347d22fdedad5ef145e5 authored over 3 years ago by Adrian Price-Whelan <[email protected]>
Reformat code with black and isort

ef28e1df1e1b5cea1181dcee4c9c88f8f96c6649 authored over 3 years ago by Jonathan Sick <[email protected]>
Add black and isort

Black formats code and isort formats imports. Both run via pre-commit.
Flake8 runs after these t...

4ff1029ef7de915cf33c14e44b0818ce05a03fc0 authored over 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #11 from jonathansick/update-packaging

Update testing around tox

7c9a3a3008ca2181fe0e68ac5aba561399bdcd7f authored over 3 years ago by Jonathan Sick <[email protected]>
Add dependabot for GitHub Actions

3dfe1bd974b56ea682756d809a148e1a2a6254c8 authored over 3 years ago by Jonathan Sick <[email protected]>
GitHub Actions CI now uses tox

This splits the CI up so that linting and type checking are separate
from running unit tests; un...

e083ba4be69d6bd90b6f2aa83a7f2969389f8b35 authored over 3 years ago by Jonathan Sick <[email protected]>
Relax runtime dependency pinning

This will help us keep up to date with our dependencies and their bug
fixes a bit better.

6afc7765200a95d3be106280377e780770c816f6 authored over 3 years ago by Jonathan Sick <[email protected]>
Add make init command to set up dev environment

This handles some intricacies of the pre-commit and tox set up: namely
that pre-commit hooks nee...

1d7066d4e94ada6e608aeef6451797732c9686dc authored over 3 years ago by Jonathan Sick <[email protected]>
Branding update

55e18292301dadfd009eaeea72edc2fdfa2c5ee1 authored over 3 years ago by Jonathan Sick <[email protected]>
Relax pinning on dev dependencies

40ea9ecc78be3335c813818a4331077f21d120ce authored over 3 years ago by Jonathan Sick <[email protected]>
Switch mypy to run in tox typing env

e06b3be383f00572d66576b87a437c2ae5cffe87 authored over 3 years ago by Jonathan Sick <[email protected]>
Improve mypy configuration

This is my go-to configuration.

e5a2f798fe2c7916a4cbc3633d3bbd6d05a4c041 authored over 3 years ago by Jonathan Sick <[email protected]>
Fix type annotations in KeywordDB

4be578ff06ea3fc9bfbf2bf8c9b8d90840498ef5 authored over 3 years ago by Jonathan Sick <[email protected]>
Fix type annotatios in tests

The tests were missing return types and also types for the pytest
fixture.

f627277d42885a2a3cffaa5fc8af8361b5479d7d authored over 3 years ago by Jonathan Sick <[email protected]>
Migrate flake8 linting to pre-commit

This also adds flake8 to the "linting" tox environment, from the unit
test environment. This is ...

50d059a541d4c78ae5cd05d9d5acb90adb8bc0b8 authored over 3 years ago by Jonathan Sick <[email protected]>
Add lint env to tox

This lint environment is a front-end for running pre-commit on all
files.

6e916773c1ce8425e480bbf5663597504ba33837 authored over 3 years ago by Jonathan Sick <[email protected]>
Add tox for running pytest

Tox will let us improve our testing and CI workflow.

1bf7be4c123957d2854dba296161a69e96ff86c8 authored over 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #5 from astropy/keyword-vocabulary

Sort tutorial keywords into types with a keyword vocabulary

bf473cc4f41bce4289b4caa880bcbc15c90de179 authored over 3 years ago by Adrian Price-Whelan <[email protected]>