Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/astropy/learn-astropy-librarian

The content crawler that supplies Learn Astropy's web search.
https://github.com/astropy/learn-astropy-librarian

Make KeywordDB adapt to keyword groups in YAML

Instead of hardcoding keyword groups into KeywordDB, we know have a
single method for transformi...

fdcda922ad81124dc7fc11ecee3848f7e8d3c0db authored over 3 years ago by Jonathan Sick <[email protected]>
Add logging integration

- Set up a log handler via the CLI and allow the user to set the log
level
- Switch print stat...

e13fd13706919411b9b217e60a44f8644709623a authored over 3 years ago by Jonathan Sick <[email protected]>
Sort keys in keywords database

This sorting is done by hand; ultimately it should be handled by a
pre-commit linter.

This sort...

3e386d06a5d71ffc1de4428a542f612898cae3b0 authored over 3 years ago by Jonathan Sick <[email protected]>
Add a dependency of PyYAML

f637f6a0ed17701be5f03ecf5abffa2f1b69a693 authored over 3 years ago by Jonathan Sick <[email protected]>
Add KeywordDb class

The purpose of this class is to load the YAML keyword database and to
provide an API for sorting...

bb66212bc489a3b3732f26a635b23da36140bc22 authored over 3 years ago by Jonathan Sick <[email protected]>
Allow for alternate forms of keywords

If a keyword has alternate forms (or synonyms) these can be listed by
turning the keyword into a...

07bc95135d9dfdac02c7bc32c730099b2108d539 authored over 3 years ago by Jonathan Sick <[email protected]>
Include package data

3c35c348d87ddc7d38248b02885d3a8468fb50a2 authored over 3 years ago by Jonathan Sick <[email protected]>
Tutorial record now has topic-specific keywords

The "keywords" record field is now replaced with fields for the specific
types of keywords:

- a...

9080bc54eaa409288d6b699c2eb91c0485258360 authored over 3 years ago by Jonathan Sick <[email protected]>
Add keyword vocabulary data file

This is a first shot at making a machine-readable version of the Learn
Astropy keyword vocabular...

69c493df77cf290f1e0c8c1f8be3479efd84819b authored over 3 years ago by Jonathan Sick <[email protected]>
Ensure all keywords are lower-case

Algolia is case-sensitive when sorting keywords alphabetically in its
facet widget. Thus all cap...

2ef26234da7e05eae667682f54388db643770819 authored over 3 years ago by Jonathan Sick <[email protected]>
try cleaning content better

37df4f6f5d2d1dd3790bf8c83cf711179b08ac88 authored over 3 years ago by Jonathan Sick <[email protected]>
Install pre-commit hooks

We'll use pre-commit to help validate data files the we have and will be
adding.

bcde3b5717ab63ed9ad5972daf29ca3df7ef4c07 authored over 3 years ago by Jonathan Sick <[email protected]>
Add check for json

3a26e4db44f26e56548874c01d8f36b766b9e638 authored over 3 years ago by Jonathan Sick <[email protected]>
Try out async method

See example from https://github.com/algolia/algoliasearch-client-python/pull/404

95b1c3f6be35c2cd853ba1e56623963963af9bf7 authored over 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #4 from astropy/tutorial-summary

Tutorial record formatting improvements

788fba51905095cccb14e055ea39ac1429140702 authored over 3 years ago by Adrian Price-Whelan <[email protected]>
Add Coordinates-Transform.html tutorial to tests

This page has the right structure for "Authors", so its useful for
testing the robustness of tha...

7a075295814952b25a699c786c9f8e49d04271d2 authored over 3 years ago by Jonathan Sick <[email protected]>
Set summary as content of h1 sections

This will improve the default display of search results because h1's
typically have no natural c...

b1d5a9fbccb196232cfe4e7688810c0a2bc17539 authored over 3 years ago by Jonathan Sick <[email protected]>
Ignore summary, keywords, and authors sections

These sections don't need to be specifically indexed because they're
already available as metada...

a7519d6b4626e0222d4e95e5f4ab9d8b06fe14e8 authored over 3 years ago by Jonathan Sick <[email protected]>
Add ReducedTutorial.summary attribute

In tutorials, the summary is assumed to be the first paragraph under the
"Summary" heading.

8238bc81846b019e61a4b25b6f192fb94386069a authored over 3 years ago by Jonathan Sick <[email protected]>
Make ReducedTutorial accept input issues

If certain elements can't be found, ReducedTutorial keeps going. We'll
probably want to issue a ...

0d868e60312c9acf6a3e8182484fe7bc5a417b93 authored over 3 years ago by Jonathan Sick <[email protected]>
Add dateIndexed field to tutorial record

This field records when the record was indexed.

b54c54e142e8fbe74818f8fe206a0882a5316007 authored over 3 years ago by Jonathan Sick <[email protected]>
Add color_excess_tutorial fixture

This fixture reduces a bunch of duplication in effort to get the HTML
content from test pages in...

4a0e9790ecf4e979498e8b9ddf5e64c818dd44c8 authored over 3 years ago by Jonathan Sick <[email protected]>
Merge branch 'develop'

0d4eb7a6a61e724d4c4897c97ee50df2eb07cf55 authored over 3 years ago by Jonathan Sick <[email protected]>
Merge pull request #8 from astropy/github-actions

Convert CI to GitHub Actions

eefdc65dbdae1005764de316e418e8f7bcd4baa5 authored about 4 years ago by Adrian Price-Whelan <[email protected]>
Update pytest to 6.1.2

For compatibility with testing sub-dependencies.

8ebae360af8e126b16c7b7c429548c3afb1467f9 authored about 4 years ago by Jonathan Sick <[email protected]>
Convert CI to GitHub Actions

This drops Travis CI.

We'll want to modernize some of the testing infrastructure for
consistenc...

c4221a8f66768277fcab6f1c5c134277cf466048 authored about 4 years ago by Jonathan Sick <[email protected]>
Merge pull request #3 from jonathansick/algolia-upload-tutorials

Algolia upload tutorials

dd163337ae83a3d1046c22df5622a8d2ad7c4f5d authored almost 5 years ago by Jonathan Sick <[email protected]>
Implement index_tutorial workflow

The idea of workflows is that they're stateless, asynchronous functions
that process a unit of d...

db533dfb423736867e8c1bce487d6b789c3c928f authored almost 5 years ago by Jonathan Sick <[email protected]>
Add the TutorialSectionRecord

"Records" are types that are made to be turned directly into Algolia
index records. In this firs...

603e664601a5cade0def9edc86f3428c396068cc authored almost 5 years ago by Jonathan Sick <[email protected]>
Add algoliasearch library dependency

To use it with asyncio, we also install aiohttp and async_timeout.

6927fe4e298649d59cb821424c92ca4469ed44f6 authored almost 5 years ago by Jonathan Sick <[email protected]>
Create a test CLI for indexing tutorials

2d952a956ff4fc5b44c8f9b5dc58ae25c8f3e301 authored almost 5 years ago by Jonathan Sick <[email protected]>
Merge pull request #2 from jonathansick/reduce-tutorial

Reduce tutorial HTML pages

5a2ebc33e0e1199e17159c55a1bf51ffbe5d71c5 authored almost 5 years ago by Jonathan Sick <[email protected]>
Start the ReducedTutorial class

This first reducer will be a proof-of-concept for how reducers can work,
and will reduce tutoria...

fb35860746522fb998c6255c26e5680501540a22 authored almost 5 years ago by Jonathan Sick <[email protected]>
Parse sections in ReducedTutorial

08dde34a7598572b10e20afd5bc3f9962aac2720 authored almost 5 years ago by Jonathan Sick <[email protected]>
Add lxml 4.4.2 as a dependency

We'll use lxml for html parsing.

03f62c4ef8360fe79fd64e765e76dc6b07042147 authored almost 5 years ago by Jonathan Sick <[email protected]>
Add cssselect 1.10 dep

b5bcb96c5346b50e780e5660d5678c8973eafbb1 authored almost 5 years ago by Jonathan Sick <[email protected]>
Develop iter_section to parse Sphinx sections

The idea behind iter_sections is to break a Sphinx-generated HTML pages
into hierarchically-sect...

71a6bad76e8a7610cfb9d56970fba03e7e8c6af0 authored almost 5 years ago by Jonathan Sick <[email protected]>
Add ReducedTutorial.images attribute

ReducedTutorial now captures the absolute URLs of any images that are
part of the tutorial conte...

00eb38b34fdc251c133e3026712afa2eb57c952d authored almost 5 years ago by Jonathan Sick <[email protected]>
Add color-excess.html test dataset for tutorials

This HTML page is from
http://learn.astropy.org/rst-tutorials/color-excess.html and will be
used...

527ff54830f835bf6028e22134b0fc16904cf9a9 authored almost 5 years ago by Jonathan Sick <[email protected]>
Extract metadata from tutorials

Basic extraction of title (h1), authors, and keywords metadata from a
tutorial page.

1c317dc53dd014bea6da14be2ca25992d1699d92 authored almost 5 years ago by Jonathan Sick <[email protected]>
Add an astropylibrarian.reducers subpackage

This will contain reducers that convert HTML pages into records that can
be uploaded to Algolia.

f2672f71a291a52d94b163a6d5299a5273dc3e6c authored almost 5 years ago by Jonathan Sick <[email protected]>
Merge pull request #1 from jonathansick/create-package

Create package

717fb3a3e81411f6c06fca12bfb732bed5d5110b authored almost 5 years ago by Jonathan Sick <[email protected]>
Add basic Travis-based testing

48e0ca23d4f9882e644845bd24da5ab3335f30a8 authored almost 5 years ago by Jonathan Sick <[email protected]>
Document development installation and testing

787033d14432341d61ac014be78b8eec28e11a9e authored almost 5 years ago by Jonathan Sick <[email protected]>
Enable mypy type checking from pytest

7b77666f57a2f593b520a743553a0825fcf0418e authored almost 5 years ago by Jonathan Sick <[email protected]>
Rename license with rst extension

9eb2296b66226cc28fd5b819ef972a3445c223be authored almost 5 years ago by Jonathan Sick <[email protected]>
Add pytest and flake8 linting

Development dependencies are installed as part of the "dev" extra.

c8a3b4056fb91b6e89387f9eac887e02f07bf172 authored almost 5 years ago by Jonathan Sick <[email protected]>
Assign copyright to Astropy

b6218b4adbe4764d909c17a2192815f04f249ab6 authored almost 5 years ago by Jonathan Sick <[email protected]>
Create package installation

We're going with a fairly modern setuptools-based package setup here
conforming to PEP 518 with ...

70c4f2324b6f1f0adc9d13757c7fb7dc9eb51436 authored almost 5 years ago by Jonathan Sick <[email protected]>
Convert README to reStructuredText

674bee03c796e688af4caaefe2ac8302ecec42cd authored about 5 years ago by Jonathan Sick <[email protected]>
Initial commit

ae8a5efdf90d5fafbbf1c330c9bdac0b2c8e5316 authored about 5 years ago by Jonathan Sick <[email protected]>