Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/matthewmueller/x-ray

The next web scraper. See through the <html> noise.
https://github.com/matthewmueller/x-ray

Merge pull request #190 from davidarnarsson/master

Absolutizing fails when encountering malformed URLs

06e1785def63f87e112b73b6bcd02d0a39f9ebfd authored over 8 years ago by Matthew Mueller <[email protected]>
Fixed spaces

a1da96b364e6d378f5e3cff5c11ba48cdd97b76e authored over 8 years ago by Davíð Arnarsson <[email protected]>
Fixed coding style

1d16cb935f8f6e4fd31a2730f27d2dd1cf515057 authored over 8 years ago by Davíð Arnarsson <[email protected]>
Fixes a problem when encountering malformed URLs while "absolutizing" urls in a document.

7805747ea4e69696359834c68dcb96b5f70a3272 authored over 8 years ago by Davíð Arnarsson <[email protected]>
Merge pull request #186 from wayneashleyberry/patch-1

Fixes Express example

563f094eeb3af7579fc92a29733eed9e576ea3be authored over 8 years ago by Matthew Mueller <[email protected]>
Update Readme.md

Fixes streaming response example using Express

d091c09a13d5db1840cf7cb019076b3bb4937251 authored over 8 years ago by Wayne Ashley Berry <[email protected]>
Moved example follow.js to a folder crawler that test to follow many links and retrieve information.

Changed to standard js.

f1cb2e31125409d46750eb49919871401803fd4c authored over 8 years ago by Martin Palmér <[email protected]>
// Nested crawling broken on 'master'. When to merge 'bugfix/nested-crawling' #111

// -------------------------------------------------------------------------------
...

6dae255cec35674266fb2a0f6e077f7804d8a472 authored over 8 years ago by Martin Palmér <[email protected]>
Fix typo in index.js in the collections example

6f05c20ec4807a107716e5154567ad225d4012f8 authored over 8 years ago by Sai Kishore Komanduri <[email protected]>
Release 2.3.0

8eb8f11067542bd9673894560a32f270c7183f61 authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #169 from fabien/filters

Support x-ray-parse filters

344f6ad43586436ac00847fb618b4df7086e674c authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #175 from laiso/patch-1

fix README code in 'Collections'

93217e2097de013a42c4c83d7d61bdd93b07de49 authored over 8 years ago by Matthew Mueller <[email protected]>
fix README code in 'Collections'

`x('ul', 'li')`
so I think it's better.

3a8470c26d48c1c39161c79c25b57c47f1d8fbdd authored over 8 years ago by laiso <[email protected]>
Update Readme and contributors

faabc135589904ed08b65e5cba187ff650b2b679 authored over 8 years ago by Fabien Franzen <[email protected]>
Support x-ray-parse filters

0fa509309d89b0a4c925b0ea4e0bfa582b62c507 authored over 8 years ago by Fabien Franzen <[email protected]>
Release 2.2.0

c921b2df4ef17b2bc6e80a6353ac2b4ead631f99 authored over 8 years ago by Kiko Beats <[email protected]>
Merge branch 'nicobevilacqua-master'

c9a3b3d09546ce2341caadf3f8c54382583f31d3 authored over 8 years ago by Kiko Beats <[email protected]>
Fix style

636d4f0b176764ebd37f5ad7a87bf1a4402b2489 authored over 8 years ago by Kiko Beats <[email protected]>
Merge branch 'master' of https://github.com/nicobevilacqua/x-ray into nicobevilacqua-master

7070a56e66c71a4333f033e9a55b60b715f4957c authored over 8 years ago by Kiko Beats <[email protected]>
run pretest on travis

21eabfb7f64d2a7ceb02147eb9fa49f0c9292d9c authored over 8 years ago by Kiko Beats <[email protected]>
fix error when html is null

f73990feeb2725568b244331345ecac87f8296a3 authored over 8 years ago by Nicolas Bevilacqua <[email protected]>
Release 2.1.1

1caf24f979328162b713825998fff6cd508df4a3 authored over 8 years ago by Kiko Beats <[email protected]>
Fix #162

7484e207614d365a62735ef02eb6e11bc568a27a authored over 8 years ago by Kiko Beats <[email protected]>
Setup correctly init state

0c3f421d48eaf7d5a5f4c9f975e80c92aee22e1c authored over 8 years ago by Kiko Beats <[email protected]>
delete unnecessary fixture

85a42a7b7715e6a48d3495da47951328b693746f authored over 8 years ago by Kiko Beats <[email protected]>
Extra util.isObject method

cd56198b49d59cde23e4b33e58808a33f839771c authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #159 from davidhq/master

fix example links in readme

40adcd3d60cb69a2ca470b925ec5271ec8a1ed98 authored over 8 years ago by Kiko Beats <[email protected]>
fix example links in readme

29ab95ecad706a66ff948a10b02ee11eeed6b329 authored over 8 years ago by David Krmpotic <[email protected]>
upgrade rimraf

43c2eb96edc370f66032cc21c39c023c25aa3cd6 authored over 8 years ago by Kiko Beats <[email protected]>
Release 2.1.0

859a535446befa836f49bfa73a0f2d0ceb600944 authored over 8 years ago by Kiko Beats <[email protected]>
Generate (again) changelog

8610ff588d4aa610ff196bf738098142ec6b88e4 authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #156 from lapwinglabs/up-to-date

Update dependencies

cb2460e52bad909feb2adba5ccf9291f48943c22 authored over 8 years ago by Kiko Beats <[email protected]>
Merge branch 'master' into up-to-date

54f68f9f5381ba2782e603dc4be981c227e69b4b authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #158 from lapwinglabs/travis_phantom

Fix travis integration with phantom

9e2bd70646c55b83fbcc3324ea7823662ccaf0f9 authored over 8 years ago by Kiko Beats <[email protected]>
Fix package

a0e8be77a7110c3e31f2ae6e876f48cef339d101 authored over 8 years ago by Kiko Beats <[email protected]>
Move xray phantom out of xray dep

0cf2be3107bf360df753c2f0f9cf8efe4811a102 authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #157 from lapwinglabs/bumped

Add bumped integration

184279fa0f2e3fea9185bb3d07df6b4c3fa4335c authored over 8 years ago by Kiko Beats <[email protected]>
Fix travis integration with phantom

0966ef16b550e834ad4fc9e5f88a7e1b1c267971 authored over 8 years ago by Kiko Beats <[email protected]>
Add bumped integration

70c39b0ccf217145611b89a7462d7bea5ca03d9c authored over 8 years ago by Kiko Beats <[email protected]>
upgrade deps

cef188e4d1e2ccd7b2986b9feb832c6dc309043d authored over 8 years ago by Kiko Beats <[email protected]>
Cleanup dependencies

Removed unused dependencies. Also removed cli: we will use a separate project for interact with ...

27933d8698f34c357ce77d647024710902f6443e authored over 8 years ago by Kiko Beats <[email protected]>
Sort requires

9b204dd499fd69d72cd715f6335ea53caa76248a authored over 8 years ago by Kiko Beats <[email protected]>
Delete commented code

b788d935323fff9121377049d93c9a7cd6b255a9 authored over 8 years ago by Kiko Beats <[email protected]>
Extract stream helpers and WalkHTML methods

6f73cac4d6ef50fa67a8810c7a69224402f4449a authored over 8 years ago by Kiko Beats <[email protected]>
Extract util methods

0781058c38ac2b1b632bf3219a5e2f26c159d6db authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #155 from tmillner/master

doc - API usage correction

dd1c2fb2b6da6f3e8f79e0e5e509fec8262ab0a5 authored over 8 years ago by Kiko Beats <[email protected]>
doc - API usage correction

The API usage example for xray.stream() was noted as `xray.steam()`

324291b9c8824cae66801931795b46ac680e5ec3 authored over 8 years ago by trevor.millner <[email protected]>
Merge pull request #152 from gconnolly/master

Handle invalid URL and invalid HTML input

693d32d333965242ee41c02137c870646117a476 authored over 8 years ago by Kiko Beats <[email protected]>
Handle invalid URL and invalid HTML input

61738eb4521bad985d409e0af5584aa39f7e1b9d authored over 8 years ago by geneconnolly <[email protected]>
Merge pull request #137 from gconnolly/patch-1

Change to documentation of support for raw HTML

01726b83e10c9c2f6f25df787678ee108403ee3a authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #149 from lapwinglabs/github-templates

Add GitHub Templates

756b220c37b288677dee9da69458ac2581b0dfb8 authored over 8 years ago by Kiko Beats <[email protected]>
Add .stream section in docs

3dbaa61cdc20e98e29551d2ab1e8a8ebc4c5b37c authored over 8 years ago by Kiko Beats <[email protected]>
Fix #148

d79f94e2f41875446341e150c3b3771f1830957e authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #142 from Kikobeats/refactor

Total Refactor, a New Hope

960b4946ab718e8e9a741b30c895a15158841b69 authored over 8 years ago by Kiko Beats <[email protected]>
Add coveralls integration

fc9b6d52a0d1a6ddee4aea47a9d1869e12ffb760 authored over 8 years ago by Kiko Beats <[email protected]>
Setup node version

6f77635de205837c00050f5749455d2b3aae6efd authored over 8 years ago by Kiko Beats <[email protected]>
Update travis phantom build

cd37e33acdc9e667d5e88cd9648419e9e3bd9893 authored over 8 years ago by Kiko Beats <[email protected]>
Add cheerio dev dependency

c34fed4a70d24dfd2acfbb7edd8eb5f795b1f331 authored over 8 years ago by Kiko Beats <[email protected]>
Disable security in testing

a26f8e54ace2de4e17fe6a3fbfd610d30785ef6c authored over 8 years ago by Kiko Beats <[email protected]>
Update travis phantom pattern

db9e63b046de3ea321964f335328750c28b7e715 authored over 8 years ago by Kiko Beats <[email protected]>
Prevent lint phantom stuff

58cb4043693aeac86f3b472b9c1650325b909b99 authored over 8 years ago by Kiko Beats <[email protected]>
Add phantom setup

c116752eba89e67a5c180c74d6a692de294a0c53 authored over 8 years ago by Kiko Beats <[email protected]>
Remove testing section, just look badges!

978306f94808cb9278c8f6f5e238120620f945d3 authored over 8 years ago by Kiko Beats <[email protected]>
Rename testing files. More easy to search

0a269fd61b315a4ca80907fa610e2fc61b2ae132 authored over 8 years ago by Kiko Beats <[email protected]>
Merge branch 'master' into refactor

bcc7de68e8c70a6637eb8ceead957a4e03f2b44f authored over 8 years ago by Kiko Beats <[email protected]>
Merge pull request #146 from Kikobeats/master

Add services integration

a43821f4e62e6fda6930b9d22f1748f66671cbc5 authored over 8 years ago by Kiko Beats <[email protected]>
Add travis

32c74c6c1e19b1dc048a247e53919276efb8d341 authored over 8 years ago by Kiko Beats <[email protected]>
Add badges

5ca8cbd052e72db79509a9874ba1ce1e75a66347 authored over 8 years ago by Kiko Beats <[email protected]>
little refactor

78cf00772fc7b997353e0a39eace7b49cb4fca9d authored over 8 years ago by Kiko Beats <[email protected]>
Fix test

760b61591323d7691fbb26abdce7f6543674e877 authored over 8 years ago by Kiko Beats <[email protected]>
Upgrade dependency

3aeea03b59c8c466b7945c292b0856015472a603 authored over 8 years ago by Kiko Beats <[email protected]>
Fix test

1adf200c2f4dfcf151d60f020eb24a2d5b6de296 authored over 8 years ago by Kiko Beats <[email protected]>
WIP

6fece6c60f8267a4ce40cbf68e17f23898bc7452 authored over 8 years ago by Kiko Beats <[email protected]>
Fix test

2b2f027feeb579973c2a46549c6e7523a7b4ebeb authored over 8 years ago by Kiko Beats <[email protected]>
Add missing fields

1d2f669e5a05ad327120656ce1e4de7b4f9ce131 authored over 8 years ago by Kiko Beats <[email protected]>
Add node.stream

c573cda9cd5bd27a98813521ffad817931e31a9d authored over 8 years ago by Kiko Beats <[email protected]>
Ensure to have last mocha version

96264afa586fddefaa147869e1ac16a5e5c0bb65 authored over 8 years ago by Kiko Beats <[email protected]>
xit tests that doesn't work well.

095ad5f26805230681320908fd4a616de033dea1 authored over 8 years ago by Kiko Beats <[email protected]>
Fix typo

03d044c38ca8f1120468e935e19c172965f246aa authored over 8 years ago by Kiko Beats <[email protected]>
WIP

1f0bc2f0e6333d01ae00515f675e5526fa0552a4 authored over 8 years ago by Kiko Beats <[email protected]>
Fix some linter messages

50c00cc3b72f96a5145cff2bacb95e8017122f4f authored over 8 years ago by Kiko Beats <[email protected]>
Fix examples

a9c9c5f8cbe2f347cc89ee57991a42f73b05d372 authored over 8 years ago by Kiko Beats <[email protected]>
total refactor

6d30434353c5247d84ecd43ea6fdea3a5f414e4d authored over 8 years ago by Kiko Beats <[email protected]>
Change to documentation of support for raw HTML

The documentation for support of raw HTML states "...all the same sematics apply" but the exampl...

959f7916d571125cedc08d7532af9cf28d14e77b authored over 8 years ago by Gene Connolly <[email protected]>
Merge pull request #102 from dfdeagle47/master

Fix potential issue when selector is a function following comments on…

0a9895d711eb9d99838d38ca93705057b4cd44b2 authored almost 9 years ago by Matthew Mueller <[email protected]>
Release 2.0.3

8c3b6e32604fce34403424b676f3d9d5a033619f authored almost 9 years ago by Matthew Mueller <[email protected]>
Merge pull request #112 from gebrits/patch-1

Do no error on trying to follow a non-url

c51faaa68300f54ce490132b90251a5fe5b51e9e authored almost 9 years ago by Matthew Mueller <[email protected]>
Merge pull request #123 from narmontas/master

Added support for <base> tag when generating absolute URLs.

d4b6b9ea5051f95675182283f31a52b976e65bb6 authored almost 9 years ago by Matthew Mueller <[email protected]>
Added support for <base> tag when generating absolute URLs.

11dd8f7ecdd72961b3ceccb5f6c4c24f0e3488f6 authored almost 9 years ago by Nerijus Narmontas <[email protected]>
Do no error on trying to follow a non-url

030e5ea61fe10f88098f9e2e36c1543c0b03ec82 authored almost 9 years ago by Geert-Jan Brits <[email protected]>
Fix potential issue when selector is a function following comments on commit e7318d591908d04b439c1ff7e93ff9c4b63a89af

When the selector v is a function, the function next() will most likely be called twice: once be...

9327cfa78924c9841fea044e4ea99b833906021f authored about 9 years ago by JAlzetta <[email protected]>
Merge pull request #99 from KodeAndGame/patch-1

Emit error on correct stream

40c85375adc1926bf362148bef4263705e7b9b46 authored about 9 years ago by Matthew Mueller <[email protected]>
Emit error on correct stream

This change fixes one of the issues from #98. `state.stream` can be the wrong stream to emit an ...

488d5dd6a738eb99432d9354df2e8c15606edd41 authored about 9 years ago by Richard Alvarez <[email protected]>
added video

46abdedaeacc4b05cab736b060412bac39ec7ce1 authored about 9 years ago by Matthew Mueller <[email protected]>
Merge pull request #71 from dfdeagle47/master

Issue when one of the selector is null

fb44d7b714919e525592e76095c31d1e63429c3c authored over 9 years ago by Matthew Mueller <[email protected]>
Fix issue when one of the selector is null

When one of the selector is null, the next callback was not called => xray would then never call...

e7318d591908d04b439c1ff7e93ff9c4b63a89af authored over 9 years ago by dfdeagle47 <[email protected]>
Paginating => Crawling

6750a386a90a923236a058a6f1211b51e8bca5b1 authored over 9 years ago by Matthew Mueller <[email protected]>
Release 2.0.2

c179fbb3b3fc0ded19da89fe9242158c7d28e2a9 authored over 9 years ago by Matthew Mueller <[email protected]>
handle the empty result set case

a257ef7d7d27e2a007bee345ab75671b7b79cb9b authored over 9 years ago by Matthew Mueller <[email protected]>
add test dependency

de3a3f033e84bbb582a9e157c97cb98e89deac30 authored over 9 years ago by Matthew Mueller <[email protected]>