Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ronin-rb/ronin-web-spider

A collection of common web spidering routines
https://github.com/ronin-rb/ronin-web-spider

Add ruby-3.3 to the CI matrix.

49aee6cb6f0438e923690ed744a5255869f524ec authored about 1 year ago by Postmodern <[email protected]>
Bump the `actions/checkout` action to `v4`.

ee171402f016ed8453e05706e6e19b563f719bf9 authored over 1 year ago by Postmodern <[email protected]>
Make the summary text a sentence.

8a6262cb3703e87821658ae0e5cbc266bdc753f3 authored over 1 year ago by Postmodern <[email protected]>
Removed the Twitter account link.

8d3f1f5d7b05d537667b16a42a39d20aafea983e authored over 1 year ago by Postmodern <[email protected]>
Add missing markdown link to the ChangeLog.

4e8b6e6d30bd7350e1982bf622263782d23e1b72 authored over 1 year ago by Postmodern <[email protected]>
Fixed indentation.

4d1d7666b9be389c7fe3760b1e7f93430cbc0b44 authored over 1 year ago by Postmodern <[email protected]>
Update documentation coverage.

691ea70445dcc735864804cd56622af17cec11e7 authored almost 2 years ago by Postmodern <[email protected]>
Update spec descriptions.

0863aa21db1734dfbb33fb65d8b692224cfd8215 authored almost 2 years ago by Postmodern <[email protected]>
Fixed the release date for 0.1.0.

5695a16147be144b948579533f1b2edb5243484a authored almost 2 years ago by Postmodern <[email protected]>
Version bump to 0.1.0.

9e7883925042a07e9e3887476cb03841353ee587 authored almost 2 years ago by Postmodern <[email protected]>
Require ronin-support ~> 1.0.

003584faf701a166be1cc0818b42f49497e2b0ba authored almost 2 years ago by Postmodern <[email protected]>
Link to the API documentation for the methods.

a51a3a5d41f9126d86c1eb010dcb35d0c6d260c5 authored almost 2 years ago by Postmodern <[email protected]>
Fixed a spelling mistake in the README example.

4debe94c292a5b8ec91252d3247003dfe2841777 authored almost 2 years ago by Postmodern <[email protected]>
Fixed a spelling mistake in the documentation.

0d79c2385804d8470859e0987be10d85dd1055fe authored almost 2 years ago by Postmodern <[email protected]>
Cache gems.

faab5b45fc6f95dbc661d18afb0e05baee564821 authored almost 2 years ago by Postmodern <[email protected]>
Added a gem version badge.

fb8032bd3b4dea8841d054cf67242a323efaef53 authored almost 2 years ago by Postmodern <[email protected]>
No need to install `libsqlite3` for the CI.

c8ee01160d31b5be1fa8fd09c91dd6ab8b063487 authored almost 2 years ago by Postmodern <[email protected]>
Exclude the test files from the built gem.

6808dce23e4125c4fddf4d29e9ed77e4807549ef authored about 2 years ago by Postmodern <[email protected]>
Link to the library namespace in the YARDocs title.

86cf7e62ffb48952a6a09ca58f53e1dcf5723276 authored about 2 years ago by Postmodern <[email protected]>
Link to the `main` branch.

071f2212686e56ac0e61b13c852fe7a9458ad3aa authored about 2 years ago by Postmodern <[email protected]>
Changed the gem's documentation URL.

26ec171c851134d625e7c19b4583df6a404f39ea authored about 2 years ago by Postmodern <[email protected]>
Added `@api` tags.

c99ce0e22e335bef292a34c1512761216d573a07 authored about 2 years ago by Postmodern <[email protected]>
Added examples for using `Archive` and `GitArchive`.

9cf75991252b3997871d0e9e05b27c627e28cd95 authored about 2 years ago by Postmodern <[email protected]>
Change order of requires.

0915580d5013d822d4c0657e502c8dac9cc62f20 authored about 2 years ago by Postmodern <[email protected]>
Added `require`s to the `Archive` example.

9f7b06e7a71b7dc6739743d9dfaab005c6ba6e2c authored about 2 years ago by Postmodern <[email protected]>
Added `@api` tags.

410330a55d7607152d6c8d0f7dd99f63a8ae55f5 authored about 2 years ago by Postmodern <[email protected]>
Copy/pasted the README examples into the top-level docs for `Spider`.

f5fe47e5e305e0999ea0b0e0dc72fd9850eaec7f authored about 2 years ago by Postmodern <[email protected]>
Added ronin-web-spider specific examples to the README.

7af5c468570f0b35649f16520979c4be75ec2b5b authored about 2 years ago by Postmodern <[email protected]>
Added `@example` tags to `Ronin::Web::Spider::Agent`.

00c88cbe6df2fb19363ce0839a2605dc4c820940 authored about 2 years ago by Postmodern <[email protected]>
Copy/paste the examples from the spidr gem.

* https://github.com/postmodern/spidr#examples

1bedb5f7d6199651656523744d09b27b3805db63 authored about 2 years ago by Postmodern <[email protected]>
Updated the copyright years.

d6f52f2d16a828eefd16a2c7119531af15289a41 authored about 2 years ago by Postmodern <[email protected]>
Mention that it requires `ruby` >= 3.0.0.

1c35ba05c48c40e53845aa432166fa87705e0008 authored about 2 years ago by Postmodern <[email protected]>
Mention that the code was relicensed.

e8d3189023d269a2ca8920189882be348aa03056 authored about 2 years ago by Postmodern <[email protected]>
Mention that `ronin-web-spider` was extracted from `ronin-web`.

82d3bf6ea9e2d83dc6ba7b330c0d0f276cd4d126 authored about 2 years ago by Postmodern <[email protected]>
Version bump to 0.1.0.beta2.

a648d24dbe4b7052fccefb132acbb3b4f062cf9f authored about 2 years ago by Postmodern <[email protected]>
Switch to using ronin-support 1.0.0.beta1.

5850e561cf34d56a2d5da12b6163a45d56fc1a54 authored about 2 years ago by Postmodern <[email protected]>
Mention the documentation and test coverage.

cc5a7f746fe87761f83aa3e78ecefbeff9771842 authored about 2 years ago by Postmodern <[email protected]>
Version bump to 0.1.0.beta1.

f018c091e06be14f1106e1823aa0a6d207b2cbb2 authored about 2 years ago by Postmodern <[email protected]>
Updated the ChangeLog for 0.1.0.

dec866789d041c286485868d7463e9ebbabb5f55 authored about 2 years ago by Postmodern <[email protected]>
Flush out the Features section.

4b0a9a98f747fb16cb7a0b43bb240994123d1a13 authored about 2 years ago by Postmodern <[email protected]>
Alias `every_js` to `every_javascript`.

f35d3b3bee182b1e2d340ed7d7288c9ad2398df8 authored about 2 years ago by Postmodern <[email protected]>
Switch to using spidr from rubygems.org.

f39a2a88b58e9531b63fe929d90e53d5881edfed authored about 2 years ago by Postmodern <[email protected]>
Require `spidr` ~> 0.7.

f71812b9327f2c4a2973dc9838c7b3e709a4a89a authored about 2 years ago by Postmodern <[email protected]>
Fixed YARD links.

70d0013b34e9987b588a148472f21c4027cb5d5a authored about 2 years ago by Postmodern <[email protected]>
Fixed a `@param` name.

01f14b28af22a9b828f33367be70c2547c41d4ff authored about 2 years ago by Postmodern <[email protected]>
Added ruby-3.2 to the CI matrix.

118ec1763256ade7cfb27fe8327202b73e9d4960 authored about 2 years ago by Postmodern <[email protected]>
Default `proxy:` and `user_agent:` to `Support::Network::HTTP` defaults.

d47fbb8ec1ad5774ad7cf12143db398f8dd0e252 authored about 2 years ago by Postmodern <[email protected]>
Added `Agent#every_comment` (issue #12).

2e38425ff86064a03e722fe775e62d97a8e5c446 authored about 2 years ago by Postmodern <[email protected]>
Alias `every_js_comment` to `every_javascript_comment`.

1d7f4a6a0072ea3643ca6e5fcb19131e1ce2d95b authored about 2 years ago by Postmodern <[email protected]>
Added `Agent#every_javascript_comment` (issue #12).

86423bfa50b4e26cef0771d17273a01922358b3c authored about 2 years ago by Postmodern <[email protected]>
Require `ronin/support/text/patterns/source_code`.

1850dd371963921d3a4a22aac34d01535bc56ed1 authored about 2 years ago by Postmodern <[email protected]>
Added `Agent#every_html_comment` (issue #12).

f5fef75a4aca63782cd3f38ab574013596bcb1a0 authored about 2 years ago by Postmodern <[email protected]>
Alias `every_javascript_string` to `every_js_string`.

40071b18de00ba01bdff9948aea36445c7150410 authored about 2 years ago by Postmodern <[email protected]>
Added `Agent#every_javascript_string` (issue #12).

94970aa9d022d6a11e3d981f40bb982d828eac01 authored about 2 years ago by Postmodern <[email protected]>
Added `Agent#every_javascript` (issue #12).

55d3a0c6d5ebb807ed6fd6bfc4cd44d6b672c43b authored about 2 years ago by Postmodern <[email protected]>
Added `Agent#every_cert` (issue #12).

98c72595b1d065b2254431c2a1a947fcd3f29e25 authored about 2 years ago by Postmodern <[email protected]>
Fixed `Archive` and `GitArchive` top-level examples.

81284d4b036e7a866fb29be36ba8fcc6ec8eea86 authored about 2 years ago by Postmodern <[email protected]>
Added `Ronin::Web::Spider::GitArchive` (closes #10).

5acca11d16d14825aeafdce2f2171d0f0d301fb4 authored about 2 years ago by Postmodern <[email protected]>
Added `Agent#every_favicon` (issue #12).

dc23996df645fcf6f0139e130a1163db49be20ba authored about 2 years ago by Postmodern <[email protected]>
Add an Examples section.

430aecc8fd6380c704af99403e020b74d0b37d35 authored about 2 years ago by Postmodern <[email protected]>
Re-add JRuby to the CI matrix (closes #11).

2661c9793051081638283e2131af4fccb1e563a2 authored about 2 years ago by Postmodern <[email protected]>
Enable TruffleRuby in the CI matrix.

5281818a9c0df421e7a327d400eb32a63f04be23 authored about 2 years ago by Postmodern <[email protected]>
Set the gemspec metaata.

d40b946440da25d3fbd92097d422a58c93b53052 authored about 2 years ago by Postmodern <[email protected]>
Added ronin-support as a dependency.

83f5ecc1555be44d1f02081d8264e48d60b86d18 authored about 2 years ago by Postmodern <[email protected]>
Added `stackprof` to the `Gemfile`.

e3541f47218237b54c689230fb0f904820806e99 authored about 2 years ago by Postmodern <[email protected]>
Added `sord` to the `Gemfile`.

6b1abd8803c2f48511fb273d5119664e90e3a963 authored about 2 years ago by Postmodern <[email protected]>
Alignment.

63e4d44410d5fc390ab80087eb496b32dbdb776e authored about 2 years ago by Postmodern <[email protected]>
Fixed project name and description in `ronin/web/spider/archive`.

333edff842be94df435b9d18852b574e3c9e4448 authored about 2 years ago by Postmodern <[email protected]>
Added an `Archive` class (closes #9).

941681f756b64f32589bf930602d503e6ecfc831 authored about 2 years ago by Postmodern <[email protected]>
Populate `gemspec.test_files` using the `spec/` directory.

2c112aa939f7050549adebef7ed39255d2626941 authored about 2 years ago by Postmodern <[email protected]>
Require ruby >= 3.0.0.

a1368782f808ec93961bba5701b2c7d90be18b06 authored about 2 years ago by Postmodern <[email protected]>
Link to `https://`.

beed2ebb667afee1df01a7ffbb41bace38540ea9 authored about 2 years ago by Postmodern <[email protected]>
This library will have no man pages, so kramdown-man not needed.

6a9afa4aa2f7d787bf4d08e3fa20a4662ddd5a6b authored about 2 years ago by Postmodern <[email protected]>
Use redcarpet to parse the GitHub Flavored Markdown.

b9b7c388fab1c5ddcbbb6582e82f21098e651b50 authored about 2 years ago by Postmodern <[email protected]>
Updated specs for top-level Spider methods.

5260280e9b4582ad314e9f30708ec4ee3353a2b5 authored about 2 years ago by Postmodern <[email protected]>
Updated `Spider::Agent#initialize` to support `RONIN_HTTP_*` env vars (closes #4).

8a6aa2786b8f8b91a473719c662b04a13c7400a8 authored about 2 years ago by Postmodern <[email protected]>
Wordwrap the description.

b8bba92954042afff48222dbf36afc2d1972e2ce authored about 2 years ago by Postmodern <[email protected]>
Added webmock to help with testing spidering.

fc66e626190463f14e1bf60e06b9cd288619828a authored about 2 years ago by Postmodern <[email protected]>
Use the library name in the description.

7abb4a5bc012d5ae15159693934ec744c36205d8 authored about 2 years ago by Postmodern <[email protected]>
Opt into rubygems.org MFA requirement.

9053fad30129e4db115005b199d951ed9bec555b authored about 2 years ago by Postmodern <[email protected]>
Removed redundant "This file is part of ronin-web-spider." line from the license header.

efeccccbc06075be319fda1315e5782ff03bfcec authored about 2 years ago by Postmodern <[email protected]>
Added `Agent#every_host` and `Agent#visited_hosts` (issue #12).

d5053026d5c84d0b11c2528ae8d690a74c6a220b authored about 2 years ago by Postmodern <[email protected]>
Added a link to Mastodon.

7d16aa0227af5e8631d7ce4a7948fff940976abe authored about 2 years ago by Postmodern <[email protected]>
Removed the Slack link (Discord is better).

9fa6e774a2cc8350caeb6742231ec7348c957673 authored about 2 years ago by Postmodern <[email protected]>
Added basic top-level spidering methods (closes #3).

b0c94a62ec56f8aba5a576750dfc323d1992fdc8 authored about 2 years ago by Postmodern <[email protected]>
Temporarily switch the spidr 0.7.0 branch.

6aeba31b6274348a7bcfb7f96f64c45632b678af authored almost 3 years ago by Postmodern <[email protected]>
Removed unused code from `spec_helper`.

1a7b9d1918aca6498eb2db537c2e17da6db929d5 authored almost 3 years ago by Postmodern <[email protected]>
Fixed the commented out spidr dependency.

d5613b90c2727e6fc278de331518c24d9bd4cb06 authored almost 3 years ago by Postmodern <[email protected]>
Bump spidr dependency to ~> 0.6.

9e61bfca7433046347bdcffa7694a31fae60e9d9 authored almost 3 years ago by Postmodern <[email protected]>
Fixed the spidr dependency.

072e4a50b6bcdd008c46e7ca1c444442e5a3b336 authored almost 3 years ago by Postmodern <[email protected]>
Remove the `ronin/ui/output/helpers` require.

67907da1dda4976820071f904f89c6cd6bf27273 authored almost 3 years ago by Postmodern <[email protected]>
Removed the `require/web/web` require.

9ae3ce6611c6233b47d5af3bd79ef294292e7bd4 authored almost 3 years ago by Postmodern <[email protected]>
Added project files.

24322ef8a5816f47426ee82b9d23e879ba04ef01 authored almost 3 years ago by Postmodern <[email protected]>
Added a `ronin/web/spider/version` file.

e0d05a56811323de65c7dbff71304ae6d441e39d authored almost 3 years ago by Postmodern <[email protected]>
Renamed the `Ronin::Web::Spider` class to `Ronin::Web::Spider::Agent`.

81e54f0a35607259eb15c88b0e31bbe1831822d3 authored almost 3 years ago by Postmodern <[email protected]>
Bump the copyright year.

a111bace0ab30eb7d6f70518fdac1089ba837cf6 authored almost 3 years ago by Postmodern <[email protected]>
Changed the license to LGPL-3.0.

8d5dc9dfe5c23cba819ed5d71b639ecddf9c9349 authored almost 3 years ago by Postmodern <[email protected]>
Changed project name to ronin-web-spider.

49040f1c5101bd7c13053f51184b3d0fc3f9b4ff authored almost 3 years ago by Postmodern <[email protected]>
Updated the copyright dates.

4c15bbc8cabd64b5dd3e2883b23a4fe97abed255 authored about 4 years ago by Postmodern <[email protected]>
Use the gem/repo name in the license header.

a58f82b6ac56c288aa49d2190395a71ef0660e1b authored about 4 years ago by Postmodern <[email protected]>