github.com/ronin-rb/ronin-recon commits | Ecosyste.ms: OpenCollective

Adjusted `Scope#include?` behavior to allow values with no scope values.

* Example: if there are no IP or IPRange scope values, then consider the IP
"in scope".

c8992ece088e576e7e741a6371b5a9faaecf66b3 authored over 1 year ago

Add missing requires.

7d93658e768814afbae17f245ff00adc772aa69d authored over 1 year ago

Added `Values::Wildcard#===`.

90cc67f0aa2feb79129aea158e68b8dd797d4e33 authored over 1 year ago

For some reason changing the `until` to a `loop do`/`break` fixed the issue.

* For some reason `Message::SHUTDOWN` messages were getting past the
`until (mesg = ...) == Me...

8afefb096983289de2cdc5e4a14b44f5e6a55d7d authored over 1 year ago

DRY up usage of `@output_queue.enqueue(...)`.

0cea0d8fbf7614adaf93eb2d300b6f22243df75e authored over 1 year ago

Fixed a typo.

b27d9a7d2eed1f504c917e7ddcb31a71ff977139 authored over 1 year ago

Fixed worker `id` names so they match their relative file name.

ecbc41cc5e0c82fb440ca69db32e8147108144f1 authored over 1 year ago

Misc rubocop fixes.

6397e413098dc5ac9282931dd099633a39fa0217 authored over 1 year ago

Fixed constants.

7e19483edb1724525acd564269a0c223f8d5d68e authored over 1 year ago

Switch back to the `ronin-support` gem version.

0da5d0d9beac9170be145941fa4216bee3733a47 authored over 1 year ago

Print failed jobs.

07cbb5ee6a05dcb321438dc1bde4a027913cf792 authored over 1 year ago

Use single quotes.

27aeacf2f5f4241f32b54c48f6cd1aa860b3942d authored over 1 year ago

Corrected YARD types for `Scope`.

901bcf0bf4feb8555b8fd2ead1bf4dca2c078a19 authored almost 2 years ago

Removed an old YARD param.

ea3b77d77d025a53fea36585dd7f82cc1e0a9d19 authored almost 2 years ago

Added a top-level description to `Importer`.

5f350a90412ed9473cd543e5d62be9f93ae27213 authored almost 2 years ago

Added `Engine#values` which returns `Graph#nodes`.

0732f1ad5700ee3e3778d9ee607d08b9d1c7e062 authored almost 2 years ago

Pass the `values` directly into `Scope.new` and access them via `@scope.values`.

5bcf8286aceba40f0ba8ec304bf3ea5525edb424 authored almost 2 years ago

Changed `Scope` to use a single list of `Value`s.

e3aab8f0c3809708b7a933504219850163ce7d9d authored almost 2 years ago

Allow `Values::Domain#===` to fuzzy match `Values::IP#host`.

40a1017c447803801c3e9d8ca8b3ddc9decd2ee5 authored almost 2 years ago

Added missing `@param` tag.

cdc45631ed6f99ddd9a307bd0333d1c07e21d7ba authored almost 2 years ago

No longer include individual host names or IPs in the `Scope`.

* Because `Scope` is initialized using the initial input values, those
will automatically get ...

a909bdceeb642ed779b4f01112d548830cde26c6 authored almost 2 years ago

Check the `scope` filter first then the `max_depth`.

6685d8fe6a746b13cfd42086dd1e397058f67f70 authored almost 2 years ago

Default `max_depth` to `nil` and instead rely on the `Scope` filter (#34).

5eff7a57e24454cbcaca567092a48eadb9d8b9e7 authored almost 2 years ago

Allow `max_depth` to be `nil`.

00ea30399321a220b635a3b2cb05940c5bb13674 authored almost 2 years ago

Integrate `Scope` into `Engine` (closes #34).

2b2cd0382f2f0bbc10ec111582cde048c74d7988 authored almost 2 years ago

Check if the scope values is empty.

16666d5f43f100da3a65cdc756ae209f92dc2c91 authored almost 2 years ago

Renamed `Scope#====` to `Scope#include?`.

6381ef405cd3ea4e5df0afe7427bffc51318c74b authored almost 2 years ago

Added `Scope` (closes #1).

0625deb4b97c76f2d7d8e6076e462d8d7b584042 authored almost 2 years ago

Added `Values::IPRange#===`.

8b15451fc8d4d5d852b69ec6973a221f9219a615 authored almost 2 years ago

Added `Values::IP#===`.

e79e508c2f5105e187693fd4f0342c4408ddacb5 authored almost 2 years ago

Added `Values::Domain#===`.

6ed677294ab0a9685a66bf3fc092ee1496cfa547 authored almost 2 years ago

Added `Values::Host#===`.

e15685bd18f85c89fe6c6ae598b15cd59121f812 authored almost 2 years ago

Added `Values::IPRange#include?`.

98ffbbad2ace2e1fee484cd3e9921972c3b6a07f authored almost 2 years ago

Changed `Values::IPRange#range` to be an `IPAddr`.

28cbe1910f571920abf598cf5c509ec34dc74dac authored almost 2 years ago

Require `set`.

d27b53b151e389658f4d586fb7de3352ccbf3dce authored almost 2 years ago

Also use `RESOURCE_STATUS_CODES` in `Web::DirEnum`.

3de55c3b4c3db28bef0bac510c1b33a925c707c1 authored almost 2 years ago

Switched to using the `combined_directories.txt` wordlist.

* https://raw.githubusercontent.com/danielmiessler/SecLists/master/Discovery/Web-Content/combine...

17bdfdc88124d30a2579c1198793ddaeaa470ed9 authored almost 2 years ago

Added an Anti-Features section.

2ab2caddedb743283750ca4627f1c26eb168c06c authored almost 2 years ago

Use `Spidr::Page#to_absolute` to combine the relative path with the page's URL.

50c331101283e0253b58d509e6fc86f9c50addab authored almost 2 years ago

Filter URLs based on their HTTP response status code.

a5b695ef6deab00a5282b284c1cc4cd098f66988 authored almost 2 years ago

Include `Mixins::HTTP` into `WebWorker`.

8d64d36033a1b1aa3429e231baf4cc6c2267f3df authored almost 2 years ago

Added `Mixins::HTTP`.

cd529a86fda572624d53b9e9b54ea1532e316258 authored almost 2 years ago

Vertical alignment.

11dba9d6650a6ae2b9a6bce9d1380719d6bc7658 authored almost 2 years ago

DRY-up `Website#to_uri`.

ee7d00bd5a67af5f09e4e94dd61c77f0ed73116b authored almost 2 years ago

Ensure that `Website#to_uri` has a path of `/`.

9c9240f29c361be7246c395497e2f72223c39dd1 authored almost 2 years ago

Only yield URLs for actual webpages or HTTP end-points.

47d96191ca90d70dd75c22d7751bf1fb84d96026 authored almost 2 years ago

Enqueue the URIs back into the spider so we stay on the website.

* Also ignore any invalid URIs that slip through.

f34acf884c9abe761ba55d6ce3bd7edba2d69a17 authored almost 2 years ago

Switch to `ronin-support` main branch for bug String decoding bug fixes.

70d6ccf90fac6ce8f764e4e973ba73e4fe5bd875 authored almost 2 years ago

Filter out non-`http:`/`https:` URIs.

eda0b8b1189894150a145a97d5c88728e54a0aa2 authored almost 2 years ago

No longer convert the URI object to a String for `Values::URL`.

ec8bc7ce578aeff32c8330c9760083bad8303efa authored almost 2 years ago

Also extract relative/absolute JavaScript paths from every page (closes #32).

38918b149afec04af453a526b2df0f23db5cbcc2 authored almost 2 years ago

Ensure that `dns_get_records` always returns an Array.

c3d5d8599485d98e85c585f5d4f8014d343ab038 authored almost 2 years ago

Add missing support for `Values::Cert`.

ba16299e6417dbf6bb256b5f889fed9ffd838aa8 authored almost 2 years ago

Filter out known bad public suffixes that return IPs for any/every subdomain.

1c122f823b9bd95e4fb2a085d968140315b79de2 authored almost 2 years ago

Also yield any JavaScript URL strings (closes #31).

11044e3b14ec50c64c6f23637b173fd05942dd2d authored almost 2 years ago

Require `ronin-web-spider` ~> 0.2.

802ee5f3a4cfccdd02f922df785f7020336364ee authored almost 2 years ago

Moved all "network" related workers into `net/`.

48a46f8ced7c5bbe33a62673a095f128579cacc9 authored almost 2 years ago

Updated the list of builtin workers.

19060d12cd8d85613e8492953512a555fcb9da2f authored almost 2 years ago

Added `DNS::SuffixEnum` (closes #23).

1e80bb8c7a06b1e964317d4591e9128f8a4a73a6 authored almost 2 years ago

Changed `Mixins::DNS` to support resolving IDN domains.

2b7889bfe37f7eaa815491cc3a38b82cc5e71dd1 authored almost 2 years ago

Allow `DNS::SubdomainEnum` to also enum `Wildcard` values.

928126f4b5c07476b238615977274afc7cbdbd8b authored almost 2 years ago

Renamed `Wildcard#host_name` to `Wildcard#template`.

9e972fafb4e2358870b6c83f74bc109f8036847e authored almost 2 years ago

Mention that `ronin-recon` can enumerate SSL/TLS certificates.

2d40d9ecea1d746afcd9b97ed5bc21e2a211d691 authored almost 2 years ago

Added the `CertEnum` worker class (closes #30).

02442c90ae767166d722d9e92ff6dd3672a035bc authored almost 2 years ago

Added the `CertGrab` worker class (closes #29).

3cbfff703df2c285e40c5df0083bceb9c812426c authored almost 2 years ago

Added `Values::Cert`.

f11c962cc591c89d16ef76d6edc9979118a2188f authored almost 2 years ago

Added `OpenPort#ssl?`.

7c1aee2dc5797b552eaa58d1d76415060ebe6f01 authored almost 2 years ago

Added `OutputFormat#write_connection` for graph file formats.

1fa7f29c7135bb0378c7e4e7fe6e8db73722b1e9 authored almost 2 years ago

Added fine grained callbacks and `Engine#on` (closes #24).

5adbad599f05a4f70b23e652759e0e0d0c534b83 authored almost 2 years ago

`Async::DNS::Resolver#query` can sometimes return `nil`.

3a9fc732dc1cdeee0264a172089fb385dc873488 authored almost 2 years ago

Alias `job_failed` to `job_completed`.

697ea6fc8e4bdcec48df6c4455cd0a7449871ce8 authored almost 2 years ago

Moved `Value` into `Values`.

79bb0b08b51ca8a0323eeb038c55bbaf53e3edb4 authored almost 2 years ago

Flush the output file after each line is written.

f54c55118949525ad96044f6cc8be26061a4bbc8 authored almost 2 years ago

Create the parent directory before opening the output files.

e72560e99bad374a988c09d23bb39ecce606889f authored almost 2 years ago

Forgot to add a license header.

8df682438c2f37c8c4e3c6bae5c8f806200a35fe authored almost 2 years ago

Added `OutputFormats::Dir` (closes #28).

fd4ed13352f9b43cd415fd0c2116fd3518e32f04 authored almost 2 years ago

Added a `ronin/recon/mixins` file.

14b85f7ad4aa074e224172e98138bc890f977ea8 authored almost 2 years ago

Merged `OutputFormats::List` into `OutputFormats::TXT`.

5e8e11720568e6a43f7029ef4e0c0020d8cdc66c authored almost 2 years ago

Added the `OutputFormats::OutputFile` class.

* Remove `OutputFormat.open`.

2618e0efb52947906a39a784b166a975639eecfc authored almost 2 years ago

Renamed `OutputFormat#<<` to `#write`.

a8620f1950265bfe112541ee258a9338ca82c9a3 authored almost 2 years ago

Moved `OutputFormat` into `OutputFormats`.

b344d7cdf6898de3a1d739702c52e6ee78f61ea3 authored almost 2 years ago

List supported output formats.

2f2ea4f1110e7bf7e32bce12eed310439cf8e697 authored almost 2 years ago

Changed `OutputFormats::CSV#write` to output `type,value`.

6457405a7b2df993592a1699d1fd79625cc77fac authored almost 2 years ago

Add missing links to the README.

eaf7ebb93ba975eb1f5f17201a606980bff3770e authored almost 2 years ago

Mention DNS SRV enumeration.

749109e78e88fd85edbb7b2aff5a6b5fa3b6fb42 authored almost 2 years ago

Fixed a YARD link.

e565d1a713a28f9bade8da68e4d0c7a8838f1043 authored almost 2 years ago

Added `DNS::SRVEnum` (closes #22).

407dbadbc64f69e68ad08458748ab2fb38e7ef5a authored almost 2 years ago

Yield a `Mailserver` if a `smtp` service is discovered.

d8504a456e73eda116578608e55de33815e54b70 authored almost 2 years ago

Forgot to add the license header.

c447ba6a665bdc4f4ba6ed699a3f1e37bfcd2eaa authored almost 2 years ago

Use `Set` to filter out duplicate values.

826fc0491e3823b28ec9f62c174b2380edd9f3c4 authored almost 2 years ago

Ignore top-level output files generated during testing.

b5a112f4d6abf6ac554a17d6a17994945895a1b8 authored almost 2 years ago

Add separate methods for adding nodes vs. adding edges.

* Call the callback for when new nodes are added or for when new edges
are added to the graph.

6f111a6a4200518a47516c92f445661c97c5bf52 authored almost 2 years ago

Associate the resolved IPs with the host name.

68ca71e815ab0e419ab97c44698052f980f541be authored almost 2 years ago

Added the `--output` and `--output-format` options to `ronin-recon run` (closes #15).

fe5319843d9b3b2c301fb003d15d99fc0cdfdf96 authored almost 2 years ago

Added `OutputFormat` and `OutputFormats` (closes #20).

0c0c0dd4afbfe844378367d18c4089f5f532ccfc authored almost 2 years ago

Use the `IP`'s host name when creating a `Website` value for an `IP`.

11587f2bb54922747873def2767449a86fe71f07 authored almost 2 years ago

Allow an `IP` to be associated with it's host name.

50151a6e9e079aba207701f40c9b562af2d17a1a authored almost 2 years ago

Refactor `Web::DirEnum#process`.

3a88d7debd5a86fb0c11258ce8fc14c6ec5e09bf authored almost 2 years ago

Start spidering at the `/` URI.

2a718f0cc9694b90e0ad526aac605a4e30495a79 authored almost 2 years ago

Also detect when the `http` service uses SSL.

c45de56afaa3a2ca0a20b68f8b4621f4baff57bf authored almost 2 years ago