github.com/ArchiveTeam/ludios_wpull commits | Ecosyste.ms: OpenCollective

Bumps version to 0.15a1.

cf907e95aa89a37433491d10e9ec22aa714c2160 authored almost 11 years ago

Bumps version to 0.14.

Merge branch 'develop'

Conflicts:
doc/changelog.rst
wpull/version.py

000da9fcec36943ced16ee3df65c5fbb62cc75f5 authored almost 11 years ago

changelog: Updates latest to 0.14.

3527f7f839f04bfe99e4aae70cbf94cc1086ef77 authored almost 11 years ago

Implements --post-data, --post-file (Closes chfoo/wpull#8).

8a26a837654ea3bf38336427102f1a1699e913e7 authored almost 11 years ago

Implements POSTing from scripts (Closes chfoo/wpull#25).

78f259e21c15cb8b467d75ad28dbabef4179b11d authored almost 11 years ago

processor,robotstxt: Switches to using RedirectTracker.

a3087f35f3f0486493fbac5f9497b8b9616a0c21 authored almost 11 years ago

Adds http.RedirectTracker.

69addd2e1424a9c20380a8f3303c8acda2c35229 authored almost 11 years ago

http.py: Adds url_info attribute to Response.

ac041ebcf042667daeeaf51cb6b4b61b94aae1cf authored almost 11 years ago

hook.py: Updates docstring for get_urls().

fd6a9b443efaa5ccfdc83d5f7118bab88c7ee868 authored almost 11 years ago

hook: Accepts inline, link_type for get_urls() (chfoo/wpull#25).

Moves Callbacks.to_native_type to HookEnvironment.to_script_native_type.

0a5a27306eb31308c595678da348749e38c2510e authored almost 11 years ago

database.py: Switches to SQLAlchemy.

e9682703471ef09fca0f73a56b1973fef7af45e8 authored almost 11 years ago

changelog: Updates latest to 0.13.

997d49f1cdb663a227b75db37c44b4204ebd3299 authored almost 11 years ago

Bumps version to 0.14a1.

300cfd77d473e2fdb060dd6629920c578864dab1 authored almost 11 years ago

changelog: Updates latest to 0.13.

2fd3375497e61b7aef07ea3198b6275110600927 authored almost 11 years ago

Bumps version to 0.13.

Merge branch 'develop'

Conflicts:
wpull/version.py

0bcd9f8f8bfa10ff6377c482a7318e8503da0b53 authored almost 11 years ago

http.Connection: Supports reading content-type gzip (Closes chfoo/wpull#14).

ef33b8f1e4ce522d143a2876bd68a0867db4c20d authored almost 11 years ago

http.py: Adds more docstring.

b92ab79f8e3fb69edba2e15120bb32583f04f91a authored almost 11 years ago

Bumps version to 0.13a1.

aff546c488b813b6fc2d756995806de1da7625b3 authored almost 11 years ago

Bumps version to 0.12.

Merge branch 'develop'

Conflicts:
wpull/version.py

6e77c745d320bc2973c6b55bfb426f7671495af2 authored almost 11 years ago

Updates changelog title to 0.12.

eca4c1afa1dc78d5264aaf2d2620575deca14e16 authored almost 11 years ago

Splits the api docs into seperate file for each module.

Adds more detail to docstrings.

d4406af08449c3eca0dd2f4207be00570583b5bf authored almost 11 years ago

Moves document.{HTMLScraper,CSSScraper} to scraper module.

28bc286ee1a08cc69a60ebec7e5c2a1685d07e31 authored almost 11 years ago

Configs docs to be cleaner. Adds docs on scripting hooks.

Changes api.rst to only show documented members.

d5bd7bdf0189145fddcef72e504028f4721b1d16 authored almost 11 years ago

engine.py: Adds back Statistics concern.

processor.py: WebProcessorSession uses keyword arguments.

engine,processor.py: Adds more docstr...

c0f3d4f4fb78c2405587a02d29d2103268fc6f30 authored almost 11 years ago

Adds BaseRequest, BaseResponse, BaseClient.

2e873d6ad0f3b0b411b07937e8c87d5dfc8cfd9f authored almost 11 years ago

Moves http.Body to conversation.Body.

9f4934392f449c6dab6a8712db15ef7a176fdd5a authored almost 11 years ago

Bumps version to 0.11.

f42e3f9b9278f6f8ff3cf5a6bad1cc2f38844224 authored almost 11 years ago

Merge branch 'develop'

119188919e1ca40380c1de52af20bb95e2d28ea8 authored almost 11 years ago

changelog: Adds 0.11 (progress bar, buffer size notes)

0b09268a1180052ed9c609d4608f0972969b7821 authored almost 11 years ago

http.Connection: __init__() supports buffer_size argument.

e795b04e19db60fdd761b53ee576fb73ed30f7f2 authored almost 11 years ago

recorder.py: Fixes print for Python 2.

bc828e6f2e9b62eb9abded566f3c8ddb581f3230 authored almost 11 years ago

Implements --progress to support progress bar or dot indicators.

a8c36813c28c6dc9c793aaebf6297ac670fc78e2 authored almost 11 years ago

network.py: Adds bandwidth meter.

fd38db538ffd7aee1c81c2910ceec9ef66d24663 authored almost 11 years ago

engine.py: Prints human friendly string stats.

7e96522693eef905cf1ebf7c3a3c49eaafef0bd0 authored almost 11 years ago

http.py: Increases buffer size to 10MB.

bd6ea763d6844c1a9cc736bace4fcd8ee28eefb0 authored almost 11 years ago

Adds util.format_size()

abc7c95ffa69ef0087fc56fddda9f89dbc3f895e authored almost 11 years ago

readme.rst: Hotlinks the image so it can be shown in PyPI.

1b98facbff6882acecf19fd6e0deb983d7e8ce2e authored almost 11 years ago

Bumps version to 0.10.9.

Merge branch 'develop'

Conflicts:
wpull/version.py

65ec4a6d4f0fac69fb95dafe903585c69a9f568a authored almost 11 years ago

Attempts to fix Read the Docs by making lxml mocked.

bb050f60d9c1f601f22993ef3c1b0d56435c7f06 authored almost 11 years ago

Removes modules with C extensions from requirements-sphinx.txt.

115e1eb21a1e5652bcc699d3e881b212d030b75f authored almost 11 years ago

Adds requirements-sphinx.txt for Read the Docs.

6c81365c7046f28e087159acc22cf765da115b23 authored almost 11 years ago

Fixes docstring syntax errors.

486f6fd8d688a96604f6d22218fc41825b899c1d authored almost 11 years ago

Adjusts namedtuple types names so doc can work.

d4eefd8c4f4cc200982385d28d90706fafa5668f authored almost 11 years ago

Adds remaining docstrings.

cf756da205cb8b3aa904eb99dd17de9d1d44eb62 authored almost 11 years ago

Adds WIP docstrings.

27790f48761142c4776a6143ebe823102e92c55a authored almost 11 years ago

doc/conf.py: Adds readthedocs mocks.

e8c28d803550b592dbbde4ee1b78b0a5efaf7c5d authored almost 11 years ago

readme.rst: Updates links to wpull.readthedocs.org.

240c92a54dcf023a14fc6cee87f89c257d5cd5b9 authored almost 11 years ago

Adds initial documentation.

faecc3b6dd8ebad0029c02761558f30d474a98c0 authored almost 11 years ago

Adds icons.

84e4aea247a3b0e05698ce07da92775667729582 authored almost 11 years ago

Bumps version to 0.10.8.

Merge branch 'develop'

Conflicts:
wpull/version.py

795be92ca80e21b99197b9e6726b4818b5bdeaa9 authored almost 11 years ago

Backports urlparse.py for Python 2.6.

a52a1ba7625d3c5fd1d3a142f89f94ca725a1c6b authored almost 11 years ago

document.py: Uses wpull.util.urljoin().

5124dde7eb238c826b67f1b22328dd7eed93a189 authored almost 11 years ago

url.py: Adds urljoin() that supports URLs begining with double slashes.

7f47096fe89c15c5f409f2ac3a0eb21d7826f1e6 authored almost 11 years ago

url.URLInfo.parse: Simplifies schemeless URL logic.

15aa5f37d1f0c9cf7338e4dcded0878bbda16b67 authored almost 11 years ago

database: Creates an index on status.

9a24d895e9374bd43e28b7727dd6a514da0ad765 authored almost 11 years ago

http.Connection: Uses invalid content length as no length.

Tries and waits until the connection closes. Closes chfoo/wpull#17.

502a4366ad36bc9bc7816c638f314068aebaab9a authored almost 11 years ago

engine.py: Removes table count debug msg. Closes chfoo/wpull#18.

97424b24fd34f1bcc938b3ae5173a409aa6ba30d authored almost 11 years ago

url_test.py: Adds tests for javascript URLs.

11af6b07a9058662ec269c819b2a9115f0d1e7b2 authored almost 11 years ago

Resets version to 0.11a1.

7646c82ba2b6afc19cdd94d36ec580bce70da00e authored almost 11 years ago

Merge branch 'hotfix' into develop

5a7c6a5ba3ecdacbec06223e6df8d26e2f2894b0 authored almost 11 years ago

Bumps version to 0.10.7.

dfb6cf6fb13edb429725679b2da81e66e05bb002 authored almost 11 years ago

Merge branch 'hotfix'

ef511f5d7707408410e45f72832ed476157dc0b1 authored almost 11 years ago

url.BackwardDomainFilter: Returns False if test_domain is empty.

3be36f3f450a89c5d05da6583bca8c9a2596092f authored almost 11 years ago

Bumps version to 0.10.6.

33327265729772e3e84baa0b5ab1f47fe0d84561 authored almost 11 years ago

Merge branch 'hotfix'

08a95e057e9c6dfed8d6de625b014a34861a9287 authored almost 11 years ago

url.py: Raises error if URL hostname is empty on HTTP schemes.

46ec899d9e88f86b416a7e8f5234a4a049e06a3e authored almost 11 years ago

Bumps version to 0.10.5.

4cfbf8494428ae1e7d2fe106a6e646808e955adc authored almost 11 years ago

Merge branch 'hotfix'

27b9ebc11afaa36168c4cbc09a0822314ddeb92f authored almost 11 years ago

document.get_encoding(): Reads the entire file.

d6d288b672d954e591d497e46034b90d0ffeaf21 authored almost 11 years ago

Merge branch 'master' into hotfix

52d30f6ecee77f58d665a7476d17202fbed0d284 authored almost 11 years ago

Bumps version to 0.10.4.

Merge branch 'develop'

Conflicts:
wpull/version.py

ac513e67a61402d07c2d13d7f18a6932d84b6b79 authored almost 11 years ago

processor,robotstxt: Passes the URL encoding to the Request factory.

Closes chfoo/wpull#16.

c0699a4b9e1a690dea0c849a3857cfaf2c81c436 authored almost 11 years ago

http.Request.new: Supports url_encoding parameter.

cee8eb2e28880513f1fbc1caccc877386ce16778 authored almost 11 years ago

writer.py: Uses quasi_quote() as appropriate.

ef4284916af82459161749162b26f07406057a03 authored almost 11 years ago

Adds percent-encoded URL to test file.

e2eb3660e50a2e638fc7196ca08c452771dc1a7b authored almost 11 years ago

url.py: Defaults to Latin-1 quasi_quote, quasi_quote_plus.

Callers of the quasi quote functions should use is_percent_encoded() to
determine if the quasi q...

db9549cc20533c75eae6390914996baf4a0bac67 authored almost 11 years ago

setup.py: Removes requiring 3to2. readme: Emphasize need latest 3to2.

93c2da2d68d1f496f0a3d67d5e90faf865f21ade authored almost 11 years ago

Fixes ProgressRecorderSession to print to correct stream.

Closes chfoo/wpull#15.

693a36c5998d9ca21a2634b18678d1482bbf513b authored almost 11 years ago

readme.rst: Fixes typo in archiving example.

f64bf0a1c63d8e182714868cb0280376b35e3b5a authored almost 11 years ago

Adds *.rst to manifest. Sets version back to 0.11a1.

d3315622541c9fb67999a5f3853c7fa9e364421e authored almost 11 years ago

Merge branch 'topic/fuzz_testing' into develop

e4fab13a312eb1d9020ce62364b2cc488b4888e7 authored almost 11 years ago

Bumps version to 0.10.3.

606cf7d791442531f35daf3a7a5bf7fccfb8dbfa authored almost 11 years ago

Merge branch 'develop'

0c4ce16eff65745b607ba812d97157358f3cc15e authored almost 11 years ago

http.py: Handles header missing colon. Closes chfoo/wpull#11.

80c291153d4999ea3e246d3217027209eb0d2118 authored almost 11 years ago

namevalue: Adds strict mode. Supports ignoring fields missing colon.

995bbc5c104eb9f0105060777c67904046d33625 authored almost 11 years ago

http: Always use Latin-1 to decode status line. Closes chfoo/wpull#13.

14ce14e90acd1f33f8af81c1ba428d67d9ba00d5 authored almost 11 years ago

document: Returns None if HTML is unparsable. Closes chfoo/wpull#12.

c90782e3b6b8f6139cc003061a2eb1ac6a0ecdc9 authored almost 11 years ago

Fixes --input-file to read lines from file. Closes chfoo/wpull#10.

5b179e3b259ddd1e85d8999e2375c1a505142689 authored almost 11 years ago

Adds more HTML samples. WIP on fuzz tester.

eabc9672f3a00424777bca0d46739e1d780a1192 authored almost 11 years ago

Adds initial fuzzer using Fusil.

208ea9b58f114231634c6aa56f10d71bcaaeb81e authored almost 11 years ago

Merge branch 'hotfix' into develop

cbdd42063eb4f3e530cf1d83adddf7c9391722b6 authored almost 11 years ago

Merge branch 'hotfix'

28de3f5c3b50e59255582e21596a9a13b9b1d7ef authored almost 11 years ago

readme.rst: Adds more detail about lib3to2.

Fixes manual install instructions to use URLs for requirements.txt. For
assuming the repo will n...

3278e716c7bf58b63cb6c14bcd8b6c91ec854b1e authored almost 11 years ago

Merge branch 'master' into hotfix

63e00cfe63626e8fcc95371385af1502f7e4a233 authored almost 11 years ago

Bumps version to 0.10.2.

b8f5c8b0988e19007d58c4ba95fd895d067cbe62 authored almost 11 years ago

Merge branch 'develop'

d1e423cfca70ade9d9478a82d2cdcca7a3041fd3 authored almost 11 years ago

readme.rst: Fixes link formatting.

2dcce2c61635b4ef4de793271c1c7c8763e7fa6d authored almost 11 years ago

Merge branch 'topic/improve_requirements' into develop

4c8ebd007bd9cce2ee6d9ebda1996eff2f24a069 authored almost 11 years ago

Fixes syntax error in travis config.

8b8b1de5f545c427e26daa5929000e7a7fb29032 authored almost 11 years ago

Adds lib3to2 as a Python 2 requirement.

bf42e361eae647615d5698b6b5c1eec2fe524e6a authored almost 11 years ago