Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/wget-lua

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
https://github.com/ArchiveTeam/wget-lua

Fix logging in background mode

* ../src/main.c: Re-init logfile if changed for background mode
* ../src/utils.c: fork_to_backgr...

c722973212547aa812cd818279e3fb989fb38dd4 authored almost 7 years ago by Tim Rühsen <[email protected]>
* src/http.c: Fix two typos in comments

bb7fa977a1223bd76cf301ee190f774612910d4b authored almost 7 years ago by Tim Rühsen <[email protected]>
* testenv/conf/expected_files.py: Ignore pubring.gpg

Reported-by: Arkadiusz Miśkiewicz

f2d6075a6e96df42e8408921bb2d200468ba31c3 authored almost 7 years ago by Tim Rühsen <[email protected]>
* bootstrap.conf: Replace gnulib module gettext by gettext-h

0caed28cda0fd6bac2442a133aadb990fe4378da authored almost 7 years ago by Tim Rühsen <[email protected]>
Mention list and bugtracker for --help and in man page

* doc/wget.texi: Mention list and bugtracker in man page
* src/main.c: Mention list and bugtrack...

d27032c4461f37549c8eae32db2721ab0e0c5ea8 authored almost 7 years ago by Tim Rühsen <[email protected]>
* contrib/make-release: Add another release script

080fd0d93be910a7af85e42ce2c4986e4198ddee authored almost 7 years ago by Darshit Shah <[email protected]>
Update NEWS file for new release

ab8a3c80dfc981194ca2ea42d9f709ac198b222c authored almost 7 years ago by Darshit Shah <[email protected]>
Fix typo in documentation

11ecabcb3d4e11ffae245bdf234546929df4f27d authored almost 7 years ago by Darshit Shah <[email protected]>
Switch off compression by default

Gzip compression has a number of bugs which need to be ironed out before
we can support it by de...

d0a5d9f13104c14c076323ea186a1e8e2f452457 authored almost 7 years ago by Darshit Shah <[email protected]>
Pull gnulib module forward

0ff71e5ff159ce76fa78a0c5e8f7cdd0ac4b049f authored almost 7 years ago by Darshit Shah <[email protected]>
Revert "* src/init.c (defaults): Set compression_none as the default compression"

This reverts commit 8283ac08467016283277578b96533febb8ce1adb.

0d0a95a01bbb8df99dd00ff311faa7083bb65419 authored almost 7 years ago by Darshit Shah <[email protected]>
* src/init.c (defaults): Set compression_none as the default compression

8283ac08467016283277578b96533febb8ce1adb authored almost 7 years ago by Darshit Shah <[email protected]>
* src/http.c (gethttp): Fix bug that prevented all files from being decompressed

Signed-off-by: Darshit Shah <[email protected]>

a7cc4e2b3706c17bd64afec121e0b2515aacaf63 authored almost 7 years ago by Reiji <[email protected]>
* src/host.c (sufmatch): Fix to domain matching

55d25fc20c0141cb7cb8bd0a6964b81aa0b50124 authored almost 7 years ago by Tim Rühsen <[email protected]>
* src/netrc.c: Fix Standalone compilation of netrc file

513cc1c0c837e249038c4e7d6b6c90c2e3e563ec authored almost 7 years ago by Gisle Vanem <[email protected]>
* NEWS: Update NEWS file for new release

3249045a918f596c136db7e0cc398f918ed706df authored almost 7 years ago by Darshit Shah <[email protected]>
* bootstrap: Use the faster gnulib-tool.py script if possible

b1fc37f465991aa57ae18efe043eb8b12bfc2fb7 authored almost 7 years ago by Darshit Shah <[email protected]>
Sync the bootstrap script from gnulib

953bcdaba86f23e92de6fdce2b084c433cacd15e authored almost 7 years ago by Darshit Shah <[email protected]>
Update Copyright years

183fccdaade74ba3968905302e4b75d39fdd9b13 authored almost 7 years ago by Darshit Shah <[email protected]>
Replace HTTP urls with HTTPS where valid

8240439e213f1ee1aa5e310837b90bb7c676175a authored almost 7 years ago by Darshit Shah <[email protected]>
Update gnulib

a03716a0fe3353bdb488eeb89f7938e0d1cfa6a4 authored almost 7 years ago by Darshit Shah <[email protected]>
* src/netrc.c: Search for the correct netrc file on Windows

d26c6c002866376b73c3c8ffd4969203b5c1420c authored almost 7 years ago by Darshit Shah <[email protected]>
* src/http.c: Exclude *.gz and *.tgz from decompression

047746eb765d212cbf05afac16f4bd73257d8186 authored almost 7 years ago by Tim Rühsen <[email protected]>
* src/utils.c (wg_pin_peer_pubkey): Fix format warning

d8df356d4ba46401181bdeacb207a5f2b731645c authored about 7 years ago by Tim Rühsen <[email protected]>
Avoid redirecting output to file when tcgetpgrp fails

* src/log.c (check_redirect_output): tcgetpgrp can return -1 (ENOTTY),
be sure to check whether ...

220c24ecb5f37bbc38231703c96c2e95f6af808d authored about 7 years ago by Peter Wu <[email protected]>
Add new test for 416 responses

* testenv/server/http/http_server.py: If there are multiple requests in
which the requested rang...

3d2b2231cdaf11e678c5f4129c2dc6cb5f4132eb authored about 7 years ago by Darshit Shah <[email protected]>
Don't assume a 416 response has no body

* http.c(gethttp): In case of a 416 response, try to drain the socket of
any bytes before reusin...

693cee01099b636257f31068d75ce6b506073cfe authored about 7 years ago by Darshit Shah <[email protected]>
Support building with OpenSSL 1.1 w/o deprecated features

* src/openssl.c (ssl_init): Fix code for the subject's issue

Reported-by: Matthew Thode

6aa6b669efbef62f60471c18e7fdef0206f92337 authored about 7 years ago by Tim Rühsen <[email protected]>
Avoid link conversion after 304 Not Modified

* src/http.c (gethttp): Handle 304 before setting document content type

Fixes: #52404
Reported-...

8551ceccfedb4390fbfa82c12f0ff714dab1ac76 authored about 7 years ago by Tim Rühsen <[email protected]>
Fix printing mutibyte chars as unprintable chars on Windows

* src/log.c (get_warc_log_fp): Fix return value to stderr
* src/main.c (main): Init logging as s...

19060db44f10d426576f69c515c54ebea37f9e6d authored about 7 years ago by YX Hao <[email protected]>
* tests/Test-https-weboftrust.px: Fix/add sslport

a30a5a9059f79a3158dea3e213a9857327eb4206 authored about 7 years ago by Tim Rühsen <[email protected]>
Convert remote path to local encoding

* src/url.c (url_file_name): Convert remote path to local encoding

a9a953feee66b3ab3078be872f5de1232bb58ceb authored about 7 years ago by YX Hao <[email protected]>
Do not use must-revalidate in Cache-Control header

As the bug report states, 'must-revalidate' is a request directive.

Fixes #52379

267cd51fffdb2e33f3e192383ccad4443f25cfa2 authored about 7 years ago by Tim Rühsen <[email protected]>
Fix Segfault due to derefencing null ptr

* src/http.c(gethttp): When Encoding is gzip, ensure that the
Content-Type Header was actually s...

973c26ed7d51052a7b6e120ed1b84e47266667e1 authored about 7 years ago by Darshit Shah <[email protected]>
* src/http.c: Fix H_REDIRECTED

16d066f89c28b522c4dbdafb2e6a6952bd031d19 authored about 7 years ago by Tim Rühsen <[email protected]>
* src/http.c: Add support for HTTP status code 308

a2477d487c80cedc1093d58066fa67a72a77d550 authored about 7 years ago by Tim Rühsen <[email protected]>
Fix uninitialized value messages in tests

* tests/Test-https-*.px: Use correct variable in error message

Reported-by: Jeffrey Walton

7ac72e063c2a3ff9fc4488f8899958e83af44300 authored about 7 years ago by Tim Rühsen <[email protected]>
Ignore dirmngr.conf, gpg.conf in test directories

* testenv/conf/expected_files.py: Ignore dirmngr.conf, gpg.conf

Libgpgme creates certain files ...

95891cbba3594ca07c706670cee6615f0e4d0c7f authored about 7 years ago by Tim Rühsen <[email protected]>
* contrib/release: Cleanup, use lzip instead of xz

2486320a2a76fec98a23318cdf4895e445c184c7 authored about 7 years ago by Tim Rühsen <[email protected]>
Fix heap overflow in HTTP protocol handling (CVE-2017-13090)

* src/retr.c (fd_read_body): Stop processing on negative chunk size

Reported-by: Antti Levomäki...

ba6b44f6745b14dce414761a8e4b35d31b176bba authored about 7 years ago by Tim Rühsen <[email protected]>
Fix stack overflow in HTTP protocol handling (CVE-2017-13089)

* src/http.c (skip_short_body): Return error on negative chunk size

Reported-by: Antti Levomäki...

d892291fb8ace4c3b734ea5125770989c215df3f authored about 7 years ago by Tim Rühsen <[email protected]>
Update for release 1.19.2

* NEWS: Add news for 1.19.2
* doc/wget.texi: Fix 1.20 to 1.19.2

bec4c215a8cbaa1ddec71180f328abfcce81ee40 authored about 7 years ago by Tim Rühsen <[email protected]>
Avoid unnecessary UTF-8 encoded fallback (trivial change)

* src/retr.c (retrieve_url): Check for changed URL on redirect

27d78d944f9cc4ba1424ba117f3027af1a35cc4f authored about 7 years ago by YX Hao <[email protected]>
Add GNU extensions to .netrc parsing

src/netrc.c (parse_netrc): Add 'port' and 'force' extensions

Reported-by: September 20Tim Lands...

60f033426fe47a1dc0d6e0fdb7a230234fb72502 authored over 7 years ago by Tim Rühsen <[email protected]>
Bail out on unexpected 416 server errors

* src/http.c (gethttp): Stop on 416 if file is incomplete

6f3b9959935ad7640bcf48a0a93848ed25ff8963 authored over 7 years ago by Josef Moellers <[email protected]>
Adjust Extension based on Content-Encoding

* doc/wget.texi (--adjust-extension, adjust_extension): Updated documentation.
* src/http.c (enc...

08ed2a5530e3c3b84c35acaadb89eef7b97bdc1c authored over 7 years ago by Tim Schlueter <[email protected]>
Add --compression option

* doc/wget.texi: Add --compression documentation.
* src/init.c (cmd_spec_compression): New funct...

b543dfe7832ff342907b9ee71aeea4bc1849fb26 authored over 7 years ago by Tim Schlueter <[email protected]>
Add gzip Content-Encoding decompression

* src/http.c (struct http_stat): Add remote_encoding field.
(read_response_body): Enable gzip de...

c451eec15534771692e7335a4ae1fe8c404287bb authored over 7 years ago by Tim Schlueter <[email protected]>
Document gperf as a requirement

951d3e4cddc8a1445907733d22b72d4dae022911 authored over 7 years ago by Darshit Shah <[email protected]>
* src/url.c (url_scheme): Use ASCII version of strncasecmp

3ad3b3e36c89ae86cffba4e214fb9d7f33f4fc96 authored over 7 years ago by Tim Rühsen <[email protected]>
Fix misuse of strncasecmp

* src/http.c (set_content_type): Use c_strcasecmp instead of strncasecmp

See issue bug #51576

5fb6b6bd680120ac1557050444e876f316a0726f authored over 7 years ago by Tim Rühsen <[email protected]>
Fix python test suite for GnuTLS 3.5.12+

* testenv/Test-*.py: Replace 127.0.0.1 by localhost
* testenv/certs/server-template.cfg: Likewis...

f42229b1fdf30ee30c6e13b01eb0c4ebd9ea9169 authored over 7 years ago by Tim Rühsen <[email protected]>
Check for 304 response before applying --adjust-extension

* src/http.c (gethttp): Move 304 code before --adjust-extension code

This fixes applying --adju...

21154bdc36f1474aaf26323d8de47aa3fe340d03 authored over 7 years ago by Tim Rühsen <[email protected]>
Fix buffer overflow in Public Key Pinning

* src/utils.c (wget_base64_decode): Add param for destination size,
(wg_pubkey_pem_to_der): Am...

ae293c945a474b5f06844f6ec4debcfb5fa9116f authored over 7 years ago by Tim Rühsen <[email protected]>
* doc/wget.texi: Mention --no-config

407c1f990ab751004c3521d50e046ab56fe9c06f authored over 7 years ago by Tim Rühsen <[email protected]>
* testenv/Test-recursive-basic.py: Check crawled files

86b46a34a59791622931e99b210fe6385243621d authored over 7 years ago by Tim Rühsen <[email protected]>
Fix two Metalink tests if $HOME is changed

* conf/expected_files.py (gen_local_fs_snapshot): Skip processing
of 'pubring.kbx'

5d4ada1b7b0b79f8053f3d6ffddda2e2c66d9dce authored over 7 years ago by Tim Rühsen <[email protected]>
Add command line option to disable use of .netrc

Although internally code uses option for (not) reading .netrc for
credentials, it was not possib...

876def8ebe56d483921cf645371d277b615373e5 authored over 7 years ago by Tomas Hozza <[email protected]>
Fixed getting of credentials from .netrc

There seemed to be a copy&paste error in http.c code, which decides
whether to get credentials f...

f8c3df1f40f09dd61078436614d06e7ad818536e authored over 7 years ago by Tomas Hozza <[email protected]>
Added tests for HTTP authentication using credentials from .netrc

Getting credentials from .netrc has been broken from time to time, thus
adding a test coverage t...

17960b57d51ffb19b2b20df3e53da42c555f022c authored over 7 years ago by Tomas Hozza <[email protected]>
Fix Test-https-badcerts.px

* util/createcerts.sh: Set date of invalid cert to +20 years
* tests/certs/invalid.crt: Re-gener...

40c0d30f5c6b057394910efa79128d0c8dbc6248 authored over 7 years ago by Tim Rühsen <[email protected]>
* util/createcerts.sh: Fix double equal (syntax-check)

e2c702571fbd5b7347231c355ea006f5acb9cb5b authored over 7 years ago by Tim Rühsen <[email protected]>
Fix Test-https-badcerts.px to work with GnuTLS

* tests/Test-https-badcerts.px: Remove OpenSSL requirement
* tests/certs/expired.crt: Re-created...

269fb6201d22067c7b5bed19b76db6f865b0b4e6 authored over 7 years ago by Tim Rühsen <[email protected]>
New shell script to create the certs and keys required for TLS tests

* util/createcerts.sh: New file

c08778aeb3462d67fc9c9a39d204fcce5836dbad authored over 7 years ago by Vijo Cherian <[email protected]>
Fix HTTPS testing for stricter OpenSSL

* testenv/certs/README: Amend cert creation extensions
* testenv/certs/ca-cert.pem: Created with...

297c1e2ac393c2b778122b3fc1f0d6c139a07f35 authored over 7 years ago by Tim Rühsen <[email protected]>
* src/iri.c (idn_encode): Better IDNA 2003 compatibility

936efc356426fc8b6a89fbc07fac02dc31e6cbd0 authored over 7 years ago by Tim Rühsen <[email protected]>
* .gitlab-ci.yml: Also test OpenSSL build

11d3de74caabe9c0d02da9ea3365511de585892c authored over 7 years ago by Tim Rühsen <[email protected]>
* .gitlab-ci.yml: Remove installation of texlive

35d5b67cc17dd840b02b36648d492c5bc350aa2e authored over 7 years ago by Tim Rühsen <[email protected]>
Add certs/wotca.pem to avoid temp. file creation

* tests/certs/wotca.pem: New file
* tests/Test-https-weboftrust.px: Remove creation of wotca.pem...

da50a1ecc36246845834faac82faecde84629714 authored over 7 years ago by Tim Rühsen <[email protected]>
* cfg.mk: Exclude ^tests/certs/.* from syntax-check

1068ca07d3d23acc4769c687c8e5147005387c27 authored over 7 years ago by Tim Rühsen <[email protected]>
* po/POTFILES.in: Remove spider.c (syntax-check)

0666e0f375a753e7ef61c2c5229cb7b30ec18432 authored over 7 years ago by Tim Rühsen <[email protected]>
* tests/Test-https-selfsigned.px: Add newline at EOF (syntax-check)

0d9f8280e00c79e40fa564a84cb98ced6c8da706 authored over 7 years ago by Tim Rühsen <[email protected]>
Removed all uses of temp files.

Added needed files to GIT

17f0e16ecc8bd1323cb25c1919f37beab7c9607d authored over 7 years ago by Vijo Cherian <[email protected]>
Made CRL related files in the repo, instead of trying to generate them

cc74f8b7e2aab5da7185052519841fcb2e9ba58e authored over 7 years ago by Vijo Cherian <[email protected]>
Cleanup on exit in Test-https-*.px

* tests/Test-https-*.px: Cleanup on exit

2894a3718992dbc175ec43984e06295111be73e8 authored over 7 years ago by Tim Rühsen <[email protected]>
Auto-generate interca.conf and rootca.conf

* configure.ac: Add interca.conf.in and rootca.conf.in to AC_CONFIG_FILES
* tests/certs/interca....

4669ba5e0c25b4ea7c3288f866d71c7d3689d473 authored over 7 years ago by Tim Rühsen <[email protected]>
Fix path and VPATH issues of new https/TLS tests

* tests/SSLTest.pm: Use $srcdir in read-only files,
(_setup_server): Remove unneeded path fixa...

b5c2d083ea2b42ee9a2f011719e0c1e0abdfbd41 authored over 7 years ago by Tim Rühsen <[email protected]>
Fix WgetFeature.pm to allow multiple required features

* tests/WgetFeature.cfg: Remove file
* tests/WgetFeature.pm: Extend to multiple features, cleanup

ffe75d0867d2e0d8ba2c306d4df82b3a0c98b396 authored over 7 years ago by Tim Rühsen <[email protected]>
* tests/Makefile.am: Enable Test-https-badcerts again

f68d0016267bbbfdd92ee5994a8c41adb3cc53f7 authored over 7 years ago by Tim Rühsen <[email protected]>
Check for test server name resolution in tests

* tests/Test-https-*.px: Skip if test server name resolution fails

466afc62b06f093ba78c85c9a8fd29ba12309ab1 authored over 7 years ago by Tim Rühsen <[email protected]>
* .gitlab-ci.yml: Add wgettestingserver to /etc/hosts

9aa894853f2c7a18db3c7e881ff315a68f245394 authored over 7 years ago by Tim Rühsen <[email protected]>
* tests/SSLServer.pm: Check for IO::Socket::SSL

5337b94ce532d6eeb3a9841d8cf344482fcb38fc authored over 7 years ago by Tim Rühsen <[email protected]>
* tests/Test-https-*: Change server port to <= 32767

a26e6f3527f3ada11eb8f22b4d0f1ae189a7cadb authored over 7 years ago by Tim Rühsen <[email protected]>
Move https test server ports from >32767 to <= 32767

* Test-https-badcerts.px: Change port
* Test-https-crl.px: Likewise
* Test-https-weboftrust.px: ...

b9fb74ddfa4e3ce0758401b3871a2e9ea4899b47 authored over 7 years ago by Tim Rühsen <[email protected]>
* tests/Makefile.am: Add SSLTest.pm and SSLServer.pm to EXTRA_DIST

3132049ae4f054b85bc8bd1a0850160dcb4ecd00 authored over 7 years ago by Tim Rühsen <[email protected]>
* tests//Makefile.am: Disable Test-https-badcerts.px

c0c42da653f9560344f03de9613716ca5481368b authored over 7 years ago by Tim Rühsen <[email protected]>
Add Gitlab CI (Debian)

* .gitlab-ci.yml: New file

888cc82c9d0603bc8eba6e635839c24c9828e873 authored over 7 years ago by Tim Rühsen <[email protected]>
* .travis.yml: Use trusty for libidn2-dev

fce1b689e83dd269de1672673a4cba3e1298ea6b authored over 7 years ago by Tim Rühsen <[email protected]>
* tests/certs/test-ca-key.pem: Add newline at EOF

580067d1e69abda1e5403d3c897271a9b3526cdf authored over 7 years ago by Tim Rühsen <[email protected]>
Add static HOSTSALIAS file

* tests/certs/wgethosts: New file
* tests/Test-https-*.px: Remove creation of wgethosts file

5c4cc011feaa97874d707cfdd275a844b46545e4 authored over 7 years ago by Tim Rühsen <[email protected]>
Added new tests for SSL

* tests/Test-https-badcerts.px : New file
* tests/Test-https-clientcert.px : New file
* tests/Te...

2a9624946910b12955b82a636ef3482431307aa8 authored over 7 years ago by Vijo Cherian <[email protected]>
Mention TLSv1_1 and TLSv1_2 as secure-protocol values in help

* src/main.c: The --secure-protocol option accepts also values TLSv1_1
and TLSv1_2, as mentioned...

0b41c7543a79bab3a66c49a50ba91ba8791b7962 authored over 7 years ago by Tomas Hozza <[email protected]>
* src/http.c (gethttp): Support Wayback Machine's X-Archive-Orig-last-modified

c4a2b2e77eead0074817fb1e46e6f1be2903b621 authored over 7 years ago by Tim Rühsen <[email protected]>
Added new tests for SSL

* tests/Test-https-badcerts.px : New file
* tests/Test-https-clientcert.px : New file
* tests/Te...

f6376ac0dc5ed5cec6f5261e7314e457de16d867 authored over 7 years ago by Vijo Cherian <[email protected]>
Added new tests for SSL

* tests/SSLServer.pm: New file
* tests/SSLTest.pm: New file
* tests/Test-https-pfs.px: New file
...

ac519c041e49bc0e35901a783685bb4068d1fdbd authored over 7 years ago by Vijo Cherian <[email protected]>
* src/utils.c: Remove non-portable __builtin_unreachable()

56c78c4b09a045820322513cf1b9833b1e472f9f authored over 7 years ago by Tim Rühsen <[email protected]>
Skip iconv() usage if HAVE_ICONV is not defined

This helps on broken iconv implementations, e.g. Solaris.

Reported-by: Mojca Miklavec

0ec46cb109d6f1253c675d51de92e555a60739ec authored over 7 years ago by Tim Rühsen <[email protected]>
Mention 'bash' for executing ./bootstrap

Reported-by: Mojca Miklavec

67cb37ce5a5dc34ef83cf2d8d3ee5639bd39ab6a authored over 7 years ago by Tim Rühsen <[email protected]>
* bootstrap.conf: Make 'sed' options more portable

'sed -i' works differently on FreeBSD.

Reported-by: Mojca Miklavec

0004d3ec22d2eb70d73a37f00018e2722a6d54be authored over 7 years ago by Tim Rühsen <[email protected]>
Fix charset transcoding issue for non-reversible codepoints

* src/url.c: Check iconv() against 0, not -1

On some libiconv implementations, unknown codepoin...

92bfe2a2e44184f62d4093ac51fb8cf5d951a1d5 authored over 7 years ago by Tim Rühsen <[email protected]>