Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/wget-lua

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
https://github.com/ArchiveTeam/wget-lua

* src/iri.c: Fix WIN32 idn2_free, forgotten code

fc2f4233ed64eb563935610e04b61127754daa91 authored over 7 years ago by Tim Rühsen <[email protected]>
* src/init.c: Set flstats correctly when using WGETRC env var

b2c38d33e1cf8e89b2cd9f8c9f50f619f25f09ee authored over 7 years ago by Darshit Shah <[email protected]>
Fix use of idn2_free()

* src/connect.c (connect_to_ip): Use xfree() instead of idn2_free()
* src/host.c (lookup_host): ...

6ef493b19ee0468dd2884940e7ad50172213fc11 authored almost 8 years ago by Tim Rühsen <[email protected]>
Fix perl warnings in tests

* tests/FTPServer.pm: Escape '{' in RE to fix warnings
* tests/FTPTest.pm: Likewise
* tests/HTTP...

7ffe93cabb181f39ad5091c31ab9f61bd940a55f authored almost 8 years ago by Anton Yuzhaninov <[email protected]>
Fix typos in comments

f381831d889a0a2f3f28f5bec2dbe66f555e3a33 authored almost 8 years ago by klemens <[email protected]>
* src/metalink.c (retrieve_from_metalink): Fix len in memset()

02d40a4676459fe452e57f9a2dae1c6ab67a9917 authored almost 8 years ago by Tim Rühsen <[email protected]>
Add gnulib module group-member

e89267fbbc37e65f2a3a15f6ad84389253421870 authored almost 8 years ago by Tim Rühsen <[email protected]>
Safeguards against TOCTTOU

* src/utils.h: Add struct file_stat_s declaration,
change prototypes of file_exists_p(),
add...

400b8eba6c446d8c22ad3a8807d0a6ba05c46b6b authored almost 8 years ago by Vijo Cherian <[email protected]>
Update gnulib

90a0a7499ce1384c94819331569c49565a28719a authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/warc.c (warc_write_cdx_record): Escape URLs

1d71645c066e1b32f7033180f5dcc57e21145038 authored almost 8 years ago by Christof Horschitz <[email protected]>
Include libunistring headers only when used

* src/iri.c: Check for libidn2 < 0.14 to include libunistring headers

The unistring functions a...

e24984414367985ec4b2c475dac0b7bace38eadb authored almost 8 years ago by Mike Frysinger <[email protected]>
Fix links to www.robotstxt.org

* NEWS: Fix links
* doc/wget.texi: Likewise
* src/res.c: Likewise

Reported-by: Noël Köthe

84a93f4127173f1bc50d52f07fd18f9dc093f893 authored almost 8 years ago by Tim Rühsen <[email protected]>
* tests/WgetTests.pm: Add -d to Wget test options

f31b93424befc27f3f056ac4347546a2b17eceb9 authored almost 8 years ago by Tim Rühsen <[email protected]>
Include <arpa/inet.h> for Windows

Reported-by: Gisle Vanem

90b487369a5cd3fb74bf1d2f324ae67c222c4c23 authored almost 8 years ago by Tim Rühsen <[email protected]>
Fix updating HSTS entries

* src/hsts.c (hsts_store_entry): Always update 'created' field

Fixes: #50490
Reported-by: Deian...

57d748117ffa7bc66dedbfe8a93175a9585e2950 authored almost 8 years ago by Tim Rühsen <[email protected]>
Fix CRLF injection in Wget host part

* src/url.c (url_parse): Reject control characters in host part of URL

Reported-by: Orange Tsai

4d729e322fae359a1aefaafec1144764a54e8ad4 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/warc.c: Use warc_write_header_uri for all WARC-Target-URI fields

The WARC spec requires that all URIs be enclosed in angle brackets. This
was being done in most ...

63c2aea2557b84640272629c7dc0caccab66ab6d authored almost 8 years ago by Benjamin Esham <[email protected]>
Fix 504 status handling

* src/http.c (gethttp): Move 504 handling to correct place.
(http_loop): Fix memeory leak.
* t...

ac4fed32204e9ec1874e7cb5ecc55f1b35c1c8de authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/url.c (url_file_name): Do not charset convert local directory

In a non-ASCII environment, the local path may contain non-ASCII
characters. The server responde...

cf5df5593d0d17677a90d02f9570d4fd11a43b37 authored almost 8 years ago by YX Hao <[email protected]>
* configure.ac: Remove manually resetting of LIBICONV variable

Fixes: #48193
Reported-by: ilovezfs
Reported-by: Charles

2215ee8d10582c54132c2dfe882d1b7e9859de87 authored almost 8 years ago by Tim Rühsen <[email protected]>
* bootstrap.conf: Call gperf to create lib/unicase/special-casing-table.h

32e26dc199be48803db4c695c78b9c4843f179f1 authored almost 8 years ago by Tim Rühsen <[email protected]>
* bootstrap.conf: Fix latest gnulib to work with gperf < 3.1

21ac4ae3568cf9d83a1597ca50cf6d7470e1604d authored almost 8 years ago by Tim Rühsen <[email protected]>
Pull GNULib to latest.

* gnulib: Pull to latest commit. This fixes an issue with Gperf 3.1

838c185ca94881d4b35e3595ead8fbeee1fed13d authored almost 8 years ago by Darshit Shah <[email protected]>
* src/main.c: Remove double 'verbose' option

Fixes: #50290

ac9be9b75658c9350ce058e6268a91db8ba6ecce authored almost 8 years ago by Tim Rühsen <[email protected]>
* NEWS: update

6620c5156f363036079d413bfa567e9d871bb30d authored almost 8 years ago by Tim Rühsen <[email protected]>
isrc/http.c (check_retry_on_http_error): Fix gcc warning

aebd49d9d41a30b5f7fba5acf26d5314cb12f573 authored almost 8 years ago by Tim Rühsen <[email protected]>
Add support for --retry-on-http-error

* doc/wget.text: Add documentation
* src/http.c: Add function check_retry_on_http_error ()
* src...

d6d00006a0c446f91a005d44ab72eb956c58ad2d authored almost 8 years ago by Tom Szilagyi <[email protected]>
Revert "Add support for --retry-on-http-error"

This reverts commit 977276374d1be7f171f5da8633368025c88b9eee.

05acf5d3f6f5c5d84863fc70432d1a350a998b37 authored almost 8 years ago by Tim Rühsen <[email protected]>
Change libtool library deps to non-libtool deps

Reported-by: Yousong Zhou
Fixes: #50260

80c62c238ead621b41cd75dbe1b84612fcd996d0 authored almost 8 years ago by Tim Rühsen <[email protected]>
Add support for --retry-on-http-error

* doc/wget.texi: Add description for --retry-on-http-error
* src/http.c (gethttp):
Consider give...

977276374d1be7f171f5da8633368025c88b9eee authored almost 8 years ago by Tom Szilagyi <[email protected]>
* tests/WgetTests.pm: Add --no-config to wget invocation

Without --no-config, wgetrc commands may disturb the tests.

Reported-by: Dagobert Michelsen

785c4b92dda6fb87f56383dfdc3e8394657574d3 authored almost 8 years ago by Tim Rühsen <[email protected]>
* tests/WgetTests.pm (_verify_download): Fix failure message

Reported-by: Zhiming Wang

d7c34dc0a8fa9c6a68505877e364fd2fffa0908d authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/http.c (initialize_request): Fix regression in .netrc auth

Reported-by: Axel Reinhold

d061e553a184871b383649c1ea8c921c62164905 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/iri.c (idn_encode): Fix memory leak

2ddd2b69e4df346deece27140f62d60fb353ebdd authored almost 8 years ago by Tim Rühsen <[email protected]>
Remove skipping libunistring with --disable-iri

* configure.ac: Remove checking for IRI=no

On certain systems, gnulib falls back to libunistrin...

990f3d67d340d226bbd4187f5d310a4d2bf2bfe4 authored almost 8 years ago by Tim Rühsen <[email protected]>
* bootstrap.conf: Add gnulib module wcwidth

d680b0b5513ea149f44ad1cec4d7fe68662f467f authored almost 8 years ago by Tim Rühsen <[email protected]>
Fix include/define clash with gnulib's unlink module

* src/options.h: Rename options.unlink to options.unlink_requested
* src/init.c: Replace options...

31ac36e170f4777655451fce10a2fa5b2b27ecd7 authored almost 8 years ago by Tim Rühsen <[email protected]>
* bootstrap.conf: Specify unicode modules more exact

51b401f5c4fb408977e91ecbb36e783012f6faea authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/xattr.h: Fix #define fsetxattr for MacOS and FreeBSD

Reported-by: Zhiming Wang

f2c42895570aed8fcb1359b687952be3a1524e82 authored almost 8 years ago by Tim Rühsen <[email protected]>
* cfg.mk: Fix syntax-check

820f3fc2b4e24dc44a43556a772074ef8812051a authored almost 8 years ago by Tim Rühsen <[email protected]>
* contrib/release: New release helper script

58546e52e2e27ae488cd17046bc68f68656dcdda authored almost 8 years ago by Tim Rühsen <[email protected]>
* doc/announcement_1.19.txt: Add new file

cc8464206da3989fe0d5a30f3484238e86502584 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/utils.c: Move macro FMT_MAX_LENGTH into scope

366d82f3499c69395b50bd7d8093fb3bb6d37ae1 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/utils.c: Fix -Wformat= warnings

f2574e90b7faaddd891741053660f7c1ea8c0439 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/gnutls.c: Fix -Wformat= warnings

81b3aaf75c18e835ad86a45bc4fec591a72ffe5f authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/iri.c: Remove unused macro IDNA_FLAGS

17d2f42a3d3b5f65d705b8ad78e649f2f885a73d authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/iri.c: Remove use of __func__ macros

638df404761329a8b2d99767c36a0f011573c334 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/http.c: Fix -Wformat= warnings

00bafe72f1fdd0f04ac41626948ec038cbd3da41 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/progress.c: Remove unused macro move_to_end

e777c01f439a7367cede010ff2e07a9711b07892 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/html-parse.c: Remove unused macro SKIP_NON_WS

3ba112ea5712874f7ef7d2906b39463417181e8f authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/hsts.c: Remove unused macro CHECK_EXPLICIT_PORT

485fcfcc202d7948968b765c9f523d7a305b2e07 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/hsts.c: Fix -Wformat= warnings

a5094731cdc248d3240aab6305411e65262d879d authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/hash.c: Explicitly convert float to int

3186eb297661399d641a3b718e178394dd86ff78 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/ftp-ls.c: Fix -Wformat= warnings

9947663af82f4e5c7038a1f1954c5697c50b56e7 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/ftp.c (ftp_retrieve_list): Add default to switch

cfae085665b3a6b0c21a304d07d277231b861fef authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/css-url.h: Remove redundant declaration

e69808256bf958dc6c8e2637ca1ae7623421023f authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/ftp.c: Fix -Wformat= warning

11989ef6696bca1dbb835f2529727609888cb121 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/http.c (test_parse_range_header): Fix constants

5fceab6cb97cd63dd0d0c568baf95b95fdf8b9fa authored almost 8 years ago by Tim Rühsen <[email protected]>
Improve documentation of --trust-server-names.

d6eead1794c77adc879cfe7c2aaadd7b77c96e5b authored almost 8 years ago by Dale R. Worley <[email protected]>
* src/url.c (mkalldirs): Add newline to log message

d0e02a54aedf077b27e930bec4d5abc3fb565a3c authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/cookies.c (check_domain_match): Add newline to DEBUG lines

2e70409844a35b0c5c76579ea590a3ed708c9f67 authored almost 8 years ago by Tim Rühsen <[email protected]>
* NEWS: update

4734e8d4d7bc0f488974187839d01862b2a0029e authored almost 8 years ago by Tim Rühsen <[email protected]>
* README.checkout: Link HTTPS where possible, update flex homepage

0fe8a5c40e70ee377bbbe235002f9a287f830331 authored almost 8 years ago by Tim Rühsen <[email protected]>
* README.checkout: Fix libidn to libidn2

1b9374ee59cf6f7b2953242445dfc2c9af789bc3 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/iri.c: Use TR46 non-transitional for toASCII conversion

6de24fe3c089181c8a6f7f436269dbc7e49d01ce authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/main.c: Fix _Noreturn compiler warnings

0ab3d92c85959ba645e272f065297133d1beee6b authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/utils.c: Fix _Noreturn compiler warning

4cf8af84e055bc457c6513a516187922d8c550d5 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/init.c (setval_internal): Fix sign compare warning

42b8761cbc00043f03f1bd03bb09ef0e54bc6547 authored almost 8 years ago by Tim Rühsen <[email protected]>
Replace home-grown portability code by gnulib modules

* bootstrap.conf: Add intprops, inttypes, limits-h, signal-h,
stat, sys_types
* src/ftp.c: Rep...

fd0f7595971992ccfa40fb437b95d5de636d3c5a authored almost 8 years ago by Tim Rühsen <[email protected]>
Replace WGET_* m4 macros by gnulib modules

* bootstrap.conf: Add hostent, inet_ntop, nanosleep, utimens
* configure.ac: Remove WGET_STRUCT_...

a384f5e2e9afd11e363d011b474c2e5da5573103 authored almost 8 years ago by Tim Rühsen <[email protected]>
Remove libidn vulnerability work-around

* src/iri.c (_utf8_is_valid): Removed

Since we are using libidn2 for IDNs, we no longer need
th...

5ae1f3790286ececf124accea20c9eee05218203 authored almost 8 years ago by Tim Rühsen <[email protected]>
* src/iri.c (idn_encode): Use TR46 transitional if available

0eb4a21b6ce38cc94c47a1dd2671eb6a303d3c94 authored almost 8 years ago by Tim Rühsen <[email protected]>
* gnulibx: Update

60dc3c21b2203e34680c870f4a971667e90cf3b7 authored almost 8 years ago by Tim Rühsen <[email protected]>
Fix previous commit 2427ca4ac090dc6cc0c527f4ac4fc5a4bd468eb1

1a01a6b2d0a572b316fa8683614feb5ad723b38d authored about 8 years ago by Tim Rühsen <[email protected]>
Fix http.c and ftp.c passwd logic error

* src/ftp.c (getftp): Fix password/user selection
* src/http.c (initialize_request): Likewise

B...

2427ca4ac090dc6cc0c527f4ac4fc5a4bd468eb1 authored about 8 years ago by vijeth-aradhya <[email protected]>
* src/main.c (main): Add missing \n in error message

42c2ce71bcbcd07a3aff908a3a5b41a875b571a5 authored about 8 years ago by Giuseppe Scrivano <[email protected]>
Check that fd_set has not fds bigger than FD_SETSIZE

* src/connect.c: check that the fd is not bigger than FD_SETSIZE
before using FD_SET. An fd_s...

def133f26fec9ef1937f16ac02ef3641e07a4bef authored about 8 years ago by Giuseppe Scrivano <[email protected]>
Avoid calling the gnutls priority functions multiple times

* src/gnutls.c (ssl_connect_wget): Call gnutls_set_default_priority()
for --secure-protocol=au...

b9ed06afd84ddb5038f82e3645c23ac53e798953 authored about 8 years ago by Nikos Mavrogiannopoulos <[email protected]>
Print debug message when skipping certain recursive downloads

* src/recur.c (retrieve_tree): Print debug message instead silently
skipping recursive downloads.

1bdc20d774a677037a058684b762c5ce04e1102c authored about 8 years ago by Tim Rühsen <[email protected]>
Rename base64_{encode,decode} (trivial patch)

* src/http-ntlm.c: Rename base64_{encode,decode}
* src/http.c: Likewise
* src/utils.c: Likewise
...

e4e9d3c1c801190b5c8232284b26d170924b1696 authored about 8 years ago by Rahul Bedarkar <[email protected]>
Add support for psl_latest()

* configure.ac: Add check for psl_latest(),
remove --with-psl-file
* src/cookies.c (check_doma...

dcdd618b1861dd7a67480b943514b33b4626f209 authored about 8 years ago by Tim Rühsen <[email protected]>
Respect -o parameter again

* log.c: don't choose log output dynamically when opt.lfilename is set

Regression introduced ...

3c796b9a852bc9e5bc089ab80afb3b840dd83395 authored about 8 years ago by Piotr Wajda <[email protected]>
Move Wget from IDN2003 (libidn) to IDN2008 (libidn2)

* .travis.yml: Install libidn2-dev instead libidn11-dev.
* bootstrap.conf: Add modules libunistr...

00ae9b4ee2caa6640776e9777e7ef5a374d082c0 authored about 8 years ago by Tim Rühsen <[email protected]>
Use -O0 in contrib scripts

* contrib/check-hard: Use -O0 instead of -O2 to speed up script.
* contrib/travis-ci: Likewise.

2242d5aee4961a48a2cc79c0a5a40e302514994a authored about 8 years ago by Tim Rühsen <[email protected]>
Update gnulib

77a546348c951e4ef340ddb9a46e984dd94dba95 authored about 8 years ago by Tim Rühsen <[email protected]>
* src/metalink.c: Fix typo 'suceeded' -> 'succeeded'

Reported-by: Göran Uddeborg <[email protected]>,
Anders Jonsson <anders.jonsson@no...

be5517f98fc1f35299cd1a4849a632438c7732e1 authored about 8 years ago by Tim Rühsen <[email protected]>
Fixes #45790: wget prints it's progress even when background

* src/log.c: Use tcgetpgrp(STDIN_FILENO) != getpgrp() to determine when to print to STD* or logf...

dd5c549f6af8e1143e1a6ef66725eea4bcd9ad50 authored about 8 years ago by losgrandes <[email protected]>
Fixes #46584: wget --spider always returns zero exit status

* src/ftp.c: Return error as exit value if even one file doesn't exist

78e0ec5f0389f09fe81546235724933e6a37ba6e authored about 8 years ago by losgrandes <[email protected]>
* src/http.c (gethttp): Accept 206 for request w/o Range header

Fixes: #49319

807d1c7d9471123fb660fe301f0ede0a09257da6 authored about 8 years ago by Tim Rühsen <[email protected]>
* tests/Makefile.am: Let WGETRC work on *nix and Windows

3d1d5b317b31994b7219bc9650502fac181512c7 authored over 8 years ago by Tim Rühsen <[email protected]>
Properly include iconv.h

* src/iri.c: Check HAVE_ICONV to include iconv.h
* src/url.c: Same

517d799b6f94e60e302806a2daa14c7a4ac3fbbd authored over 8 years ago by Tim Rühsen <[email protected]>
* bootstrap.conf: Add pipe-posix for pipe()

f79bb20f1ba374894b4e0b850ebe97860f8dabaa authored over 8 years ago by Tim Rühsen <[email protected]>
Amend redirection behavior

* src/recur.c (descend_redirect): Ignore WG_RR_LIST and WG_RR_REGEX
for redirections.
* testen...

e5164a8260139a3bb64308350e16b37e454d942a authored over 8 years ago by Tim Rühsen <[email protected]>
New: --trust-server-names saves Metalink/HTTP xml files using the "name" field

* src/metalink.c (retrieve_from_metalink): If opt.trustservernames is
true, use the basename o...

c89767d8d1df297dc01261efdd24b5220bc9760d authored over 8 years ago by Matthew White <[email protected]>
New: Metalink/XML v3 python class, update tests to use this class

* testenv/misc/metalinkv3_xml.py: New Metalink/XML v3 python class
* testenv/Test-metalink-xml-a...

a35f3dd4f6b0fc2b507c090ab7a8df7bb92d7edd authored over 8 years ago by Matthew White <[email protected]>
Bugfix: Prevent sorting when there are less than two elements

* src/utils.c (stable_sort): Add condition nmemb > 1, sort only when
there is more than one el...

acb1d1a668b2167b6761d751363cfadd258d87dc authored over 8 years ago by Matthew White <[email protected]>
New: --metalink-over-http Content-Type/Disposition Metalink/XML processing

* src/http.c (metalink_from_http): Process the Content-Type header.
Add an application/metalin...

c403e67935677d2f32d18968a8afc6c98616b354 authored over 8 years ago by Matthew White <[email protected]>
Bugfix: Set NULL variable due to --content-disposition to Metalink origin

* src/http.c (http_loop): Prevent SIGSEGV when hstat.local_file is
NULL, opt.content_dispositi...

3021466817f55139659feb7631f15f2ece19e4d5 authored over 8 years ago by Matthew White <[email protected]>
New option --metalink-index to process Metalink application/metalink4+xml

* NEWS: Mention the effect of --metalink-index over Metalink
* src/init.c: Add new option metali...

0538e791fb5ded49775e3ffb67001108d4e27b0e authored over 8 years ago by Matthew White <[email protected]>
Bugfix: Detect malformed base64 Metalink/HTTP Digest header

* src/http.c (metalink_from_http): Fix hash_bin_len type. Use ssize_t
instead than size_t. Rej...

5dccb2a9ce69a5ab2fb7e9db62ca10e62339ce65 authored over 8 years ago by Matthew White <[email protected]>