github.com/ArchiveTeam/NewsGrabber-Warrior commits

Bump version

731f17685d3e7ca700a0c3413854a33edfda271c authored over 6 years ago by kurtmclester <[email protected]>

Merge pull request #13 from JustAnotherArchivist/master

Find Python 2 dynamically

0c2d93f1fd6d9b49e60da6fb93cdd5ba49ad1677 authored over 6 years ago by kurtmclester <[email protected]>

Find Python 2 dynamically

Modern and up-to-date systems (e.g. Gentoo, Arch) have Python 3 as the default version, i.e. cal...

05cf2567d3f8622f0b1071ee42adf21b032c7ba7 authored over 6 years ago by JustAnotherArchivist <[email protected]>

Roll back to python (from python2)

0ae57924b6c97b77c55b343760c2b6ee125fa21b authored over 6 years ago by kurtmclester <[email protected]>

[Untested] Merge pull request #11 from JustAnotherArchivist/master

Explicitly call Python 2 for deduplication to prevent breakage on systems that use Python 3 by d...

7f1683aea04b88a3322a6e486147781b98abc908 authored over 6 years ago by kurtmclester <[email protected]>

Explicitly call Python 2 for deduplication to prevent breakage on systems that use Python 3 by default

23556764fa33a5725d6bf7339e979458e9928d35 authored over 6 years ago by JustAnotherArchivist <[email protected]>

Merge pull request #10 from JustAnotherArchivist/master

Find the youtube-dl executable regardless of where it's located

a6b017d8c80921780f35151a8aac6fc3782a26bf authored over 6 years ago by kurtmclester <[email protected]>

Remove youtube-dl symlink code

77b0ea6025930e87dba8631819b7810cb993d270 authored over 6 years ago by JustAnotherArchivist <[email protected]>

Find the youtube-dl executable regardless of where it's located

9b4083b057fc42ca52ce4cfa68c13a846f12f6a8 authored over 6 years ago by JustAnotherArchivist <[email protected]>

Use brain v2

34e3e92bfeb5863e8ba9e88ac4f6e98e15b36728 authored over 6 years ago by kurtmclester <[email protected]>

Fix that symlink, stop making live code changes

b717c9b8962423e0daeac7237ebdd1bf6db8e242 authored over 6 years ago by kurtmclester <[email protected]>

.

c93ce275ea016f845107598075e979915cd3d40d authored over 6 years ago by kurtmclester <[email protected]>

Attempt to use brain before creating symlink

f0643d90a2d3ecef3d193d9cf6cab872e7217656 authored over 6 years ago by kurtmclester <[email protected]>

Fix youtube-dl symlink

59c2ace813148aa7041e5b9ecf017b19afd197ea authored over 6 years ago by kurtmclester <[email protected]>

Python2 -> python, should fix dedupe not running

Dedupe not running on warriors (v2)

f4d6eee95e8bb6a047b2d481146b31cc720ecac2 authored over 6 years ago by kurtmclester <[email protected]>

Merge pull request #8 from HarryC145/patch-3

Update pipeline.py

3ef5d42d5a0e3d0da662db7bb768b70ece1abc44 authored over 6 years ago by kurtmclester <[email protected]>

Update pipeline.py

reduce timeout

b54f063d6443bc2e0755131d2bce0910eaaa3260 authored over 6 years ago by HarryC145 <[email protected]>

Merge pull request #7 from jcj83429/spotless

block launcher.spot.im infinite loop

f117d59031ed3d587e0121d3e6ca19152639ba04 authored almost 7 years ago by kurtmclester <[email protected]>

bump version number

0a91c8e7839b4aa16b9f6c7772de48f38567f93d authored almost 7 years ago by jcj83429 <[email protected]>

block launcher.spot.im infinite loop

add the exclude pattern suggested by Kaz

2d78a3a71a4143552ed4b562ea6cd53cdfaf0ecb authored almost 7 years ago by jcj83429 <[email protected]>

Final version bump. Warriors now working correctly.

d6f3e16cdc1ed363c2088e1bb1ed52a9b684e4bd authored almost 7 years ago by kurtmclester <[email protected]>

Remove that

49805dbe06997f6402ce5017fd356c2f75e394b4 authored almost 7 years ago by kurtmclester <[email protected]>

One day we'll learn to increment version numbers

4e19282e3ad5598fdac5ea4a8362d7f09c53ae72 authored almost 7 years ago by kurtmclester <[email protected]>

More updates and that

e1f26cc08253f05f4ab08e147a09a04bd0b7e6b8 authored almost 7 years ago by kurtmclester <[email protected]>

Igloo still can't update version

7bf0f8b40ba29443cf23eecefab782980012685e authored almost 7 years ago by kurtmclester <[email protected]>

Merge pull request #6 from Iggersm00/patch-3

Fix pip upgrade mistake

ab02be7d36e2078e31cde4c16c395972c0384abc authored almost 7 years ago by kurtmclester <[email protected]>

Fix pip upgrade mistake

PICNIC

34e744c7b02e1241ae9d9371997bea57a73927de authored almost 7 years ago by Iggersm00 <[email protected]>

Bump version

9466e6bad2fbe5144c35a08200e40f4a6d627bc6 authored almost 7 years ago by kurtmclester <[email protected]>

Merge pull request #5 from Iggersm00/patch-2

Implement youtube-dl fix & pip upgrade

3e8a12ba7459038c2075bc0580b71ed39d55ba64 authored almost 7 years ago by kurtmclester <[email protected]>

Implement youtube-dl fix & pip upgrade

24c43a7b6c898418d039fef0ba991414303c78dc authored almost 7 years ago by Iggersm00 <[email protected]>

Merge pull request #3 from jcj83429/extproc-dedupe

move dedupe to a separate script and run it with ExternalProcess

a39131d706f6e395b1d50d809e3e20b84d35a76e authored almost 7 years ago by kurtmclester <[email protected]>

move dedupe to a separate script and run with ExternalProcess

This way dedupe won't stall the wpull download and rsync upload,
and multiple items can be dedup...

51c1b822937f200755ace841cd8582718c42533a authored almost 7 years ago by jcj83429 <[email protected]>

Merge pull request #2 from HarryC145/patch-2

forgot to update

1dde1a0890673a24034d8df341f9aa75b5d55956 authored almost 7 years ago by Arkiver2 <[email protected]>

forgot to update

786ea6df5dc6a501cfef9cf8cec257e1fed86b1b authored almost 7 years ago by HarryC145 <[email protected]>

Merge pull request #1 from HarryC145/patch-1

move dedupe to via cdn

f72c7ad3e124fd8ddb3373e9fde6143a7eab20a0 authored almost 7 years ago by Arkiver2 <[email protected]>

move dedupe to via cdn

4a0fd514c6c1ea0b2bba4c01250d942f49ed27ca authored almost 7 years ago by HarryC145 <[email protected]>

Fix opening files for python2.6

Bump version to 20170826.01

31b29fc0ba61a05b081c06852d9ae9413421cab5 authored about 7 years ago by Arkiver2 <[email protected]>

Use port 3000 for deduplication server

Bump version to 20170824.03

b03144d0a3f7e2e96d21ebf05da0ad6eab49d3f8 authored about 7 years ago by Arkiver2 <[email protected]>

Fix loop, bump version to 20170824.02

88a8aae68f117fe63cdd8673567e28349da7ac6c authored about 7 years ago by Arkiver2 <[email protected]>

Merge branch 'master' of https://github.com/ArchiveTeam/NewsGrabber-Warrior

f52fa687b2859cdd7f25a0417e528f6a4264741c authored about 7 years ago by Arkiver2 <[email protected]>

Change deduplication server

Bump version to 20170824.01

03b1e1d41632e71787bc730884b322f2c681b660 authored about 7 years ago by Arkiver2 <[email protected]>

Fix setup instructions.

9c6c1d49f990ff53b2953b3f8b8954b62fd2a499 authored over 7 years ago by Arkiver2 <[email protected]>

Switch to internal deduplication.

Bump version to 20170713.01.

61ac01ace8c170160a308b0c72ed64a88435ddb4 authored over 7 years ago by Arkiver2 <[email protected]>

Deduplicate through caching server.

Bump version to 20170623.01.

8dcd2b67c16169d38265994961399273f0f6d8cc authored over 7 years ago by Arkiver2 <[email protected]>

Install youtube-dl.

Bump version to 20170618.02.

272d6b1806786f3567ae274eee4a040c674f04cc authored over 7 years ago by Arkiver2 <[email protected]>

Update deduplication.

Bump version to 20170618.01.

96bb9d80131a969f95fecc2cb8c769a918fe5a7f authored over 7 years ago by Arkiver2 <[email protected]>

Add deduplication.

Bump version to 20170617.01.

e61b44ad1651e1b29b1e40d96f623359bf5cc471 authored over 7 years ago by Arkiver2 <[email protected]>

set as executable file

a5f6c2295155d725ec7ae1f4a642a737e53f0716 authored over 7 years ago by Arkiver2 <[email protected]>

Fix wpull unrecognized arguments error.

Bump version to 20170415.02.

fd68ff35d8f66d93c3fe78abf0cc523c70387c1d authored over 7 years ago by Arkiver2 <[email protected]>

Update URLslist URL. Bump version to 20170415.01.

6474ae5cdb1e3adbc8a8c536cac8c3f2f1166789 authored over 7 years ago by Arkiver2 <[email protected]>

initial

cc94901ba591371b90f05c47f63ea8e1689728ee authored over 7 years ago by Arkiver2 <[email protected]>

Ecosyste.ms: OpenCollective

github.com/ArchiveTeam/NewsGrabber-Warrior