Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/WebArchiver

Decentralized web archiving
https://github.com/ArchiveTeam/WebArchiver

Merge pull request #4 from uzerus/master

Update README.rst

c2144a498764de6f086fc2fca3c653b6c4adcf57 authored over 6 years ago by Arkiver2 <[email protected]>
Update README.rst

b2eaebf4f48e001cd88176d9aa6f14ded9cf71b4 authored over 6 years ago by Uzerus <[email protected]>
Improve README for --dashboard-port.

6611a07156a0155486b3de3dfc2513b6834bea4d authored over 6 years ago by Arkiver2 <[email protected]>
Add job settings information to dashboard.

91f7daeb6a716229bd3ad3cbd53b24d3a06625e0 authored over 6 years ago by Arkiver2 <[email protected]>
Add host, port information to main page dashboard.

e0178ce1ec88d4fe62cf5d35f84f8bcb34a5709e authored over 6 years ago by Arkiver2 <[email protected]>
Bind dashboard to 0.0.0.0.

d345faf9c41f2eac0ca6cfb05d6ed3f165a74785 authored over 6 years ago by Arkiver2 <[email protected]>
Base of dashboard.

de03f9b8b0dec750e2ee5da1c7de6afa050c82f4 authored over 6 years ago by Arkiver2 <[email protected]>
For random port use number between 50000 and 60000.

f1d4a140e69a5d437ae241a10063520a6cbfbca1 authored over 6 years ago by Arkiver2 <[email protected]>
Remove wget-lua related files.

61a5e1e97aaaff344e6c8cf554cdbf47746ed889 authored over 6 years ago by Arkiver2 <[email protected]>
Extract URLs not using wget-lua. Use wget instead of wget-lua. Fix WARC-Target-URI in <...>. Add version command line option.

eef75584d251ed2e230f4476c687659b559bf687 authored over 6 years ago by Arkiver2 <[email protected]>
Add check if job is finished on server.

3e9dd894bbd7e901a0ff2a49a272af641b033258 authored over 6 years ago by Arkiver2 <[email protected]>
Add tests for stager server creation and connection.

c9b9ea2df425ec9a5f482c257c799de2f9d7d8bf authored over 6 years ago by Arkiver2 <[email protected]>
Add tests for utils.py.

21192c5197de110ddc9be3003708b312da1e2ce3 authored over 6 years ago by Arkiver2 <[email protected]>
Don't edit original set when splitting set into smaller sets.

449d0e2a1836c0f0f980b7dfb50bbbc21547bcd3 authored over 6 years ago by Arkiver2 <[email protected]>
Add docstring for shutdown.

563d8f8113162d3d14231c32c0be13af165ff6cd authored over 6 years ago by Arkiver2 <[email protected]>
Compress logs at shutdown.

e8a28641b22206ef328ec99384d8f551ee9abb66 authored over 6 years ago by Arkiver2 <[email protected]>
Move check for existing WARC file to deduplicate instead of __init__.

45ba9fbdd24a35bcd49c22bd6db4744efc4184ff authored over 6 years ago by Arkiver2 <[email protected]>
Fix variable names.

70f134fb133ff6b92881043184b4b68b03765e87 authored over 6 years ago by Arkiver2 <[email protected]>
Fix variable name.

4a1f54bd2c1d3893cf7dcd24d6b9f59d5d66cbcf authored over 6 years ago by Arkiver2 <[email protected]>
Fix syntax.

601c66468d799e083e2454f38c160fceb526006e authored over 6 years ago by Arkiver2 <[email protected]>
Add logging.

78ae00c5dd8f57841b9e9d08fd948ea11cc8eb43 authored over 6 years ago by Arkiver2 <[email protected]>
Support shutting down logging.

e8a112d060953d9b91039301da9e208bfa5e6104 authored over 6 years ago by Arkiver2 <[email protected]>
Fix __repr__ string format.

6b358a33a2a72e477f6dcb5d5d32c03ec4f815bb authored over 6 years ago by Arkiver2 <[email protected]>
Implement __hash__ and __repr__ functions.

37fe90f2e387c5e91a8cc7d91318876b4e7a2e5c authored over 6 years ago by Arkiver2 <[email protected]>
Log thread name. Simplify stream handler log.

2b80f43f2123911034e52ab5de7ecbad31ce2346 authored over 6 years ago by Arkiver2 <[email protected]>
Set log gilename to date only.

912bdd100829539373070a8378a42792e6c5c93f authored over 6 years ago by Arkiver2 <[email protected]>
Fix logger. Set DEBUG for stream and INFO for file log handlers.

5feb09d6e9236ac99b788a2ef497af64167ed168 authored over 6 years ago by Arkiver2 <[email protected]>
Fix docstring webarchiver.check

f6f0c9f8cce4ec795e92a3d31913c8713639a2c2 authored over 6 years ago by Arkiver2 <[email protected]>
Add log base. Move WebArchiver start to __init__.py.

3e6aaa86a96c44edb4c1170b06232f483c11dc67 authored over 6 years ago by Arkiver2 <[email protected]>
Add docstrings. Move README.md to README.rst.

370006eef29e8a1aaad2ed7a2e24845f42d08ee5 authored over 6 years ago by Arkiver2 <[email protected]>
Fix test. Add tests for multiple URLs and split test for existing and not existing URLs.

8778243bd383c922eb3aef0166432f95ef7c9b4b authored over 6 years ago by Arkiver2 <[email protected]>
Add clean method

4069c6751fe5c739c457ea332b2c7348d3fe7a8e authored over 6 years ago by Arkiver2 <[email protected]>
Fix handling bad extacted URLs

4f73deed082b96fe0943a3e94ea6155fd59b055d authored over 6 years ago by Arkiver2 <[email protected]>
Rename config job to and add

d0fa52663d16f101ec7e1a98e2614ec93c21e6bb authored over 6 years ago by Arkiver2 <[email protected]>
Support HREF links

c937a0ab069c196518b1322842833696cab86641 authored over 6 years ago by Arkiver2 <[email protected]>
Fixes in UrlConfig handling

708459eb41e6dda00a903e697cc38221710ad90e authored over 6 years ago by Arkiver2 <[email protected]>
Add check for wget-lua

24fe396cdb6ab056052ade7e7ccc3a14439efd35 authored over 6 years ago by Arkiver2 <[email protected]>
Create UrlConfig class. Ignore wget-lua executable. Support depth of job.

f5aed5779e6c188951dadd756d2071d9a1cb70e7 authored over 6 years ago by Arkiver2 <[email protected]>
Add instructions to build wget-lua

fbfd238885baed51ba47afe557a00222faadea1a authored over 6 years ago by Arkiver2 <[email protected]>
Typo fixes

17d255fd4af1a34ae913d2f1e79cccd1bff49eed authored over 6 years ago by Arkiver2 <[email protected]>
Support regex for discovered URLs

ace694683253d388b1fcb14bfbbe507e2a00e901 authored over 6 years ago by Arkiver2 <[email protected]>
Support using rate from settings

61377d5878eca55877d91ff32e9160698f0e48db authored over 6 years ago by Arkiver2 <[email protected]>
Update README with instruction to add a job

36a3cbc15b927108d5a9c7ce0391b0f2a6c6d323 authored over 6 years ago by Arkiver2 <[email protected]>
Remove .db files

7b2439496eb7ffcb74eded85d0db464d592470bf authored over 6 years ago by Arkiver2 <[email protected]>
Support discovery and using of job settings file

d6bbbabae91a5161535fe8c5fa3b80af8f359af8 authored over 6 years ago by Arkiver2 <[email protected]>
Add random string to job settings file. Do not rename original .cfg input file after conversion

a66a2a09e8a3cbf928d1ec35d5fa65332beff6a5 authored over 6 years ago by Arkiver2 <[email protected]>
Add .db extension to database file

44488b62b2b88067c3fc0e2c5cf769bbcb2bc6f9 authored over 6 years ago by Arkiver2 <[email protected]>
Make creation of pkl file more secure

8800de6fffc94734731261430c23fc7c6275b814 authored over 6 years ago by Arkiver2 <[email protected]>
Add script to create new job

b4bfcac7ca674bb5a441fd7b0e45608a189755af authored over 6 years ago by Arkiver2 <[email protected]>
Fix serializing Node instead of listener

b3bb6f4303c74b4460c613fa140776ae83bd310e authored over 6 years ago by Arkiver2 <[email protected]>
Update README

6e7235b6055d28ad3bb35a4619f8a2267596225e authored over 6 years ago by Arkiver2 <[email protected]>
Rename module archiver to webarchiver

f5cfd4345ef5e3f6989761c489796caa697e0054 authored over 6 years ago by Arkiver2 <[email protected]>
Lock set difference update

087f571c9c87700b6b8874c7b9a37d8cc116f6bf authored over 6 years ago by Arkiver2 <[email protected]>
Support choosing host and port. Update README.

2c546375c04ddbd70acdf4d679ab8e4a46761422 authored over 6 years ago by Arkiver2 <[email protected]>
Improve support for received data

e8a9c968e2d1c5a8c3af00ab5d5f99250a570b0a authored over 6 years ago by Arkiver2 <[email protected]>
Replace base64 message encoding with pickle

3f5b8a3d94d6e9e3f6e3b30c1b985c78bcfbf7b4 authored over 6 years ago by Arkiver2 <[email protected]>
Fix renaming STAGING to STAGER

2a8de1d1148022fd5063bd61b5e28c129ecdb92b authored over 6 years ago by Arkiver2 <[email protected]>
Fix renaming STAGING to STAGER

d1f0f2b6fe3cc56338c59f3bbb94006271e5638c authored over 6 years ago by Arkiver2 <[email protected]>
Fix staging to stager in README

df5393ebcff83666b9176b900600eee4e22c7d6e authored over 6 years ago by Arkiver2 <[email protected]>
Rename staging to stager

766f50a338f7a5e491f61ffb407a99d86131878b authored over 6 years ago by Arkiver2 <[email protected]>
Fix binding to 0.0.0.0. Fix getfqdn instead of gethostname

a6f4615e32cf12121eb52317e248d60a8ba95f64 authored over 6 years ago by Arkiver2 <[email protected]>
Fix WebArchiver name in README

ad8b915ab1ebe2b5639b268f725d8f266637c6fb authored over 6 years ago by Arkiver2 <[email protected]>
Fix README format

61a3025d54a01418d072352124a4ad1c45108b50 authored over 6 years ago by Arkiver2 <[email protected]>
initial

778d4f899a77a3ee6f0d4aa98c11ca1a6420e8f7 authored over 6 years ago by Arkiver2 <[email protected]>