Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/tinyback

A tiny web scraper
https://github.com/ArchiveTeam/tinyback

Change tracker to http://tracker.terrywri.st/

12d8610b6cbfb49ba4ce060834a14755e255ffcf authored over 11 years ago by Terry Wrist <[email protected]>
Bump version number to 2.12

15807ff40ff060271f7ec3e8b1192c3a5a7167bd authored over 11 years ago by David Triendl <[email protected]>
service.BaseVisibliService: Add some doc. Change rate.

Add some documentaton and change the rate in case someone decides to
grab visibli/sharedby.

621627f414388007cf079a29a609b8aed8523859 authored over 11 years ago by Christopher Foo <[email protected]>
Add documentation for tinyback.generators

f351c87b93de026243c18c4f61e04e176733d1a1 authored over 11 years ago by David Triendl <[email protected]>
services.Bitly: Fix STOP page parsing

Bitly switched to using the domain from the request (in tinyback's case bit.ly)
instead of alway...

f3b4ca28b50e844845b53c99e3083a14b069e316 authored over 11 years ago by David Triendl <[email protected]>
services.Postly: No more Mr. Nice Guy

9129f321f7f9032d8183015bde42f99a71976999 authored over 11 years ago by David Triendl <[email protected]>
Merge remote-tracking branch 'chfoo/master'

a3f5450a8524a036e5fb6667a995c60d3cf0a925 authored over 11 years ago by Christopher Foo <[email protected]>
services.BaseVisibliService: Adds case for possible iframe buster 302 urls

c42b987fb1f8c8e5cb41073294fa88b1f83cbe0d authored over 11 years ago by Christopher Foo <[email protected]>
Merge branch 'pull/9'

4c25aba404b31e477a0d0e4e7889bfd190147241 authored over 11 years ago by David Triendl <[email protected]>
services.BaseVisibliService: Detect problems with user-agent

6076ba828f29fd72a41c9878346951371d101b70 authored over 11 years ago by Christopher Foo <[email protected]>
Bump version to 2.11

ffe5f6b4351e8b3305ac20a53bab2a1c02e83760 authored over 11 years ago by David Triendl <[email protected]>
generators: Add "list" generator

The list generator takes exactly one argument: A list of shortcodes, stored
with the key "list".

f9292456b35f7713119f55ea81a58ab05e821648 authored over 11 years ago by David Triendl <[email protected]>
services.BaseVisibliService: Changes re pattern to accept any iframe id.

5ef6282e7a61267e167244738a73c4d98f6917ed authored over 11 years ago by Christopher Foo <[email protected]>
Bump verison number to 2.10

7de5614e4441b3cbd91a08e03122d648aa5fa683 authored almost 12 years ago by David Triendl <[email protected]>
services.YourlsService: Switch from "json" to "simple" format

Saves a whole lot of hassle with parsing JSON, encodings, etc.

bb65539c0b9cf9a9a74b792d45c0145eed90d2ee authored almost 12 years ago by David Triendl <[email protected]>
services.Vbly/Arsehat: Fix yourls_url_convert parameter

b24aed4e7532782c6a40fbdead9ab953ca91faeb authored almost 12 years ago by David Triendl <[email protected]>
Bump verison number to 2.9

1a28657723b0cca4e76a92d032e61c45535ee8d4 authored almost 12 years ago by Christopher Foo <[email protected]>
Adds specialized stream handler for progress support ( soult/tinyback#3 ).

d40be94dab2110e89cd728ad837f52ba1691d24a authored almost 12 years ago by Christopher Foo <[email protected]>
Basic support for soult/tinyback#3 "Add progess bar/output of status".

13ece7e4f58cc790ba9bf7e75c085382aefe28ee authored almost 12 years ago by Christopher Foo <[email protected]>
Bump verison number to 2.8

6da03588ce86237e4eb01898d335fe104f4c0543 authored almost 12 years ago by David Triendl <[email protected]>
Merge branch 'yourls'

Conflicts:
tinyback/services.py

6ba63bd376a75a6e84d6d97daad56c3be62bed29 authored almost 12 years ago by David Triendl <[email protected]>
services.BaseVisibliService: Use unexpected_http_status mechanism to handle iframes

b68ca9e8f2d7ddd265823ec0f7e39a2174c91d82 authored almost 12 years ago by David Triendl <[email protected]>
Merge pull request #8

8744e29ab0b7cb8d58f532e51fcc887960173b43 authored almost 12 years ago by David Triendl <[email protected]>
Adds Visibli/SharedBy.

services.py: Uses a dict instead of long if case.

0b4e37c9de4ecfd019c70e3d60ed015555883ca2 authored almost 12 years ago by Christopher Foo <[email protected]>
services: Add Arsehat (http://arseh.at)

98948b030f291665f81884e71d7858d6eef4f221 authored almost 12 years ago by David Triendl <[email protected]>
services: Add Vbly (http://vbly.us)

6379705af277d7812a4645252616eb27e9728ea4 authored almost 12 years ago by David Triendl <[email protected]>
services: Add YourlsService for Yourls-based URL shorteners

167fbdb8b02451b98cc7abd5389c6df5111553e1 authored almost 12 years ago by David Triendl <[email protected]>
services.Postly: Use non-ssl connection and rate-limiting

- Use non-ssl connection for Postly
- Add http_headers property to HTTPService to make setting t...

c4ae57093903b35c67e356f4b04abeb86a8384e3 authored almost 12 years ago by David Triendl <[email protected]>
services.Postly: Send user-agent

32e8245f930055fbd672e2ca8658791b2acbbdbd authored almost 12 years ago by David Triendl <[email protected]>
services.HTTPService: Add http_keepalive property

Try to use HTTP Keep-Alive when possible, which can be disabled by setting the
http_keepalive pr...

365bb422950f3da30cf077b556a356228d06561a authored almost 12 years ago by David Triendl <[email protected]>
services.Postly: Treat connection timeout as being blocked

5d5cd181760ab4c327eb632f93b3cc8c5f59a99b authored almost 12 years ago by David Triendl <[email protected]>
run_tests: Remove debug statement accidentally included in last commit

32de98d881d06cc87e99db3f8df3f0768318b21a authored almost 12 years ago by David Triendl <[email protected]>
services.Isgd: Treat empty URL on preview pages as "blocked"

771d39eca603b1f7eb967e091eb21389935b5024 authored almost 12 years ago by David Triendl <[email protected]>
run.py: Delay of 1 second between each thread

When starting multiple threads, pause 1 second before starting each thread.

5954feb2577b0b727c5dd62fa59d0bc8b8955ab1 authored almost 12 years ago by David Triendl <[email protected]>
No ratelimit for post.ly

04c6c3495d08a3dfef01a11fe23c41b09458515a authored almost 12 years ago by David Triendl <[email protected]>
Bump version number to 2.7

5c21b264a71be25b64b30376a76a433c257e85c6 authored almost 12 years ago by David Triendl <[email protected]>
Add SSL support and use it for post.ly

025b81a1ca67c86e2da62a0a7f96d6f4cfce86c4 authored almost 12 years ago by David Triendl <[email protected]>
services: typofix

b79c41e39764cecd21c461e0804928d10e5d523a authored almost 12 years ago by David Triendl <[email protected]>
Adding Wp.me service

f44a063284c0e513560f350eb5848540c56cefa0 authored almost 12 years ago by Erik Simmesgård <[email protected]>
Bump version to 2.6

1b014bf6ba5407bd40d28b0c1f3e9f6ba3cc7e14 authored almost 12 years ago by David Triendl <[email protected]>
services: Add "Postly"

732268788645329256070fe9808b393052db2c60 authored almost 12 years ago by David Triendl <[email protected]>
Set default sleep time to 300 seconds / 5 minutes

48a7ce565dbdb7267ab554a7e386156ad06a5f97 authored almost 12 years ago by David Triendl <[email protected]>
Bump version to 2.5

662541c1e640b766c448d807654649ed705b1330 authored almost 12 years ago by David Triendl <[email protected]>
Update list of shorteners and copyright

5b8b1a3ff814c9dda992b9c8324a9e7fb64e0fa2 authored almost 12 years ago by David Triendl <[email protected]>
servies.Bitly: Remove "stop" page from test definitions

It appears that bit.ly has either completely stopped the use of it's spam
warning page, or at le...

dfd70d8b7282757c493d51d19bb66d84fd214b33 authored almost 12 years ago by David Triendl <[email protected]>
Add service "Trimnew" (http://tr.im/)

This new shortener shortener is re-using the domain name of the once popular
shortener "Trim". T...

c668cff65acd200529058c6433b2957ce38536b5 authored almost 12 years ago by David Triendl <[email protected]>
Remove service "Klam" (http://kl.am/)

d3d434d67e696426bbc5ece253386382ce4463d4 authored almost 12 years ago by David Triendl <[email protected]>
Add service "Google" (http://goo.gl/)

7df24ec73e646a6233029ceeb03161c733edf53e authored almost 12 years ago by David Triendl <[email protected]>
run.py: Fix wrong variable name

082b31134ce126012e0faaf8e50ab66566fca4c0 authored about 12 years ago by David Triendl <[email protected]>
Make run.py easier to use

- Add tracker.tinyarchive.org/v1/ as default tracker
- Add 60 seconds as default sleep time
- Re...

98454bf1c2ae2bb58cc18945c03cff1e3a10c87d authored about 12 years ago by David Triendl <[email protected]>
single_task.py: Return non-zero exit code on failure

61cc00bff8cca9379e1a43632a1e3a0ee7fc549f authored about 12 years ago by David Triendl <[email protected]>
services.Snipurl: Suppress UnicodeWarning

b3568264ceac4d7d594839153d739e411d014ad2 authored about 12 years ago by David Triendl <[email protected]>
Revert "Convert all parts of compare to unicode"

This reverts commit e37b80fa5837183d961c76ec1744aab25c41ba2e.

d197ccb589e535f66d3ecad7567f3dff76fd46e1 authored about 12 years ago by David Triendl <[email protected]>
Supporting setting tracker url on cli of single_task.py

Still defaulting to regular tracker

34f33a1762a567c04320838c40935563cb995ae7 authored about 12 years ago by Erik Simmesgård <[email protected]>
Adding snipurl in supported urlshorteners

c7942583b51590d7ba9de167ee860d2ce77493a9 authored about 12 years ago by Erik Simmesgård <[email protected]>
Convert all parts of compare to unicode

This fixes issue #6 - since the warning will go away

e37b80fa5837183d961c76ec1744aab25c41ba2e authored about 12 years ago by Erik Simmesgård <[email protected]>
services.Tinyurl: Return unscrubbed URL instead of exception

Instead of throwing an exception, just return the unscrubbed URL. It is better
than having no UR...

c7b880d8aabcff0b8597f6050d99c129068756af authored about 12 years ago by David Triendl <[email protected]>
Bump version to 2.4

0f7d20e6d34c89a307606d6d227e9c04aa894a59 authored about 12 years ago by David Triendl <[email protected]>
services.Snipurl: Close connection after each request

Snipurl has trouble understanding HTTP: Sometimes empty responses are sent, and
apparently somet...

fbffcaebd6a2cae25002c6e991329bcadd8c89c1 authored about 12 years ago by David Triendl <[email protected]>
services.Snipurl: Handle preview pages

3980ca86569ea3e3ca74da9f29ec7b52a564afb8 authored about 12 years ago by David Triendl <[email protected]>
Bump version to 2.3

588c45c9fe8368036b34cf46db0c3efae62ae0f8 authored about 12 years ago by David Triendl <[email protected]>
Merge branch 'add-snipurl-service'

7a6a8204e637607fe16c56c536af9a662d3bd5b6 authored about 12 years ago by David Triendl <[email protected]>
services.Snipurl: Use default rate limit

Since Snipurl uses some kind of rate limiting, but we are not sure what the
limits are, use the ...

5680012a0b9900f2939af4b4efef8f6de63e6b3c authored about 12 years ago by David Triendl <[email protected]>
services.Tinyurl: Try to get original URL from affiliate URL

5f1da452e1e8aed0e9cee081d329b23853e50428 authored about 12 years ago by David Triendl <[email protected]>
services.Snipurl: ~ is valid character

ba5438d766cd1ed081e74a703be9f3a1595156cb authored about 12 years ago by David Triendl <[email protected]>
services.Snipurl: Throw CodeBlockedException on links that require a private key

2371ced7d49d5d863bb93eb6b5a010cc0fa700ab authored about 12 years ago by David Triendl <[email protected]>
Initial work on adding a scraper service for snipurl

c09f2289eb13ef2b1b0f4e7c62351682f918034b authored about 12 years ago by Erik Simmesgård <[email protected]>
pipeline.py: Fix typo in tracker link

d49d8ef8068854181ef7c96adb9d1ff6c00094dd authored about 12 years ago by David Triendl <[email protected]>
pipeline.py: Remove logo again

The logo was not resized inside the warrior web console, which ruined the whole
layout.

44f76ff6b0dc9f2adfb0804fb22c32ea2146d960 authored about 12 years ago by David Triendl <[email protected]>
pipeline.py: Add logo and link to tracker

64dc9a7b7d94f6ce197a42e79f737297dfdec62d authored about 12 years ago by David Triendl <[email protected]>
Add single_task.py

single_task.py run a single task or sleeps for 60 seconds if there are no tasks
available. It is...

0937f7aa77bd4367f0f84b63e1e59906d0648785 authored about 12 years ago by David Triendl <[email protected]>
services.Tinyurl: Use affiliate link when preview link is empty

51c062f6ad78995913931533099a5b9f5ca2be5e authored about 12 years ago by David Triendl <[email protected]>
Bump version to 2.2

a6cf293eadd15865afc4d8c24ca6a6b032001500 authored about 12 years ago by David Triendl <[email protected]>
services: Switch Isgd and Owly to "simple service"

The new "unexpected_http_status" method makes it possible to handle preview
pages even for "Simp...

6b4011014e84728a292cc30d1997caee0d0d919c authored about 12 years ago by David Triendl <[email protected]>
services.Klam: Handle preview page for "suspicious" URLs

42476d90f2968bb358288a7c4060f373bebcf612 authored about 12 years ago by David Triendl <[email protected]>
HTTPService: Use separate methods for HEAD/GET

Use separate methods for HEAD and GET requests, so that we can return the
response body for GET ...

575c39b83a5cf12289324186afd56a5c7372a1bc authored about 12 years ago by David Triendl <[email protected]>
services.Bitly: Fix typo in charset

9ef4f0269401ee76e3caeeb73e023e8521ae1108 authored about 12 years ago by David Triendl <[email protected]>
Readme: Update list of supported URL shorteners

65aaffe26f017669f0791364659d2185aabea0fa authored about 12 years ago by David Triendl <[email protected]>
Update/Add copyright headers

885941917948abcb62dd69a814c33b6fdb9e7ecd authored about 12 years ago by David Triendl <[email protected]>
services.Isgd: Parse "forced" preview pages

For some domains (e.g. Google Docs), is.gd forces a preview page.

b383b8523996d3d381ab600764dae439962cb5bc authored about 12 years ago by David Triendl <[email protected]>
Merge pull request #4 from alard/master

Some improvements for the warrior

13f11c6998908399db269f51370b9f6b60496790 authored about 12 years ago by davidt <[email protected]>
Show some statistics when Reaper ends.

3dc91f2e63ef698e2fc5d50eed842354440e80bf authored about 12 years ago by Alard <[email protected]>
Get current username from warrior/pipeline runner.

By including the username as a variable, it gets re-evaluated every time
the task starts.

462323f05a34512fafa8d22b5b6f270384fd4261 authored about 12 years ago by Alard <[email protected]>
services.Tinyurl: Fix character encoding bug

789b9147d56db74685aab261dd3aa971ed844c67 authored about 12 years ago by David Triendl <[email protected]>
services: Fix version detection

Python version tuples are made out of strings, not integers

65f5269e3c34f48233cd7109c6cdbdaf022bdd19 authored about 12 years ago by David Triendl <[email protected]>
services.HTTPService: Workaround for Python <= 2.5

Do not set timeout for HTTPConnection if Python version is older than 2.5.

a96dc0154109e9203df72d5a8a0406f17071c186 authored about 12 years ago by David Triendl <[email protected]>
Merge pull request #1 from joepie91/master

Change exception syntax to make the script work on older versions of Python

fbac1f1aef51f2c2480a54ab778aafd8e4e04203 authored about 12 years ago by davidt <[email protected]>
Change exception syntax in yet *another* place

168a84617bfc36371d11fa96153baa6409460bab authored about 12 years ago by Sven Slootweg <[email protected]>
Change exception syntax in another place

0178a6721fe5f7896aabe8b1c5f8adb25d42a130 authored about 12 years ago by Sven Slootweg <[email protected]>
Make script work on older Python versions as well by changing exception syntax

3236cc68e9901b5a0320398881f07661e2173a33 authored about 12 years ago by Sven Slootweg <[email protected]>
pipeline.py: Allow "downloader" to be a simple string

Thanks to underscor for reporting this bug.

0b806cda0795fcecd88d2c6a6d03cf77474dc2b1 authored about 12 years ago by David Triendl <[email protected]>
services.Owly: Parse URL from "Safety Warning" page

Thanks to alard for finding this warning page in the logs.

05d573d8f2afe52542c3415ce229ae2071a24fa3 authored about 12 years ago by David Triendl <[email protected]>
services.Isgd: Properly handle unencoded URLs in HTML

75b197073c76eae169f17b21eb7f3fb98651eda4 authored about 12 years ago by David Triendl <[email protected]>
services: UTF-8-encode URLs that are parsed from HTML

bf81109cba8f572f535d4ae30a2eb3f8c11ec770 authored about 12 years ago by David Triendl <[email protected]>
pipeline: Report "warrior" as default username

57a2f0d777c2ed137a6f9656fa2cb1dd67e6db58 authored over 12 years ago by David Triendl <[email protected]>
tinyback: Increase version number to 2.1

a612fe7f17b39b705b2f3a8c9bed715803784c50 authored over 12 years ago by David Triendl <[email protected]>
run.py: Catch exceptions when fetching tasks from tracker

3b699604bbc41ce02b98d24b3213416309be6701 authored over 12 years ago by David Triendl <[email protected]>
pipeline.py: Completely fix username config (D'oh)

52435688f72b8ff84945df073289b350481d50e2 authored over 12 years ago by David Triendl <[email protected]>
pipeline.py: Fix username config option

bea4340d497d98260a8d213c38f528bc12aa20ca authored over 12 years ago by David Triendl <[email protected]>
Support --username and --temp-dir options

f1ef61454ce5ed7ab391a48bb9984bae9a4a2590 authored over 12 years ago by David Triendl <[email protected]>