Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/ArchiveTeam/VideoBot

Specialised bot for periodical grabs and video/audio/etc. webpage scrapes.
https://github.com/ArchiveTeam/VideoBot

[facebook.com] remove twitter references

ad504e03c941c9a1ed7bc5c037f2336c4c9bc160 authored about 7 years ago by Arkiver2 <[email protected]>
[facebook.com] add support

db8b98473af4f64a6f9420e80ab1fd10f9cbd089 authored about 7 years ago by Arkiver2 <[email protected]>
add gitignore

b7949f31b1ff442cb66825852d0a3bab602647de authored about 7 years ago by Arkiver2 <[email protected]>
Support new names .ts files for Periscope.

Bump version to 20170916.01.

78728843e630f84fa0dcda5cadb53d93bb366dea authored over 7 years ago by Arkiver2 <[email protected]>
Add support for twitter hashtag.

Fix periscope support.
Fix uploading of items with ' = ' in metadata.
Bump version to 20170118.01.

fa15bbd1e6ef46352464ce840b24c2ed3fe41914 authored almost 8 years ago by Arkiver2 <[email protected]>
twitter_com: prevent duplicate creators.

43ab262af324bd036b426063aeccc423871c225b authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: add metadata about user who shared the video. Add tweet ID to metadata.

060c35c77c7a84633c45e91a677cd960248edba4 authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: prevent uploading empty video items. fix.

e7a2eda802a5e33616db5fe6f2edbcffaa7b33b3 authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: prevent uploading empty video items.

e595722b916b36d1ff776829895af3bf72c314e4 authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: fix title of Internet Archive item, upload video and tweet info as JSON.

242048d09d10eb02fcb44104a31c7ca62e59621b authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: don't download any URLs more than 5 times.

6c34c5c369ad73a67be978b89ef89a38d47f75bc authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com_user: increase time between queueing tweets to 10 seconds.

671c8c558d136b37c8e051e780ab251565e1ffcf authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: prevent loop on URL with status code 0. Before preventing loop, retry 5 times.

eaae872b54c8519452f78bb4872f129d6d88f5bd authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: prevent loop on URL with status code 999.

bbaadeceb83fb7eebfad5251e0bc5872b9bab602 authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: prevent loop on URL with status code 4xx.

d6d42d327ead2c66ca230fe2b031f2b1eb18581c authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: fix grab-site not showing statistics.

3f2d2ec24cd151f56da19148e34fba5c14eed75e authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: prevent loop on URL returning status code 400.

6e479a8a536a61f342fc150faf55446335d86af6 authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com_user: grab the /media timeline. Reduce wait between adding tweets to 5 seconds.

58d696253aa3471618f2f9981ab3415fa4a642ef authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com_user: add support.

4dcfa28972567424add6e15cfcd3dbc93c6755c6 authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: check if video is already on Internet Archive.

4f23dda0dbc9e43f92a3df889d6b74ad695f19a8 authored about 8 years ago by Arkiver2 <[email protected]>
twitter_com: add hashtags to ia item subjects.

ed621625ea70940ec47f858f2385cd0da5afed11 authored about 8 years ago by Arkiver2 <[email protected]>
Ignore URLs for twitter.com grab, making the grab faster.

ea0ebd29d578d5857d3777fef83c1faa9bb82b2f authored about 8 years ago by Arkiver2 <[email protected]>
Fix date for twitter_com service.

aab3f43fc6fa1bbe941c3f7684e17afd430112bb authored over 8 years ago by Arkiver2 <[email protected]>
Download .m3u8 videostreams with '/amplify_video' in URL.

c75f108c884786e4a3b97486a12e86ea3067082c authored over 8 years ago by Arkiver2 <[email protected]>
Remove debug line from periscope_tv service.

1b1fe08c93038ce3f0c40de2e2a29f13ae146cf0 authored over 8 years ago by Arkiver2 <[email protected]>
Fix periscope_tv service: chunk extraction.

a8539c21cb7c80f6e1e4a7c75a7e499b118269d0 authored over 8 years ago by Arkiver2 <[email protected]>
Fix periscope_tv service.

e741112819fe855d7250e3ba13433121e12258ed authored over 8 years ago by Arkiver2 <[email protected]>
Remove no_upload and *.upload files on start. Remove *.upload files every 21600 seconds. Bump version to 20160609.01.

5bb23524540365ad72412a9cd6d346b3411489cf authored over 8 years ago by Arkiver2 <[email protected]>
liveleak_com: Add support.

Bump version to 20160528.01.

a54fdef2797685691138a2facdc6d039bdc70b30 authored over 8 years ago by Arkiver2 <[email protected]>
periscope_tv: Fix 'location' in Internet Archive metadata.

Bump version to 20160525.02.

8288bca06b6dd01fa34e0ad1d96b36da57c16915 authored over 8 years ago by Arkiver2 <[email protected]>
periscope_tv: Add location to metadata and title.

Bump version to 20160525.01.

df6e620ea407b054c01e8c3fdaa35794f69b8466 authored over 8 years ago by Arkiver2 <[email protected]>
periscope_tv: Fix metadata extraction.

963e762f3a1daf0ef569723c3a62839c925f250c authored over 8 years ago by Arkiver2 <[email protected]>
periscope_tv: Fix item_title regex.

Bump version to 20160521.01.

46a82828f5c7a399051bd3d95f2a8c5258fb5055 authored over 8 years ago by Arkiver2 <[email protected]>
twitter_com: Add support for new kind of video. Skip all URLs containing '?lang='.

Bump version to 20160520.01.

679b7b436cd3817fd71a43eb15b844ff7d5d311b authored over 8 years ago by Arkiver2 <[email protected]>
Prevent 'Too many open files' error on periscope.tv.

Bump version to 20160504.01.

ad2ca8b1e0d3eed2df6311e02b6c8f239a749c40 authored over 8 years ago by Arkiver2 <[email protected]>
Fix not deriving after uploading.

Fix '&amp;' in twitter.com item title and description.
Bump version to 20160503.03.

31faedda405ec64902c47fd14147ef0b21a82f66 authored over 8 years ago by Arkiver2 <[email protected]>
Add periscope.tv.

Don't create new item if no itemdata was downloaded.
Bump version to 20160503.02.

a8b44feed4e8afc1ada1f42cabc23307def01fd3 authored over 8 years ago by Arkiver2 <[email protected]>
Fix key problem with newlines.

Bump version to 20160503.01.

a090344ddf1cb0cee201124d923ad34e419bfb3a authored over 8 years ago by Arkiver2 <[email protected]>
Load keys from 'keys' file.

Reduce concurrent for each grab to 1.
Make sure to derive after an upload.

9ea9d9e73c9efa98486e8c761df5cd3980dfcef1 authored over 8 years ago by Arkiver2 <[email protected]>
Add support for twitter.com videos.

Fix \n and \r support for vine.co.
Bump version to 20160502.01.

1a6e1adf5d68ea980b2bc30574f4dd8b0fc087f7 authored over 8 years ago by Arkiver2 <[email protected]>
Fix unicode character printing to IRC problem.

Fix bad JSON loading for vine_co service.
Find mmsh and rtmp URLs.

de246c28653a04e51c11a7103af81e7cb1cea925 authored over 8 years ago by Arkiver2 <[email protected]>
Fix uploading problems.

Fix IRC reconnect problems.
Bump version to 20160501.01.

cfab76e80b113cdbb787958b2e956a9e8a0f47eb authored over 8 years ago by Arkiver2 <[email protected]>
Better support for vine_co.

Add 'write_metadata' command for services.
Add 'bad_command' command for services.
Extract metad...

1680521d51e44d522f6cb3a114be346ada2fd2a4 authored over 8 years ago by Arkiver2 <[email protected]>
Fix upload started while file is recording.

Fix collection for vine_co service.
Bump version to 20160413.02.

91418a9084c462b04f99d1b52369659e5c975635 authored over 8 years ago by Arkiver2 <[email protected]>
Add support for uploading items.

Add script to sort WARCs into items.
Add upload script using internetarchive to upload to Intern...

31b83e0392c3761482e18414adf78169c8d6e7f2 authored over 8 years ago by Arkiver2 <[email protected]>
Fix crash because ' would be written to a Python file string as ' and not as \'.

Bump version to 20160407.01.

0fadfebc8f37d19cc739be7febca9410a09c9367 authored over 8 years ago by Arkiver2 <[email protected]>
Add rtsp video stream support.

Add support for non-http(s).
Add 'execute_timeout' command to periodical_job.
Fix returning None...

9857f30a164337f999eb2427bc5175a2df3ee0b8 authored over 8 years ago by Arkiver2 <[email protected]>
Add support for service Vine.

Add removal if temp periodical jobs are last edited longer than a
certain time ago.
Add creation...

1deeeb270dc4c9b5b180ae4f1342c7252ac15081 authored over 8 years ago by Arkiver2 <[email protected]>
Add --remove function for !perjob to remove a service.

Add 'execute' command for service IRC commands to execute program using
os.system.
Add IRC comma...

e73d9086bf6439314fccd5ace1c0fcdf8375ef7e authored over 8 years ago by Arkiver2 <[email protected]>
Rename check_url.py to url.py.

Add check if string is number to check_valid.py.
Extract multiple strings using download_page.py...

034e3f40a1a3f0c9c64c5b82a139846652034f02 authored over 8 years ago by Arkiver2 <[email protected]>
Initial.

404917c4f731b0744510b38bcc9615c4909e0e9b authored almost 9 years ago by Arkiver2 <[email protected]>