Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

websterjs

a reliable high-level web crawling & scraping framework for Node.js.
Collective - Host: opensource - https://opencollective.com/webster - Code: https://github.com/zhuyingda/webster

update dep & docker switch to ubuntu

github.com/zhuyingda/webster - ecba1303d566386226b6593787c55f77521f9363 authored about 1 year ago by Sugar <[email protected]>
eslint autofix

github.com/zhuyingda/webster - c35f62828ca519e149e457ad8fb066722ef8bfe2 authored almost 2 years ago by 赫焱 <[email protected]>
更新 eslint 及对应dep

github.com/zhuyingda/webster - 3d1962ecb67940b94f7e637372d7759d43653fba authored almost 2 years ago by 赫焱 <[email protected]>
update dep ver

github.com/zhuyingda/webster - 030445d50b46dfd7511fdd26e97a303a63c095a9 authored almost 2 years ago by 赫焱 <[email protected]>
optimize docs

github.com/zhuyingda/webster - 53decc4db0405c66515e95af24738ad0742b7e9b authored over 2 years ago by Sugar <[email protected]>
test: 将redis在单测中stub掉

github.com/zhuyingda/webster - 6f4eda25fabd46f44280a3da432cc7279932f852 authored over 2 years ago by Sugar <[email protected]>
update fix

github.com/zhuyingda/webster - a20f8380a2d94ed809042f84f9c10e1735e84bab authored almost 3 years ago by Sugar <[email protected]>
log fix

github.com/zhuyingda/webster - a5d995ad41ca848022c40cecea8e240bd34eb6a4 authored almost 3 years ago by Sugar <[email protected]>
update version

github.com/zhuyingda/webster - 2dfdb5bcaf006b37f123ff25b9ee7662bc348573 authored almost 3 years ago by 赫焱 <[email protected]>
feat: 对抓取失败的task增加lifecycle函数 便于业务代码处理

github.com/zhuyingda/webster - ec38256ce72e6644a83cc1a6c10adfc74c56cf50 authored almost 3 years ago by 赫焱 <[email protected]>
update version

github.com/zhuyingda/webster - 1aea110b417f2405337df75ddbfe0ea778b1df46 authored almost 3 years ago by 赫焱 <[email protected]>
feat: 日志优化

github.com/zhuyingda/webster - d646a7f6cdd250e846ce796622070a00770219f9 authored almost 3 years ago by 赫焱 <[email protected]>
feat: 新增了crawlTarget 和 waitForSelector 两个抓取action，并优化了一些日志

github.com/zhuyingda/webster - 015543eb4befc6dc65464578eb2d48f5bb4e668d authored almost 3 years ago by 赫焱 <[email protected]>
feat: 支持细粒度自定义device宽高

github.com/zhuyingda/webster - eed252830df0c0b2d606543510540156e352a42d authored almost 3 years ago by 赫焱 <[email protected]>
bugfix

github.com/zhuyingda/webster - 0a75ff0eb3596bbd8a4f78516cc051200255cde3 authored almost 3 years ago by Sugar <[email protected]>
spider模式进入正式feature，consumer增加ignoreUnfinishTask参数

github.com/zhuyingda/webster - fab7eeeffcc6a77c756838faf701d987d29e2a9a authored almost 3 years ago by Sugar <[email protected]>
fix: redis security vulner

github.com/zhuyingda/webster - 7ed470bbbbe5bf015074d88f33d9a6452d07be44 authored over 3 years ago by Sugar <[email protected]>
优化 single Spider class

github.com/zhuyingda/webster - 177010c95f5f1cbc97dbe36c05608fcf6b50a5e8 authored over 3 years ago by Sugar <[email protected]>
update version

github.com/zhuyingda/webster - e615a7582e9f264d484693fca919cda75422a996 authored over 3 years ago by 赫焱 <[email protected]>
对外暴露出Spider class

github.com/zhuyingda/webster - 21e3c7ee0a3fb307d7930eb749876dd2849aa998 authored over 3 years ago by 赫焱 <[email protected]>
fix deprecated api

github.com/zhuyingda/webster - 93c0c41f022ead3150ba2149cebc5db2af0d8359 authored over 3 years ago by 赫焱 <[email protected]>
fix eslint issue

github.com/zhuyingda/webster - 412307e49a89a07d4344b114b222de6f8b70f8a5 authored over 3 years ago by 赫焱 <[email protected]>
Merge branch 'master' of github.com:zhuyingda/webster

github.com/zhuyingda/webster - d8faeca1ef825d2404ce28018f70dd26499e4e28 authored over 3 years ago by Sugar <[email protected]>
重构：将spider从consumer中拆出来

github.com/zhuyingda/webster - b89e7bc3062674c6665a11d834358c4e26473e6b authored over 3 years ago by Sugar <[email protected]>
Update README.md

fix issue of doc

github.com/zhuyingda/webster - 8b4ea21ffdb1782ee1c6b8fc6fba018019ff1df3 authored almost 4 years ago by Yingda Zhu <[email protected]>
security fixed

github.com/zhuyingda/webster - afc34e1dda6e28033c77157f8bb05049b0f8ae7d authored almost 4 years ago by Sugar <[email protected]>
add executableBundle option for custom chromium exe file path

github.com/zhuyingda/webster - 90efeb949578a32ed475a90bf38ac4386f67d6a8 authored almost 4 years ago by Sugar <[email protected]>
Update README.md

github.com/zhuyingda/webster - c27c08c27221cff0d3e125788a4fb547e6cdf84d authored about 4 years ago by Yingda Zhu <[email protected]>
Update README.md

docs: ✏️ optmize readme

github.com/zhuyingda/webster - f1f7c0464b58251bd9b93e35fb6a21d308e59560 authored about 4 years ago by Yingda Zhu <[email protected]>
Update README.md

github.com/zhuyingda/webster - 8201a621ca60208bb11c082945e6b66e15f33a73 authored about 4 years ago by Yingda Zhu <[email protected]>
update docker file

github.com/zhuyingda/webster - 3ac3bb9902c2199e66c051903f2e829f77fea7b5 authored about 4 years ago by 赫焱 <[email protected]>
ci bugfix

github.com/zhuyingda/webster - cd6566816ecee74d5f6059ab2508e5f9e48d50af authored about 4 years ago by 赫焱 <[email protected]>
update test case

github.com/zhuyingda/webster - 5d7263bb5bfa225469ad323b7a0de55057e969b1 authored about 4 years ago by 赫焱 <[email protected]>
update docker default node version to 14

github.com/zhuyingda/webster - bce67d63a8eb8c397e05ef7bfe505f12436663f0 authored about 4 years ago by 赫焱 <[email protected]>
bugfix

github.com/zhuyingda/webster - 94bf5115ede24688bb885a8fc62c6d128a4f229e authored about 4 years ago by Sugar <[email protected]>
v1.7.0

github.com/zhuyingda/webster - 89e130e77423c700c50d4b85b6affb744c0e9b36 authored about 4 years ago by Sugar <[email protected]>
update travis

github.com/zhuyingda/webster - e554595476501b4cae5a56172725c11170282b10 authored about 4 years ago by Sugar <[email protected]>
update travis

github.com/zhuyingda/webster - b87b59e06cae4a2eda7cbf0af957711eb8aa0d39 authored about 4 years ago by Sugar <[email protected]>
feat: support for playwright engineType consumer

github.com/zhuyingda/webster - d9416c4fed58693cb9ff7061bb83d11c028d6e34 authored about 4 years ago by Sugar <[email protected]>
update some packages, fix audit issue

github.com/zhuyingda/webster - db4f83873402a40154da71bfbc184193b969796f authored about 4 years ago by Sugar <[email protected]>
refactor test case & update puppeteer dependency

github.com/zhuyingda/webster - cdaa17d1387edad335c8e6ccb125b566a18418ec authored about 4 years ago by Sugar <[email protected]>
Update README.md

github.com/zhuyingda/webster - 84cdbb8af63edc90d723bd704c17058991e3f531 authored about 4 years ago by Yingda Zhu <[email protected]>
add docs

github.com/zhuyingda/webster - d938c0d15b0c4402bafd7fc9601f8f17f379a81c authored about 4 years ago by Sugar <[email protected]>
add docs

github.com/zhuyingda/webster - a3843b425a28166db4d757624ee5945476fa7f68 authored about 4 years ago by Sugar <[email protected]>
update nodejs version and redis test source

github.com/zhuyingda/webster - dbd324c17b4073ad70041255a507fecff613a78f authored over 4 years ago by Sugar <[email protected]>
optimize unit case

github.com/zhuyingda/webster - fa7588ffdcc9dfe493838d066c09ce867221d155 authored almost 5 years ago by Sugar <[email protected]>
fix test case bug

github.com/zhuyingda/webster - a708efda1c66d1d285e5679976e8a3fa81512143 authored almost 5 years ago by Sugar <[email protected]>
update redis server

github.com/zhuyingda/webster - dff117e42741166eff2ab901556d99c13f49f454 authored almost 5 years ago by Sugar <[email protected]>
u

github.com/zhuyingda/webster - 48b636526285acaf222bc933ef21185deab336a8 authored almost 5 years ago by Sugar <[email protected]>
update arch img

github.com/zhuyingda/webster - 27353ad08a62281a2cb5bc01881e27d4e006fb6c authored almost 5 years ago by Sugar <[email protected]>
version 1.6.6 update request package

github.com/zhuyingda/webster - e7c3fa1f6449406242e9333de5b25adba07273a1 authored about 5 years ago by 朱英达 <[email protected]>
update unit test

github.com/zhuyingda/webster - fa9610d297ddfbe1d182e2029763269324add48f authored over 5 years ago by zhuyingda <[email protected]>
update puppeteer to the latest version

github.com/zhuyingda/webster - 11ab3631496abc220c93c00cd298162c86bc3928 authored over 5 years ago by zhuyingda <[email protected]>
add test

github.com/zhuyingda/webster - 2390dabea9c9aff22c0e439e8506e0562871fcea authored over 5 years ago by zhuyingda <[email protected]>
add waiting time

github.com/zhuyingda/webster - 70258a4503b9b8f891433bcfcbf89ce2d45c9b71 authored over 5 years ago by zhuyingda <[email protected]>
Merge pull request #9 from opencollective/opencollective

Activating Open Collective

github.com/zhuyingda/webster - f75af77e16dfff60111863f51efb430ec5f0ccf2 authored over 5 years ago by Yingda Zhu <[email protected]>
Added call to donate after npm install (optional)

github.com/zhuyingda/webster - 4bbcf1fee79eafb8f14ec2d38527ed26d72cfbbd authored over 5 years ago by Jess <[email protected]>
Added financial contributors to the README

github.com/zhuyingda/webster - f41fe0ccf45a82bbf5817385c4df5dd4b71df2f0 authored over 5 years ago by Jess <[email protected]>
fix travis output problem

github.com/zhuyingda/webster - 5f8e6d8ee51032ba67b32da3679e12c602d00ba1 authored over 5 years ago by zhuyingda <[email protected]>
display sponsor button

github.com/zhuyingda/webster - f985737c38fc50612732f48e596e4933185443fc authored over 5 years ago by zhuyingda <[email protected]>
version 1.6.5 refactoring

github.com/zhuyingda/webster - eff76d66f59b910f24dd22eab3536ccf2aca94a9 authored over 5 years ago by zhuyingda <[email protected]>
version 1.6.4 browser mode use chrome native extracting dom

github.com/zhuyingda/webster - 9fa4c4d5c1bf7a547bf27efa63ad02b2b76642c8 authored over 5 years ago by zhuyingda <[email protected]>
version 1.6.3 bugfix

github.com/zhuyingda/webster - 2bb766fde4ac8c872192fe2cc7651bb35bd75cb1 authored over 5 years ago by zhuyingda <[email protected]>
version 1.6.2 add click action for browser spider

github.com/zhuyingda/webster - 0950c2ba4d7dcb5b7b7eddfffd8f62c028fd98aa authored over 5 years ago by zhuyingda <[email protected]>
version 1.5.3

github.com/zhuyingda/webster - 5d90b2566d6a6983edeb2ca730e4cade41d5d4d2 authored over 5 years ago by zhuyingda <[email protected]>
version 1.5.2 bugfixed

github.com/zhuyingda/webster - 8715d2a3724b3425bf4d2422a82efe0dcd99096e authored over 5 years ago by zhuyingda <[email protected]>
version 1.5.1 add browser crawler delay option

github.com/zhuyingda/webster - 10c81b6cc6635cd8c86f28cf9e88d859b324f8ca authored over 5 years ago by zhuyingda <[email protected]>
update readme

github.com/zhuyingda/webster - 75029d2297bf7841f54a98126bec0b1e7a78b200 authored over 5 years ago by zhuyingda <[email protected]>
Merge branch 'master' of github.com:zhuyingda/webster

github.com/zhuyingda/webster - c8094c3a3b3f2ffa66416ffbf95ed28235eb52a3 authored over 5 years ago by zhuyingda <[email protected]>
update for docker and redis service

github.com/zhuyingda/webster - eefdabdda716b2e0ce53fe49c7f47d3b5ece882f authored over 5 years ago by zhuyingda <[email protected]>
add support for 996icu project

add support for 996icu project

github.com/zhuyingda/webster - 7fda998feb8c7c823e84df9b95622e2ad5b3c282 authored over 5 years ago by Yingda Zhu <[email protected]>
version 1.4.1 add custom header param to consumer

github.com/zhuyingda/webster - 54f759ae711bd7982e204a8da4c57bd2cf329ffe authored over 6 years ago by zhuyingda <[email protected]>
单元测试用例 含produce consume

github.com/zhuyingda/webster - c03769212201196c96cf956eea6702b03a18f7c7 authored over 6 years ago by zhuyingda <[email protected]>
Merge pull request #6 from flyanna/master

modify function name, add some annotation in comsumer.js

github.com/zhuyingda/webster - 74feee849ff87611da2b7f4eb54127313078d38e authored over 6 years ago by Yingda Zhu <[email protected]>
modify coding in producer.js

github.com/zhuyingda/webster - 7919733e2c5772b9c873513bea831c5a8e162576 authored over 6 years ago by xuaifang <[email protected]>
modify function name, add some annotation in comsumer.js

github.com/zhuyingda/webster - 19da5e2cc969e878e0ece15da92a2a9538851455 authored over 6 years ago by xuaifang <[email protected]>
version 1.3.9

github.com/zhuyingda/webster - 88abfe5f81a190901bddd01f9c96efde5d1ff949 authored over 6 years ago by zhuyingda <[email protected]>
version 1.3.8

github.com/zhuyingda/webster - d814dea09e207647d738bb51a1215c94a2a975cc authored almost 7 years ago by zhuyingda <[email protected]>
optim

github.com/zhuyingda/webster - 0a243a95a3ba8b92eea52a8644cb39cb9b56cc6b authored almost 7 years ago by zhuyingda <[email protected]>
npm ignore

github.com/zhuyingda/webster - 1b28226f65523fde330836be0084522f0ade79fe authored almost 7 years ago by zhuyingda <[email protected]>
version 1.3.7

github.com/zhuyingda/webster - 22c0e800848568c752a729317fad18b1942eaf28 authored about 7 years ago by zhuyingda <[email protected]>
empty queue log rule

github.com/zhuyingda/webster - 76302006b80657dbc8acc4d692ed8b5b1a3279a7 authored about 7 years ago by zhuyingda <[email protected]>
add node version limit

github.com/zhuyingda/webster - a8c8af6c61477c3b28f5456c2311217f7ad0499e authored about 7 years ago by zhuyingda <[email protected]>
fix a bug when crawler got invalid html error

github.com/zhuyingda/webster - 23f0571e7929a31240ea688a5ff86a2d782c72f8 authored about 7 years ago by zhuyingda <[email protected]>
version 1.3.6

github.com/zhuyingda/webster - b4f786747093ddb607a22d4567d80cc307652b9c authored about 7 years ago by zhuyingda <[email protected]>
clean unfinished task in current channel when every instance setup

github.com/zhuyingda/webster - a5711cef9617ab97500687712cff8f940bfa298e authored about 7 years ago by zhuyingda <[email protected]>
fix a bug cause dirty data in task queue tmp hash

github.com/zhuyingda/webster - b908d1a773c63d8e7dccbe177a0dc9571dfa03d4 authored about 7 years ago by zhuyingda <[email protected]>
add docker quick start

github.com/zhuyingda/webster - 27e44e6029aa41bdf51b3173622b066e2126aec7 authored about 7 years ago by zhuyingda <[email protected]>
version 1.3.5

github.com/zhuyingda/webster - 01f8eca5011ac32895e267cb97707b4791c79edd authored about 7 years ago by zhuyingda <[email protected]>
short the readme

github.com/zhuyingda/webster - 26db0cd1c22384394cf0ae725436a20424558990 authored about 7 years ago by zhuyingda <[email protected]>
add docs site

github.com/zhuyingda/webster - 4f1dea7b7aa678a0d0d5a8de74b3b8d0c8f59a4c authored about 7 years ago by zhuyingda <[email protected]>
version 1.3.4 u

github.com/zhuyingda/webster - 6718fe9d9c9adc6813592b40aa5d07518cefcfb1 authored about 7 years ago by zhuyingda <[email protected]>
version 1.3.4

github.com/zhuyingda/webster - b9bac97f8020d0be57464f628b007c43eef2cceb authored about 7 years ago by zhuyingda <[email protected]>
version 1.3.3

github.com/zhuyingda/webster - e66f7a450d43fcaf96ef07137013442c9f1c75f1 authored about 7 years ago by zhuyingda <[email protected]>
version 1.3.2

github.com/zhuyingda/webster - 4c96a96d96cefdf9d3cd1af1f00c63cf12e03055 authored about 7 years ago by zhuyingda <[email protected]>
task exten referInfo & consumer fail reason support

github.com/zhuyingda/webster - d0ac1e14ef168a48682773415046c7090beb027d authored about 7 years ago by zhuyingda <[email protected]>
version 1.3.1

github.com/zhuyingda/webster - 6c5f4f9eed2caff40b85f722f4194da8f64478bf authored about 7 years ago by zhuyingda <[email protected]>
bugfix

github.com/zhuyingda/webster - 8855b8b5aad1cbb4a710956dde8900cce7106854 authored about 7 years ago by zhuyingda <[email protected]>
add some hook to consumer lifecycle, and robust logic

github.com/zhuyingda/webster - 81c1153e407774b9e39679805a62875b2936a257 authored about 7 years ago by zhuyingda <[email protected]>
update docs

github.com/zhuyingda/webster - 7e0f8711f7232e623169a12107333906e221df53 authored about 7 years ago by zhuyingda <[email protected]>