Ecosyste.ms: OpenCollective
An open API service for software projects hosted on Open Collective.
github.com/denosaurs/tokenizer
⚙️ A simple tokenizer for deno
https://github.com/denosaurs/tokenizer
fix: README Formatting + Example Fix (#1)
2b7b21f93184cd46f5b832c5dc705b898db77a60 authored over 2 years ago by トトも <[email protected]>
2b7b21f93184cd46f5b832c5dc705b898db77a60 authored over 2 years ago by トトも <[email protected]>
Update stuff
de312f79741481b5296cbe033132d646f1e455ea authored over 4 years ago by eliassjogreen <[email protected]>
de312f79741481b5296cbe033132d646f1e455ea authored over 4 years ago by eliassjogreen <[email protected]>
Updated everything to work with latest
d10c70cb7d83fdaa7869abad80362f3c763dcfdd authored almost 5 years ago by eliassjogreen <[email protected]>
d10c70cb7d83fdaa7869abad80362f3c763dcfdd authored almost 5 years ago by eliassjogreen <[email protected]>
Update push.yml
a3b67d50f4aaacbf2493b20ef0766c651dfdb2ff authored almost 5 years ago by Elias <[email protected]>
a3b67d50f4aaacbf2493b20ef0766c651dfdb2ff authored almost 5 years ago by Elias <[email protected]>
Update push.yml
0a5621e7e1f6850c8fbcfc5ef3f4aab6abf430e8 authored almost 5 years ago by Elias <[email protected]>
0a5621e7e1f6850c8fbcfc5ef3f4aab6abf430e8 authored almost 5 years ago by Elias <[email protected]>
Update push.yml
495415d4ee2acc621272ccd25c78d869fc1b463b authored almost 5 years ago by Elias <[email protected]>
495415d4ee2acc621272ccd25c78d869fc1b463b authored almost 5 years ago by Elias <[email protected]>
Fixed way tokenizer handles arrays
3c7d9c65914636763e20f6c226a62a9e7031483a authored almost 5 years ago by eliassjogreen <[email protected]>
3c7d9c65914636763e20f6c226a62a9e7031483a authored almost 5 years ago by eliassjogreen <[email protected]>
rule type can now be number
b41e65e553ba83b41084599151796db9838022e1 authored about 5 years ago by eliassjogreen <[email protected]>
b41e65e553ba83b41084599151796db9838022e1 authored about 5 years ago by eliassjogreen <[email protected]>
Add value transformation in rule & value in token
251a49a1e3aaf401ac7befa9ce2295a749e5db76 authored about 5 years ago by eliassjogreen <[email protected]>
251a49a1e3aaf401ac7befa9ce2295a749e5db76 authored about 5 years ago by eliassjogreen <[email protected]>
Readme and formatting
f9a40c623c17694e6f428032e28cc6ffe3e7af6d authored over 5 years ago by eliassjogreen <[email protected]>
f9a40c623c17694e6f428032e28cc6ffe3e7af6d authored over 5 years ago by eliassjogreen <[email protected]>
Forgot a small change
e249211ccdc0555b996db9e0163922f891dc8029 authored over 5 years ago by eliassjogreen <[email protected]>
e249211ccdc0555b996db9e0163922f891dc8029 authored over 5 years ago by eliassjogreen <[email protected]>
Updated result.json
67327472ed7756b1c1cbd3c3595661109210f278 authored over 5 years ago by eliassjogreen <[email protected]>
67327472ed7756b1c1cbd3c3595661109210f278 authored over 5 years ago by eliassjogreen <[email protected]>
Replaced crlf with lf
6c83639a1fe6b1fec964fa73830870ff257c63e8 authored over 5 years ago by eliassjogreen <[email protected]>
6c83639a1fe6b1fec964fa73830870ff257c63e8 authored over 5 years ago by eliassjogreen <[email protected]>
Added .editorconfig, changed json example
63e5ffe07a3d1ae0267317e82eae7521616344a5 authored over 5 years ago by eliassjogreen <[email protected]>
63e5ffe07a3d1ae0267317e82eae7521616344a5 authored over 5 years ago by eliassjogreen <[email protected]>
Added .editorconfig, changed json example
0653d5c5cb75b2b0d5f0d83cd3444d5196b125cd authored over 5 years ago by eliassjogreen <[email protected]>
0653d5c5cb75b2b0d5f0d83cd3444d5196b125cd authored over 5 years ago by eliassjogreen <[email protected]>
Added json example and fixed the tokenize method
29b4eb1f178d5ada5e3697bbe2208e3a644edb20 authored over 5 years ago by eliassjogreen <[email protected]>
29b4eb1f178d5ada5e3697bbe2208e3a644edb20 authored over 5 years ago by eliassjogreen <[email protected]>
Added support for group matching
a7066061750fac1d61dfffa1813b06d8c2324556 authored over 5 years ago by eliassjogreen <[email protected]>
a7066061750fac1d61dfffa1813b06d8c2324556 authored over 5 years ago by eliassjogreen <[email protected]>
Added constructor and Tokenizer.tokenize overloads
367399a57adb76e22c8d49661b77e73b29adda6e authored over 5 years ago by eliassjogreen <[email protected]>
367399a57adb76e22c8d49661b77e73b29adda6e authored over 5 years ago by eliassjogreen <[email protected]>
Migrated the workflow to yaml
804d308bdad196268ab2c211700efaec9666789a authored over 5 years ago by eliassjogreen <[email protected]>
804d308bdad196268ab2c211700efaec9666789a authored over 5 years ago by eliassjogreen <[email protected]>
Added a tokenize method to the Tokenizer
72474a20246b6f581dc9b001f13723cc9b1a1c25 authored over 5 years ago by eliassjogreen <[email protected]>
72474a20246b6f581dc9b001f13723cc9b1a1c25 authored over 5 years ago by eliassjogreen <[email protected]>
Added test cmd and bumped deno version in workflow
58c8cca9b9434893b23ed2b6c392c98778acaefb authored over 5 years ago by eliassjogreen <[email protected]>
58c8cca9b9434893b23ed2b6c392c98778acaefb authored over 5 years ago by eliassjogreen <[email protected]>
Added typescript-deno-plugin
6a959877d20acee476e5b75fd18b983ab9c4cc7a authored over 5 years ago by eliassjogreen <[email protected]>
6a959877d20acee476e5b75fd18b983ab9c4cc7a authored over 5 years ago by eliassjogreen <[email protected]>
Changed package.json to only contain the vitals
3e0e568b949ec0cdd91a989f2fb27628a35a1df3 authored over 5 years ago by eliassjogreen <[email protected]>
3e0e568b949ec0cdd91a989f2fb27628a35a1df3 authored over 5 years ago by eliassjogreen <[email protected]>
Added eslint and prettier
9d79001f02acc183c75a46d916725fa9806ff724 authored over 5 years ago by eliassjogreen <[email protected]>
9d79001f02acc183c75a46d916725fa9806ff724 authored over 5 years ago by eliassjogreen <[email protected]>
Wrote a some (bad) jsdoc compatible docs
b3a37c6d0c926a5ecd49097fb8b9a3b136e4cb8b authored over 5 years ago by eliassjogreen <[email protected]>
b3a37c6d0c926a5ecd49097fb8b9a3b136e4cb8b authored over 5 years ago by eliassjogreen <[email protected]>
Replace rule "name" with "type"
3fd39483c7b0225c873c4ba8fbc532d517bc2d34 authored over 5 years ago by eliassjogreen <[email protected]>
3fd39483c7b0225c873c4ba8fbc532d517bc2d34 authored over 5 years ago by eliassjogreen <[email protected]>
Added support for array patterns in rules
37c07b97c30f5c686415bb328b3940b0563db214 authored over 5 years ago by eliassjogreen <[email protected]>
37c07b97c30f5c686415bb328b3940b0563db214 authored over 5 years ago by eliassjogreen <[email protected]>
Added custom patterns using functions and tests
c817fd5da69c72fb86564cbaee8aa04b93333f2f authored over 5 years ago by eliassjogreen <[email protected]>
c817fd5da69c72fb86564cbaee8aa04b93333f2f authored over 5 years ago by eliassjogreen <[email protected]>
Finally fixed workflow
9de20d9e157e0ab653440d746714aa5a6d1de27d authored over 5 years ago by Elias <[email protected]>
9de20d9e157e0ab653440d746714aa5a6d1de27d authored over 5 years ago by Elias <[email protected]>
Update main.workflow
a047630e75f1cc16c9385f02eb2ee42c810bd460 authored over 5 years ago by Elias <[email protected]>
a047630e75f1cc16c9385f02eb2ee42c810bd460 authored over 5 years ago by Elias <[email protected]>
Update main.workflow
6f1ed9d1a5fda0495424b8df6c7c1e16bafcf0ef authored over 5 years ago by Elias <[email protected]>
6f1ed9d1a5fda0495424b8df6c7c1e16bafcf0ef authored over 5 years ago by Elias <[email protected]>
Fixed test workflow
99bd4e456ba64682a5f9bc6886a2890e33b02896 authored over 5 years ago by eliassjogreen <[email protected]>
99bd4e456ba64682a5f9bc6886a2890e33b02896 authored over 5 years ago by eliassjogreen <[email protected]>
Rename test.ts to tokenizer_test.ts & workflow fix
1d91cfb7ebe3baee079f7f2c10ff9b69fab780bd authored over 5 years ago by eliassjogreen <[email protected]>
1d91cfb7ebe3baee079f7f2c10ff9b69fab780bd authored over 5 years ago by eliassjogreen <[email protected]>
Deleted testing file
9f611aa3826fc900513951251fd3715464540cac authored over 5 years ago by eliassjogreen <[email protected]>
9f611aa3826fc900513951251fd3715464540cac authored over 5 years ago by eliassjogreen <[email protected]>
Added position information to token
eeec094f9fe457db10669d58ea64e64124badd68 authored over 5 years ago by eliassjogreen <[email protected]>
eeec094f9fe457db10669d58ea64e64124badd68 authored over 5 years ago by eliassjogreen <[email protected]>
Typo 2: Electric bungaloo
94992458239782a2280e79449bca6fa4d8ea6e91 authored over 5 years ago by eliassjogreen <[email protected]>
94992458239782a2280e79449bca6fa4d8ea6e91 authored over 5 years ago by eliassjogreen <[email protected]>
Added TODO
16fa4999c2cbfaa48839ac173074fb7a68bb10be authored over 5 years ago by eliassjogreen <[email protected]>
16fa4999c2cbfaa48839ac173074fb7a68bb10be authored over 5 years ago by eliassjogreen <[email protected]>
Small typo
cf952a972e12e36a267c526b8562fce2f8b35b7d authored over 5 years ago by eliassjogreen <[email protected]>
cf952a972e12e36a267c526b8562fce2f8b35b7d authored over 5 years ago by eliassjogreen <[email protected]>
Fixed yet another typo
e46d0bd49fcf200ccd68c9dd960fb0c67e2da0a2 authored over 5 years ago by eliassjogreen <[email protected]>
e46d0bd49fcf200ccd68c9dd960fb0c67e2da0a2 authored over 5 years ago by eliassjogreen <[email protected]>
Did a typo lmao
f052d12e43c5405a6972b6eb12b0a2a664604c3e authored over 5 years ago by eliassjogreen <[email protected]>
f052d12e43c5405a6972b6eb12b0a2a664604c3e authored over 5 years ago by eliassjogreen <[email protected]>
Fixed typo
5411e04e5540cb7528891f27c9c17b1de55d8e83 authored over 5 years ago by eliassjogreen <[email protected]>
5411e04e5540cb7528891f27c9c17b1de55d8e83 authored over 5 years ago by eliassjogreen <[email protected]>
Added tests for Iterable
4151c239b80edf8237b3fb03666d280963eecb30 authored over 5 years ago by eliassjogreen <[email protected]>
4151c239b80edf8237b3fb03666d280963eecb30 authored over 5 years ago by eliassjogreen <[email protected]>
Made Tokenizer a IterableIterator
e7ad8ebba7097c08743da8387cb65c3f23cb7c57 authored over 5 years ago by eliassjogreen <[email protected]>
e7ad8ebba7097c08743da8387cb65c3f23cb7c57 authored over 5 years ago by eliassjogreen <[email protected]>
Added support for matching strings
2935a9c0aef9ddfb30745ca09906d79242e37854 authored over 5 years ago by eliassjogreen <[email protected]>
2935a9c0aef9ddfb30745ca09906d79242e37854 authored over 5 years ago by eliassjogreen <[email protected]>
Update README.md
c8da7276f50fea570d5c4f80a7249f9450bf2ee2 authored over 5 years ago by Elias <[email protected]>
c8da7276f50fea570d5c4f80a7249f9450bf2ee2 authored over 5 years ago by Elias <[email protected]>
Changed name
268eaccf7e1d395edf289cfcf8b72cb3aa99be12 authored over 5 years ago by Elias <[email protected]>
268eaccf7e1d395edf289cfcf8b72cb3aa99be12 authored over 5 years ago by Elias <[email protected]>
Fixed action status badge
c35dd484e10352c5854e45db670c6114159dc3bf authored over 5 years ago by eliassjogreen <[email protected]>
c35dd484e10352c5854e45db670c6114159dc3bf authored over 5 years ago by eliassjogreen <[email protected]>
Updated README.md and formatted a few files
e9807879eac51ba24a16145d58541f09ee9da812 authored over 5 years ago by eliassjogreen <[email protected]>
e9807879eac51ba24a16145d58541f09ee9da812 authored over 5 years ago by eliassjogreen <[email protected]>
Finally
daf4d97837eac1c350803da6405a7d072809a0b8 authored over 5 years ago by Elias <[email protected]>
daf4d97837eac1c350803da6405a7d072809a0b8 authored over 5 years ago by Elias <[email protected]>
Rename .github/workflows/main.yml to .github/workflows.yml
2c0b3ee4a5a0bfef77eb8d11b3f68346066b2c55 authored over 5 years ago by Elias <[email protected]>
2c0b3ee4a5a0bfef77eb8d11b3f68346066b2c55 authored over 5 years ago by Elias <[email protected]>
Added main.yml with a "test" job
997659029d2c272b680455c1af41e357067d8a0b authored over 5 years ago by Elias <[email protected]>
997659029d2c272b680455c1af41e357067d8a0b authored over 5 years ago by Elias <[email protected]>
Fixed tokenizer.ts, added gitignore and tests
6c033e92cd2425d8aa9795ac18ef44b9f7962e8f authored over 5 years ago by eliassjogreen <[email protected]>
6c033e92cd2425d8aa9795ac18ef44b9f7962e8f authored over 5 years ago by eliassjogreen <[email protected]>
Initial commit
ecdd9598a4eb0fe62dee97b4b99bb577a446380c authored over 5 years ago by eliassjogreen <[email protected]>
ecdd9598a4eb0fe62dee97b4b99bb577a446380c authored over 5 years ago by eliassjogreen <[email protected]>