EAGLE
EAGLE is a fast decoding method of large language models with provable performance maintenance.
Collective -
Host: opensource -
https://opencollective.com/eagle
- Code: https://github.com/SafeAILab/EAGLE
pypi: eagle-llm 1.2.1
Accelerating LLMs by 3x with No Quality Lossgithub.com/SafeAILab/EAGLE - 3 versions - Latest release: about 2 years ago - 41 downloads last month