python39-pytokens - A Fast, spec compliant Python 3.12+ tokenizer that runs on older Pythons
| Website: | https://github.com/tusharsadhwani/pytokens |
|---|---|
| License: | MIT |
| Vendor: | Alcance Libre, Inc. |
- Description:
A Fast, spec compliant Python 3.12+ tokenizer that runs on older Pythons.
Packages
| python39-pytokens-0.4.0-1.aldos.x86_64 [142 KiB] |
Changelog
by Joel Barrios (2026-01-20):
- Update to 0.4.0. |