Releases: okirmis/encoding_estimator
Releases · okirmis/encoding_estimator
Release 0.2.0
This releases fixes some bugs and added measures to improve code quality.
- Now works in non-UTF-8 shell environments
- New languages
- Portuguese
- Greek
- Turkish
- Chinese
- Arabic
- Added unit tests
- Code coverage measurement
- Continuous integration service
Version 0.1.1
- Updated metadata
- Fixed broken grammar in gem description
- Added minimum ruby version
Version 0.1.0
Initial version of this gem, supporting:
- Encoding detection
- German, Enlish, French, Spanish and Russian language models
- Allows usage of custom language models
- Multithreaded detection
- Generating language models
- Multithreaded
- Can use wikipedia dumps
- Command line utils
encest-detect
for encoding detectionencest-gen
for language model generation