length ratio removal

vocab containment update

dynamic api cache of openrouter free llms

UI fixes

feat(ui): Add preset-based analysis UI and Gradio 6 compatibility

codebase cleanup

remove fasttext

Update README.md

Reafactoring of the tokenization pipeline, adjusted fasttext implementation

Upload 19 files

Update README.md

Update README.md

revamped the pipeline and added stopwords and documentation

Update README.md

Upload 19 files

initial commit