Halide Yılmaz Tags
Turkish NLP
2 posts
Turkish NLP10 minTurkish AI Data Quality and Benchmarks: What Actually Exists
The Turkish resource landscape exists mostly as scattered GitHub lists and arXiv papers. What actually exists, what each benchmark measures, what the Cetvel finding says about data quality, and how to build your own evaluation set.
Turkish NLP7 minTokenization and the Challenges of Turkish: Agglutination, Vocabulary Explosion, and Efficient Tokenization
Why does Turkish consume more tokens? Agglutination, vocabulary explosion, BPE and SentencePiece, and how efficient tokenization affects cost and speed.