Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains
Abstract
Modern Greek is absent from NVIDIA's Nemotron retrieval models and from major multilingual retrieval benchmarks, despite being important for retrieval-augmented generation (RAG) in legal, energy, financial, and medical applications. We present an end-to-end adaptation of the Nemotron retrieval stack for Modern Greek, including corpus mining, synthetic supervision, retrieval model training, reranker adaptation, reader fine-tuning, and a new benchmark called HERA. Our study shows that a parameter-free BM25 baseline outperforms several off-the-shelf multilingual dense retrieval models on specialist Greek corpora. After fine-tuning on 65,773 Greek retrieval pairs, a Nemotron 1B embedder improves nDCG@10 from 0.362 to 0.835 and substantially outperforms its unadapted counterpart. The learned language competence transfers to general-domain Greek, although the advantage over BM25 remains domain-dependent. We further adapt a cross-encoder reranker and demonstrate consistent improvements across specialist domains. Finally, we LoRA-tune a Nemotron 30B-A3B mixture-of-experts reader for grounded generation, increasing judged answer correctness from 29.4% to 66.9% while significantly improving faithfulness and citation quality. We also introduce HERA, the first large-scale Greek benchmark for retrieval-augmented generation, and release our adapted models and benchmark to support future research on Greek-language RAG systems.
Community
If you've tried building RAG in Greek, you've probably hit the same wall we did: most multilingual retrievers haven't seen enough Greek, and there's no benchmark to tell you how bad it is. So we adapted the Nemotron retrieval stack end to end and built HERA, a benchmark covering legal, energy, financial and medical Greek. The finding that surprised us most was plain BM25 beating several off-the-shelf dense models on specialist corpora.. fine-tuning fixed that. Models and benchmark are released, and feedback is welcome, especially from people working on other low-resource languages.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- PETRA: Transforming Web Text for Petroleum-Engineering Domain Adaptation (2026)
- MTEB-BR: A Text Embedding Benchmark for Brazilian Portuguese (2026)
- CeQe: Grounding Lexical Retrieval in Semantic Evidence (2026)
- ARMOR: Adaptive Retriever Optimization for Low-Resource Telecom Question Answering (2026)
- When More Documents Hurt RAG: Mitigating Vector Search Dilution with Domain-Scoped, Model-Agnostic Retrieval (2026)
- Inject or Navigate? Token-Efficient Retrieval for LLM Analysis of Transactional Legal Documents (2026)
- Can Language Models Actually Retrieve In-Context? Drowning in Documents at Million Token Scale (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper