Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmark

Export BriefConnect with Author
View PDF ↗
PDF Viewer
Open Full PDF

BUILDER'S SANDBOX

Build This Paper

Use an AI coding agent to implement this research.

OpenAI Codex
OpenAI CodexAI Agent

Lightweight coding agent in your terminal.

Claude Code
Claude CodeAI Agent

Agentic coding tool for terminal workflows.

AntiGravity IDE
AntiGravity IDEScaffolding

AI agent mindset installer and workflow scaffolder.

Cursor
CursorIDE

AI-first code editor built on VS Code.

VS Code
VS CodeIDE

Free, open-source editor by Microsoft.

Estimated $9K - $13K over 6-10 weeks.

See exactly what it costs to build this -- with 3 comparable funded startups.

7-day free trial. Cancel anytime.

Discover the researchers behind this paper and find similar experts.

7-day free trial. Cancel anytime.

References (30)

[1]
GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and Citations
2025Odysseas S. Chlapanis, D. Galanis et al.
[2]
Command A: An Enterprise-Ready Large Language Model
2025Team Cohere, Aakanksha et al.
[3]
Plutus: Benchmarking Large Language Models in Low-Resource Greek Finance
2025Xueqing Peng, Triantafillos Papadopoulos et al.
[4]
Open or Closed LLM for Lesser-Resourced Languages? Lessons from Greek
2025John Pavlopoulos, Juli Bakagianni et al.
[5]
Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier
2024John Dang, Shivalika Singh et al.
[6]
INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge
2024Angelika Romanou, Negar Foroutan et al.
[7]
Greek Wikipedia: A Study on Abstractive Summarization
2024Nikolaos Giarelis, Charalampos Mastrokostas et al.
[8]
Social Media Topic Classification on Greek Reddit
2024Charalampos Mastrokostas, Nikolaos Giarelis et al.
[9]
NLP for The Greek Language: A Longer Survey
2024Katerina Papantoniou, Yannis Tzitzikas
[10]
The Llama 3 Herd of Models
2024Abhimanyu Dubey, Abhinav Jauhri et al.
[11]
Gemma 2: Improving Open Language Models at a Practical Size
2024Gemma Team Morgane Riviere, Shreya Pathak et al.
[12]
Meltemi: The first open Large Language Model for Greek
2024Leon Voukoutis, Dimitris Roussis et al.
[13]
A systematic survey of natural language processing for the Greek language
2024Juli Bakagianni, K. Pouli et al.
[14]
The Effect of Sampling Temperature on Problem Solving in Large Language Models
2024Matthew Renze, Erhan Guven
[15]
A Study on Large Language Models' Limitations in Multiple-Choice Question Answering
2024Aisha Khatun, Daniel G. Brown
[16]
GreekT5: Sequence-to-Sequence Models for Greek News Summarization
2024Nikolaos Giarelis, Charalampos Mastrokostas et al.
[17]
A Review of Greek NLP Technologies for Chatbot Development
2023Nikolaos Giarelis, Charalampos Mastrokostas et al.
[18]
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
2023Lucas Bandarkar, Davis Liang et al.
[19]
How is ChatGPT's behavior changing over time?
2023Lingjiao Chen, Matei Zaharia et al.
[20]
GPT-4 Technical Report
2023OpenAI Josh Achiam, Steven Adler et al.

Showing 20 of 30 references

Founder's Pitch

"Develop a Greek-specific QA system leveraging a new dataset and evaluation framework for enhancing LLM performance in under-resourced languages."

Question AnsweringScore: 5View PDF ↗

Commercial Viability Breakdown

0-10 scale

High Potential

2/4 signals

5

Quick Build

2/4 signals

5

Series A Potential

0/4 signals

0

Sources used for this analysis

arXiv Paper

Full-text PDF analysis of the research paper

GitHub Repository

Code availability, stars, and contributor activity

Citation Network

Semantic Scholar citations and co-citation patterns

Community Predictions

Crowd-sourced unicorn probability assessments

Analysis model: GPT-4o · Last scored: 2/18/2026

Explore the full citation network and related research.

7-day free trial. Cancel anytime.

Understand the commercial significance and market impact.

7-day free trial. Cancel anytime.

Get detailed profiles of the research team.

7-day free trial. Cancel anytime.

Related Papers

Loading…