CHiL(L)Grader: Calibrated Human-in-the-Loop Short-Answer Grading

Export BriefConnect with Author
View PDF ↗
PDF Viewer
Open Full PDF

BUILDER'S SANDBOX

Build This Paper

Use an AI coding agent to implement this research.

OpenAI Codex
OpenAI CodexAI Agent

Lightweight coding agent in your terminal.

Claude Code
Claude CodeAI Agent

Agentic coding tool for terminal workflows.

AntiGravity IDE
AntiGravity IDEScaffolding

AI agent mindset installer and workflow scaffolder.

Cursor
CursorIDE

AI-first code editor built on VS Code.

VS Code
VS CodeIDE

Free, open-source editor by Microsoft.

Estimated $9K - $13K over 6-10 weeks.

See exactly what it costs to build this -- with 3 comparable funded startups.

7-day free trial. Cancel anytime.

Discover the researchers behind this paper and find similar experts.

7-day free trial. Cancel anytime.

References (32)

[1]
Enhancing LLM-Based Short Answer Grading with Retrieval-Augmented Generation
2025Yucheng Chu, Peng He et al.
[2]
Advancing Student Writing Through Automated Syntax Feedback
2025Kamyar Zeinalipour, Mehak Mehak et al.
[3]
Improving Generative AI Student Feedback: Direct Preference Optimization with Teachers in the Loop
2025Juliette Woodrow, Chris Piech et al.
[4]
Using Large Language Models for Automated Grading of Student Writing about Science
2024Christopher Impey, Matthew Wenger et al.
[5]
Calibrating Language Models with Adaptive Temperature Scaling
2024Johnathan Xie, Annie S. Chen et al.
[6]
The Llama 3 Herd of Models
2024Abhimanyu Dubey, Abhinav Jauhri et al.
[7]
Qwen2 Technical Report
2024An Yang, Baosong Yang et al.
[8]
Automatic Grading of Short Answers Using Large Language Models in Software Engineering Courses
2024Ta Nguyen Binh Duong, Chai Yi Meng
[9]
Gemma: Open Models Based on Gemini Research and Technology
2024Gemma Team Thomas Mesnard, Cassidy Hardin et al.
[10]
Reinforcement learning for question answering in programming domain using public community scoring as a human feedback
2024Alexey Gorbatovski, Sergey V. Kovalchuk
[11]
A Survey of Confidence Estimation and Calibration in Large Language Models
2023Jiahui Geng, Fengyu Cai et al.
[12]
Orthogonal Subspace Learning for Language Model Continual Learning
2023Xiao Wang, Tianze Chen et al.
[13]
Mistral 7B
2023Albert Qiaochu Jiang, Alexandre Sablayrolles et al.
[14]
Understanding Catastrophic Forgetting in Language Models via Implicit Inference
2023Suhas Kotha, Jacob Mitchell Springer et al.
[15]
Instruction Tuning for Large Language Models: A Survey
2023Shengyu Zhang, Linfeng Dong et al.
[16]
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-Tuning
2023Yun Luo, Zhen Yang et al.
[17]
Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs
2023Miao Xiong, Zhiyuan Hu et al.
[18]
Evaluating Quadratic Weighted Kappa as the Standard Performance Metric for Automated Essay Scoring
2023Afrizal Doewes, N. Kurdhi et al.
[19]
Estimating Expected Calibration Errors
2021N. Posocco, Antoine Bonnefoy
[20]
Automated Grading of Exam Responses: An Extensive Classification Benchmark
2021Jimmy Ljungman, Vanessa Lislevand et al.

Showing 20 of 32 references

Founder's Pitch

"CHiL(L)Grader is an AI-powered grading framework that enhances accuracy by integrating human feedback for uncertain predictions."

Educational AIScore: 7View PDF ↗

Commercial Viability Breakdown

0-10 scale

High Potential

1/4 signals

2.5

Quick Build

3/4 signals

7.5

Series A Potential

0/4 signals

0

Sources used for this analysis

arXiv Paper

Full-text PDF analysis of the research paper

GitHub Repository

Code availability, stars, and contributor activity

Citation Network

Semantic Scholar citations and co-citation patterns

Community Predictions

Crowd-sourced unicorn probability assessments

Analysis model: GPT-4o · Last scored: 3/12/2026

Explore the full citation network and related research.

7-day free trial. Cancel anytime.

Understand the commercial significance and market impact.

7-day free trial. Cancel anytime.

Get detailed profiles of the research team.

7-day free trial. Cancel anytime.

Related Papers

Loading…