vocaliodmiku/SLI-LL
Repository of the paper: "Spoken Language Intelligence of Large Language Models for Language Learning"
This project provides a comprehensive dataset and evaluation framework for assessing how well large language models (LLMs) understand and apply spoken language knowledge for language learning. It takes in various prompting techniques and LLM outputs, then evaluates their ability to answer multiple-choice questions related to phonetics, phonology, and second language acquisition. Language educators, curriculum designers, and AI researchers focused on educational technology would use this.
No commits in the last 6 months.
Use this if you need to evaluate the "spoken language intelligence" of large language models for developing conversational language learning tools or educational chatbots.
Not ideal if you are looking for an off-the-shelf application to directly teach spoken language to students.
Stars
4
Forks
—
Language
—
License
—
Category
Last pushed
Aug 30, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/vocaliodmiku/SLI-LL"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jncraton/languagemodels
Explore large language models in 512MB of RAM
microsoft/unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
haizelabs/verdict
Inference-time scaling for LLMs-as-a-judge.
bytedance/Sa2VA
Official Repo For Pixel-LLM Codebase
albertan017/LLM4Decompile
Reverse Engineering: Decompiling Binary Code with Large Language Models