Skip to content

Commit 3676532

Browse files
Merge pull request #13 from kevo1ution/add-kotlin-bench
Add Kotlin-bench, first LLM agentic benchmark of real world android tasks
2 parents 7b718f9 + 516419f commit 3676532

File tree

2 files changed

+14
-15
lines changed

2 files changed

+14
-15
lines changed

data/firebender-plugin.json

Lines changed: 0 additions & 15 deletions
This file was deleted.

data/kotlin-bench.json

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
{
2+
"name": "Kotlin Bench",
3+
"description": "🔍 A benchmark for evaluating Large Language Models (LLMs) on real-world Kotlin and Android software engineering tasks. The first benchmark that tests AI models' ability to resolve actual Kotlin and Android issues. Created by the Firebender team 🔥.",
4+
"link": "https://github.com/firebenders/Kotlin-bench",
5+
"authorName": "Aman Gottumukkala",
6+
"authorLink": "https://firebender.com/blog/kotlin-bench",
7+
"tags": [
8+
"kotlin",
9+
"benchmark",
10+
"android",
11+
"llm",
12+
"ai"
13+
]
14+
}

0 commit comments

Comments
 (0)