LLM Response Evaluation & Synthesis Tool
Evaluate, compare, and synthesize LLM responses using automated metrics and human judgment.
1
Add Prompt and Responses
01Response 1
02Response 2
03Response 3
2
Automated Evaluation
Add at least one response and click Evaluate to calculate readability, structure, and content metrics.
View detailed metrics
Readability Metrics
Flesch Reading Ease
-
-
-
Flesch-Kincaid Grade
-
-
-
SMOG Index
-
-
-
Automated Readability
-
-
-
Text Structure
Word Count
-
-
-
Sentence Count
-
-
-
Avg Sentence Length
-
-
-
Sentence Variety
-
-
-
Content Analysis
Keyword Overlap
-
-
-
Specificity Score
-
-
-
Coherence Score
-
-
-
Similarity to Others
-
-
-
Algorithmic Scores
Response 1
-
Response 2
-
Response 3
-
3
Human Evaluation
Rate each response across four dimensions once evaluations are complete.
1 = Poor · 3 = Adequate · 5 = Excellent
Dimensions
Response 1
Response 2
Response 3
Relevance
Addresses the prompt requirements
★★★★★
Not rated★★★★★
Not rated★★★★★
Not ratedAccuracy
Factual correctness
★★★★★
Not rated★★★★★
Not rated★★★★★
Not ratedCompleteness
Depth of coverage
★★★★★
Not rated★★★★★
Not rated★★★★★
Not ratedClarity
Structure and readability
★★★★★
Not rated★★★★★
Not rated★★★★★
Not rated4
Comparison Results
Overall Winner
Evaluate responses to determine the winner.
Score Comparison
| Dimension | Resp 1 | Resp 2 | Resp 3 |
|---|---|---|---|
| Relevance | 0 | 0 | 0 |
| Accuracy | 0 | 0 | 0 |
| Completeness | 0 | 0 | 0 |
| Clarity | 0 | 0 | 0 |
| Human | 0/20 | 0/20 | 0/20 |
| Algorithmic | 0/100 | 0/100 | 0/100 |
5
Synthesis Recommendations
Complete evaluation to generate structured synthesis recommendations.