Available Metrics
Prompt Optimization metrics are special metrics based on the evaluation metrics that are designed to evaluate the quality of the prompts generated by the Prompt Optimization API.
20 docs tagged with "metrics"
View all tagsClassification Metrics
Definitions
Code String Match
Definitions
Context Precision, Recall, and F1
Definitions
Correctness
Definitions
Extended Context Precision & Recall
Definitions
Faithfulness
Definitions
Flesch–Kincaid Readability
Definitions
LLM-based Answer Relevance
Definition
LLM-based Context Coverage
Definition
LLM-based Context Precision
Definition
LLM-based Correctness
Definition
LLM-based Faithfulness
Definition
LLM-based Style Consistency
Definition
Overview
Metric Overview
Python AST Similarity
Definitions
Ranked-Aware Metrics
Definitions
SQL AST Similarity
Definitions
SQL Syntax Match
Definitions
Tool Selection Accuracy
Definitions