Single Metric
In this example, we show how to calculate a metric on a single data point.
from continuous_eval.metrics.retrieval import PrecisionRecallF1
datum = { "question": "What is the capital of France?", "retrieved_context": [ "Paris is the capital of France and its largest city.", "Lyon is a major city in France.", ], "ground_truth_context": ["Paris is the capital of France."], "answer": "Paris", "ground_truth_answers": ["Paris"],}
metric = PrecisionRecallF1()
print(metric(**datum))