Skip to content

Commit cc1e2b6

Browse files
author
Simba
committed
Move _run_coro to base class, prevent LiteLLM logging warnings by introducing the AsyncLoopRunner
1 parent 0a7a280 commit cc1e2b6

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

adt_eval/text_type.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,10 +8,8 @@
88
- For each line in the Gold Standard transcript, we seek a match and, if the line matches, one text type item is 'used up' from the list.
99
"""
1010

11-
import asyncio
1211
import json
1312
import os
14-
import threading
1513
from pathlib import Path
1614
from typing import Any, Dict, List
1715

@@ -84,6 +82,7 @@ def text_type_per_page_scorer(inputs: Dict[str, Any], outputs: Dict[str, Any]) -
8482
rationale=json.dumps(matches),
8583
)
8684

85+
8786
class TextTypeEvaluator(MLflowEvaluatorBase):
8887
"""Evaluator for text type accuracy."""
8988

0 commit comments

Comments
 (0)