tinker_cookbook.exceptions.EvalGradingError
Generated from tinker-cookbook at commit 28de41e. Source links point at that snapshot.
class tinker_cookbook.exceptions.EvalGradingError(EvalError)
The grading function failed on a model response.
Raised when the grader (programmatic, LLM judge, or execution-based) cannot produce a score — e.g. the judge response is unparseable, the sandbox crashes during test execution, or the answer extractor returns an unexpected format.
The example is scored as a failure (reward=0). Check
StoredTrajectory.error for the specific grading failure.