Sitelet https://github.com/langchain-ai/langsmith-java/pull/209
Skip to content

fix(evaluation): link traced runs to examples - #209

Open
Abhinav Kumar Singh (abhinavkr26104) wants to merge 2 commits into
langchain-ai:mainfrom
abhinavkr26104:main
Open

fix(evaluation): link traced runs to examples#209
Abhinav Kumar Singh (abhinavkr26104) wants to merge 2 commits into
langchain-ai:mainfrom
abhinavkr26104:main

Conversation

@abhinavkr26104

@abhinavkr26104 Abhinav Kumar Singh (abhinavkr26104) commented Aug 9, 2026

Copy link
Copy Markdown

closes: #210

Summary

  • Always link traced evaluation runs to their source dataset example.
  • Add regression coverage for successful evaluations using EvaluateErrorHandling.IGNORE.

Problem

referenceExampleId was set only when EvaluateErrorHandling.LOG was selected. Successful traced runs created with other error-handling modes were therefore not associated with their dataset example.

Testing

  • git diff --check
  • Focused EvaluateRunnerTest run was attempted but exceeded the local execution timeout.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Link traced evaluation runs to their dataset examples

1 participant