Sitelet https://github.com/abhinavkr26104/langsmith-java/pull/1
Skip to content

fix(evaluation): link traced runs to examples - #1

Merged
abhinavkr26104 merged 1 commit into
mainfrom
fix/link-evaluation-runs-to-examples
Aug 9, 2026
Merged

fix(evaluation): link traced runs to examples#1
abhinavkr26104 merged 1 commit into
mainfrom
fix/link-evaluation-runs-to-examples

Conversation

@abhinavkr26104

Copy link
Copy Markdown
Owner

closes: langchain-ai#208

Summary

  • Always link traced evaluation runs to their source dataset example.
  • Add regression coverage for successful evaluations using EvaluateErrorHandling.IGNORE.

Problem

referenceExampleId was set only when EvaluateErrorHandling.LOG was selected. Successful traced runs created with other error-handling modes were therefore not associated with their dataset example.

Testing

  • git diff --check
  • Focused EvaluateRunnerTest run was attempted but exceeded the local execution timeout.

@abhinavkr26104
abhinavkr26104 merged commit 675483c into main Aug 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Link traced evaluation runs to their dataset examples

1 participant