Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(core): Keep track of test case executions during test run (no-changelog) #12787

Draft
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

burivuhster
Copy link
Contributor

Summary

This PR introduces a new entity "TestCaseExecution". It represents a specific past execution being "re-run" and evaluated during a specific Test Run.

The idea is to store the connection between Test Runs and related executions (past, new and evaluation) in a separate table, together with statuses, errors, individual metrics produced by the evaluation workflow. This will allow us to keep track of the details of each Test Run even after related executions will be pruned, and make data fetching more efficient and straightforward in general. Previously, we had to rely on a workaround with the testRunId property added to each evaluation execution's metadata.

Related Linear tickets, Github issues, and Community forum posts

Review / Merge checklist

  • PR title and summary are descriptive. (conventions)
  • Docs updated or follow-up ticket created.
  • Tests included.
  • PR Labeled with release/backport (if the PR is an urgent fix that needs to be backported)

@n8n-assistant n8n-assistant bot added core Enhancement outside /nodes-base and /editor-ui n8n team Authored by the n8n team ui Enhancement in /editor-ui or /design-system labels Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Enhancement outside /nodes-base and /editor-ui n8n team Authored by the n8n team ui Enhancement in /editor-ui or /design-system
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant