You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
One of the variables that take part in a test run, besides the kernel version, config applied, compiler environment, etc. is the information about the KernelCI version used to build the kernel, generate the job and run it, and this has always been ignored.
There are two ways, I think, in which KernelCI impacts a test:
The kernel config fragments used in the kernel build, if any
The way the job is generated and the involved templates
A change in any of these may affect the result of a test, but currently there's no way to tell which KernelCI version was used to run a particular test. We can get the full kernel config used for a build, and that will include all the KernelCI fragments used, but this doesn't make it easier to track down potential test failures introduced by KernelCI changes, as happened in the past.
There were some cases where KernelCI reported regressions that were found to be caused exclusively by changes in the KernelCI kernel config fragments, but there were no way to tell that from the test results, and no tests in place to check for failures caused by these particular changes.
The text was updated successfully, but these errors were encountered:
One of the variables that take part in a test run, besides the kernel version, config applied, compiler environment, etc. is the information about the KernelCI version used to build the kernel, generate the job and run it, and this has always been ignored.
There are two ways, I think, in which KernelCI impacts a test:
A change in any of these may affect the result of a test, but currently there's no way to tell which KernelCI version was used to run a particular test. We can get the full kernel config used for a build, and that will include all the KernelCI fragments used, but this doesn't make it easier to track down potential test failures introduced by KernelCI changes, as happened in the past.
There were some cases where KernelCI reported regressions that were found to be caused exclusively by changes in the KernelCI kernel config fragments, but there were no way to tell that from the test results, and no tests in place to check for failures caused by these particular changes.
The text was updated successfully, but these errors were encountered: