-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CI for UI Tests Infrastructure Update #88
Conversation
…_close_and_reopen_window() test.
…() and Solution_Name_Is_Added_To_Chat_Input()
- Introduced SemaphoreSlim() for synchronization - Playwright related properties (Browser, Context, Page and Playwright) are now static Added CollectionBehavior.CollectionPerAssembly and DisableTestParallelization = true Turned off ChatLoggedBasicTests
…d(IVsCredentialKey credentialKey, String credentialValue) method.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great in the CI! Let's document how dev can add a new test and what steps devs should take when the CI fail in our CONTRIBUTING docs in a follow up. Will create a linear issue for this, thank you so much!
{ | ||
} | ||
|
||
//[VsFact(Version = VsVersion.VS2022)] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what is this for?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is for XUnit logger, which is passing calls to our Logger. Thanks to it we have nice, detailed logs from tests https://github.com/sourcegraph/cody-vs/actions/runs/10814320609/job/30000502786#step:8:88
NoBuild = true, | ||
NoRestore = true | ||
}); | ||
// DotNetTest("./Cody.VisualStudio.Tests/bin/Debug/Cody.VisualStudio.Tests.dll", new DotNetTestSettings |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we need to keep this comment?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes (it's a reminder). I will change it later, when I will finish the next part of CI updates.
CLOSE https://linear.app/sourcegraph/issue/CODY-2816/ci-for-visual-studio-integration-tests-based-on-vsixtesting
UI Tests infrastructure (
Cody.VisualStudio.Tests
) updated to allow running them, not only locally which were running fine from the very beginning, but also using GitHub Actions.Fixed threading issues only seen in GitHub Actions:
Call was Rejected By Callee
(more about it), caused PlaywrightTestsBase.InitializeAsync() was called multiple times, which internally tries to call VS API, when XUnit was creating instances of all involved test classes