Commit Graph

1134 Commits

Author SHA1 Message Date
Megan Rogge
a2b7750527 skip a11y test vs failing if timeout occurs (#298058) 2026-02-26 18:47:05 +00:00
Martin Aeschlimann
c0e2678a6a Naming of instructions files, use constants, make consistent (#297742)
* Naming of instruction files, use constants, make consistent

* update

* update
2026-02-26 10:26:43 +01:00
Benjamin Pasero
e372e6a288 smoke - remove skipped test (#295795) 2026-02-17 09:11:15 -08:00
copilot-swe-agent[bot]
f6fbcd535a Fix terminal persistence test by setting stable title format
Set terminal.integrated.tabs.title to ${process} to ensure consistent
terminal names for detach/attach operations in the smoke test. This
prevents name mismatches on Windows where the default title format
may include dynamic content.

Fixes failing test: Terminal Persistence -> detach/attach -> should support basic reconnection

Co-authored-by: Tyriar <2193314+Tyriar@users.noreply.github.com>
2026-02-11 21:12:10 +00:00
Robo
3832ddc648 fix: associate extHost lifecycle to window (#293144)
* fix: associate extHost lifecycle to window

* fix: skip the smoke test in remote

The reload scenario doesn't guarantee a proper cleanup of
the remote server via the test-resolver extension.

* fix: flaky condition

* chore: disable extension setup in remote
2026-02-06 05:31:19 +09:00
Alex Ross
833ea644b8 Skip install and enable vscode-smoketest-check extension (#293111)
See https://github.com/microsoft/vscode/issues/293108
2026-02-05 14:53:55 +00:00
Alex Ross
dd683d8b8c BUILD: Revert "fix: associate extHost lifecycle to window" (#293053)
Revert "fix: associate extHost lifecycle to window (#292672)"

This reverts commit b22bccfc65.
2026-02-05 09:22:21 +00:00
Megan Rogge
f54be1c26f fix flakey test (#292874) 2026-02-04 17:30:27 +00:00
Robo
27b960f73d fix: flaky chat accessibility smoke tests (#292859) 2026-02-04 10:38:25 -06:00
Robo
b22bccfc65 fix: associate extHost lifecycle to window (#292672)
* fix: associate extHost lifecycle to window

* chore: update test/smoke/src/areas/extensions/extension-host-restart.test.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: add grace period when tracking extension host lifecycle

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2026-02-04 11:42:45 +01:00
Robo
d0e516655a fix: rename product executable on macOS (#291948)
* fix: rename product executable name on macOS

* chore: update test/automation/src/electron.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* chore: update test/automation/src/electron.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* chore: rename in additional places

* chore: rename in code-perf.js

* chore: create symlink for backwards compatibility

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2026-02-03 14:50:21 -08:00
Megan Rogge
80e6a921e8 add aria label for todo clear button, fix a11y smoketest violation (#292671)
fixes #292665
2026-02-03 13:10:06 -08:00
Megan Rogge
2f87e3fa5d add chat response tests, discover and fix a11y issues (#286622) 2026-02-03 11:06:14 -08:00
Benjamin Pasero
1adb77d0f4 can send a chat message with anonymous access (fix #292582) (#292593) 2026-02-03 17:04:40 +00:00
Benjamin Pasero
159ca554bf smoke - make chat anonymous test less flaky (#292569) 2026-02-03 14:57:22 +00:00
Benjamin Pasero
1951d88056 Chat Anonymous: can send a chat message with anonymous access (fix #292296) (#292341) 2026-02-02 17:14:52 +00:00
Matt Bierner
e6f0ffde9c Merge pull request #291937 from mjbvz/dev/mjbvz/severe-buzzard
Update build ts versions
2026-01-31 15:34:15 -08:00
Copilot
b31c729a39 Add smoke test for anonymous chat access (#291953)
* Initial plan

* Add smoke test for anonymous chat access

Co-authored-by: bpasero <900690+bpasero@users.noreply.github.com>

* fix

* .

* .

* .

* .

* .

* .

* .

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: bpasero <900690+bpasero@users.noreply.github.com>
Co-authored-by: Benjamin Pasero <benjamin.pasero@microsoft.com>
2026-01-31 16:33:11 +00:00
Matt Bierner
ee01088b74 Update roots 2026-01-30 13:12:58 -08:00
Benjamin Pasero
e2144d22df refactor - improve workspace path handling in smoke tests (#287706) 2026-01-14 06:53:34 +00:00
Peng Lyu
e64d58389d vscode mcp: support custom workspace path; enable restart tool (#286297)
* vscode mcp: support specifying workspace path; enable restart tool

* fix: include workspace path in launch options for browser

* fix: ensure workspace path is set for tests requiring a workspace

* Address PR review comments: support optional workspace path

* fix: standardize workspace path variable naming in tests

* fix: fallback to rootPath for workspacePath in CI environments
2026-01-13 16:38:31 -08:00
meganrogge
29068277e3 fixes #286855 2026-01-09 18:37:00 -06:00
Megan Rogge
9b90136ce3 skip smoke test for web on mac (#286808)
skip for web on mac
2026-01-09 19:42:03 +00:00
Megan Rogge
4e9a8da2de fix flaky smoke test 🤞🏼 (#286806)
fixes #286804
2026-01-09 19:30:31 +00:00
Megan Rogge
bf90c47890 Bring back a11y smoke tests, add exclusion for flake case (#286773)
fixes #286704
2026-01-09 17:03:15 +00:00
Benjamin Pasero
8edf92d2af debt - update esbuild@0.27.2 (#286687) 2026-01-09 10:53:03 +00:00
Megan Rogge
9986468dd2 add accessibility tests for more of the workbench (#286446) 2026-01-08 21:33:47 +01:00
Ladislau Szomoru
dd65f0c5ef Engineering - switch from npm-run-all to npm-run-all2 (#284087)
* Introduce compilation error

* Engineering - limit the tasks that we run

* Limit available memory to simulate an OOM

* Try to update the task

* Remove the use of npm-run-all

* Fix script

* Another try

* Try npm-run-all2

* Restore tasks, keep npm-run-all2

* Switch from npm-run-all to npm-run-all2

* Revert changes that were used for testing
2026-01-05 15:49:42 +01:00
Aaron Munger
4290065b29 notebook tests still failing too often (#283882)
still failing too often
2025-12-16 19:29:08 +00:00
Benjamin Pasero
3cd24f525e Screencheese issue in empty chat welcome view (fix #273827) (#283819) (#283825)
docs - update log file retrieval instructions
2025-12-16 15:13:27 +00:00
Raymond Zhao
41997d514d chore: npm audit fix (#279437)
* chore: npm audit fix

* chore: npm audit fix in extensions

* chore: npm audit fix in tests

* Catch last few
2025-11-25 20:29:09 +00:00
Daniel Imms
e65fbaa63e Also clear scrollback in smoke tests 2025-11-14 11:23:37 -08:00
Aaron Munger
8e0a21f36d enable a few notebook smoke tests (#276793)
* more strenuous add/delete cell check

* unskip some tests
2025-11-11 17:12:27 -08:00
Matt Bierner
19606fb407 Fix in smoke tests 2025-11-10 10:31:47 -08:00
Benjamin Pasero
cb11538020 MCP related actions need to hide when AI features are disabled (fix #275478) (#275840) 2025-11-06 15:53:29 +00:00
Aaron Munger
ebd995adee disable flaky test (#275414) 2025-11-05 00:02:59 +00:00
Benjamin Pasero
08d06ad8c1 smoke - more checks for AI test (#274002)
* smoke - more checks for AI test

* change to set
2025-10-30 08:24:49 +01:00
Benjamin Pasero
6808f75d53 chat - add a smoke test to check for AI disabling support (#273940) 2025-10-29 13:16:26 +00:00
Matt Bierner
2f5b1d0cc4 Enforce single quote strings in tests too
Fixes #271473

Final pass of fixes and removes the exception for test files
2025-10-15 11:33:45 -07:00
Aaron Munger
32fbf1d72e skip all but the simplest (#270790) 2025-10-10 10:52:12 -07:00
Aaron Munger
57409952f0 re-enable tests to look for failure (#270299)
* re-enable tests to look for failure

* edit to focus back in the cell

* make command available for smoke test
2025-10-10 10:01:16 -07:00
João Moreno
abb3be88db isolate smoke test runs between type (#269021)
also, move some fs calls to sync
also, increase retryDelay for rmSync
fixes #268437
2025-09-30 08:20:08 +00:00
Tyler James Leonhardt
443daf8d60 Allow configuring userDataDir, ExtensionDir, & usage of in-memory Secret Storage (#263451)
* Allow configuring userDataDir, ExtensionDir, & usage of in-memory Secret Storage

ref https://github.com/microsoft/vscode/issues/262164

* fix a couple references of getRandomUserDataDir
2025-08-27 15:31:27 -04:00
Tyler James Leonhardt
d436b22dca Allow modals in automation (#262808) 2025-08-22 15:54:31 +02:00
Tyler James Leonhardt
6e36a27f3c Revert "Allow modals in automation" (#262806)
Revert "Allow modals in automation (#262510)"

This reverts commit 038c39cd5c.
2025-08-21 23:23:25 +00:00
Tyler James Leonhardt
038c39cd5c Allow modals in automation (#262510)
* Allow modals in automation

This allows for the opt-in behavior of allowing dialogs while using automation.

When opted in, we also switch over to using custom dialogs & the simple file picker so that the automation can control it.

This was added so that we can do auth flows, which uses dialogs. Now we will be able to complete an auth flow (with the help of the user in the browser) and automate interacting with chat via the development MCP server.

* Instead use custom for smoke tests

* Go back to command but have a context key for automation

* Workaround terminal smoke tests
2025-08-21 18:07:11 -04:00
Copilot
a496091135 Fix smoke test directory conflicts by adding unique workspace path suffixes (#262268) 2025-08-19 12:57:48 +02:00
Benjamin Pasero
55377133de Smoke-test failure: directory not empty (fix #260110) (#260121) 2025-08-06 16:00:13 +00:00
Benjamin Pasero
27c10fba46 [chore] bump @types/mocha to match mocha (#260034) 2025-08-06 11:54:24 +00:00
Matt Bierner
e51d57aa5c Update target for build and test scripts 2025-08-04 17:28:08 -07:00