Commit Graph

1990 Commits

Author SHA1 Message Date
Dmitriy Vasyura
9d61d1947f Add more logging to sanity test runner (#298664) 2026-03-02 11:50:36 +01:00
dependabot[bot]
d1d66da10a Bump minimatch from 3.1.2 to 3.1.5 in /test/integration/browser (#298658)
Bumps [minimatch](https://github.com/isaacs/minimatch) from 3.1.2 to 3.1.5.
- [Changelog](https://github.com/isaacs/minimatch/blob/main/changelog.md)
- [Commits](https://github.com/isaacs/minimatch/compare/v3.1.2...v3.1.5)

---
updated-dependencies:
- dependency-name: minimatch
  dependency-version: 3.1.5
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-02 08:53:34 +00:00
dependabot[bot]
e2344f9b6b Bump minimatch from 9.0.6 to 9.0.9 in /test/sanity (#298126)
Bumps [minimatch](https://github.com/isaacs/minimatch) from 9.0.6 to 9.0.9.
- [Changelog](https://github.com/isaacs/minimatch/blob/main/changelog.md)
- [Commits](https://github.com/isaacs/minimatch/compare/v9.0.6...v9.0.9)

---
updated-dependencies:
- dependency-name: minimatch
  dependency-version: 9.0.9
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-27 17:36:27 +00:00
Henning Dieterichs
77ec1740b7 updates baseline 2026-02-27 17:58:11 +01:00
Dmitriy Vasyura
a0a6cd83e2 Improve sanity tests stability (#298253) 2026-02-27 16:06:37 +00:00
Ben Villalobos
9ba3e6af04 Revert "Bump hono from 4.12.0 to 4.12.3 in /test/mcp" (#298137)
Revert "Bump hono from 4.12.0 to 4.12.3 in /test/mcp (#298076)"

This reverts commit 4ce5eb1a83.
2026-02-27 01:35:36 +00:00
dependabot[bot]
4ce5eb1a83 Bump hono from 4.12.0 to 4.12.3 in /test/mcp (#298076)
Bumps [hono](https://github.com/honojs/hono) from 4.12.0 to 4.12.3.
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.12.0...v4.12.3)

---
updated-dependencies:
- dependency-name: hono
  dependency-version: 4.12.3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-26 15:47:44 -08:00
Megan Rogge
a2b7750527 skip a11y test vs failing if timeout occurs (#298058) 2026-02-26 18:47:05 +00:00
Martin Aeschlimann
c0e2678a6a Naming of instructions files, use constants, make consistent (#297742)
* Naming of instruction files, use constants, make consistent

* update

* update
2026-02-26 10:26:43 +01:00
dependabot[bot]
0aa520dbb9 Bump minimatch from 9.0.5 to 9.0.6 in /test/sanity (#297542)
Bumps [minimatch](https://github.com/isaacs/minimatch) from 9.0.5 to 9.0.6.
- [Changelog](https://github.com/isaacs/minimatch/blob/main/changelog.md)
- [Commits](https://github.com/isaacs/minimatch/compare/v9.0.5...v9.0.6)

---
updated-dependencies:
- dependency-name: minimatch
  dependency-version: 9.0.6
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 22:20:25 -08:00
Dmitriy Vasyura
d0f203e76f Add Win32 metadata all executable binaries (#296710) 2026-02-24 09:29:02 +01:00
Henning Dieterichs
5c4204e60d updates component explorer 2026-02-23 22:44:44 +01:00
Henning Dieterichs
2650c907f6 use git lfs (#297013) 2026-02-23 17:11:15 +01:00
dependabot[bot]
0bafbc18b3 Bump hono from 4.11.7 to 4.12.0 in /test/mcp (#296460)
Bumps [hono](https://github.com/honojs/hono) from 4.11.7 to 4.12.0.
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.11.7...v4.12.0)

---
updated-dependencies:
- dependency-name: hono
  dependency-version: 4.12.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-23 15:58:16 +01:00
Henning Dieterichs
bdd6e80b9f update screenshot baselines from CI 2026-02-23 12:50:38 +01:00
Dmitriy Vasyura
ee401a1256 Sanity tests perf improvements (#296248) 2026-02-22 16:55:53 +00:00
Henning Dieterichs
1cc58eb412 update screenshot baselines from CI 2026-02-20 19:57:07 +01:00
Henning Dieterichs
2751fb4d2f adds component explorer 2026-02-20 19:57:07 +01:00
Daniel Imms
c5f3a8b400 Merge pull request #295803 from microsoft/dependabot/npm_and_yarn/test/mcp/ajv-8.18.0
Bump ajv from 8.17.1 to 8.18.0 in /test/mcp
2026-02-17 10:10:07 -08:00
Benjamin Pasero
e372e6a288 smoke - remove skipped test (#295795) 2026-02-17 09:11:15 -08:00
dependabot[bot]
8c2e00c9e0 Bump ajv from 8.17.1 to 8.18.0 in /test/mcp
Bumps [ajv](https://github.com/ajv-validator/ajv) from 8.17.1 to 8.18.0.
- [Release notes](https://github.com/ajv-validator/ajv/releases)
- [Commits](https://github.com/ajv-validator/ajv/compare/v8.17.1...v8.18.0)

---
updated-dependencies:
- dependency-name: ajv
  dependency-version: 8.18.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-02-17 16:58:51 +00:00
Dmitriy Vasyura
44166499c1 Type slower to attempt fix flaky sanity test (#295722) 2026-02-17 10:06:11 +01:00
Dmitriy Vasyura
8e56833278 Implement GitHub authentication flows in CLI tests (#295386) 2026-02-14 20:42:38 -08:00
Dmitriy Vasyura
104123aaee Merge pull request #295063 from microsoft/dev/dmitriv/flaky-download-fix
Add retries for target download logic in sanity tests
2026-02-12 16:56:59 -08:00
dependabot[bot]
a3e466a735 Bump qs from 6.14.1 to 6.14.2 in /test/mcp (#295038)
Bumps [qs](https://github.com/ljharb/qs) from 6.14.1 to 6.14.2.
- [Changelog](https://github.com/ljharb/qs/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ljharb/qs/compare/v6.14.1...v6.14.2)

---
updated-dependencies:
- dependency-name: qs
  dependency-version: 6.14.2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-12 13:46:31 -08:00
Dmitriy Vasyura
e72a9f54d6 Sanity test updates (#294782) 2026-02-12 10:36:23 +01:00
copilot-swe-agent[bot]
f6fbcd535a Fix terminal persistence test by setting stable title format
Set terminal.integrated.tabs.title to ${process} to ensure consistent
terminal names for detach/attach operations in the smoke test. This
prevents name mismatches on Windows where the default title format
may include dynamic content.

Fixes failing test: Terminal Persistence -> detach/attach -> should support basic reconnection

Co-authored-by: Tyriar <2193314+Tyriar@users.noreply.github.com>
2026-02-11 21:12:10 +00:00
dependabot[bot]
fee2867942 Bump @modelcontextprotocol/sdk from 1.25.2 to 1.26.0 in /test/mcp (#292929)
Bumps [@modelcontextprotocol/sdk](https://github.com/modelcontextprotocol/typescript-sdk) from 1.25.2 to 1.26.0.
- [Release notes](https://github.com/modelcontextprotocol/typescript-sdk/releases)
- [Commits](https://github.com/modelcontextprotocol/typescript-sdk/compare/v1.25.2...v1.26.0)

---
updated-dependencies:
- dependency-name: "@modelcontextprotocol/sdk"
  dependency-version: 1.26.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-06 18:54:04 +00:00
Robo
3832ddc648 fix: associate extHost lifecycle to window (#293144)
* fix: associate extHost lifecycle to window

* fix: skip the smoke test in remote

The reload scenario doesn't guarantee a proper cleanup of
the remote server via the test-resolver extension.

* fix: flaky condition

* chore: disable extension setup in remote
2026-02-06 05:31:19 +09:00
Alex Ross
833ea644b8 Skip install and enable vscode-smoketest-check extension (#293111)
See https://github.com/microsoft/vscode/issues/293108
2026-02-05 14:53:55 +00:00
Alex Ross
dd683d8b8c BUILD: Revert "fix: associate extHost lifecycle to window" (#293053)
Revert "fix: associate extHost lifecycle to window (#292672)"

This reverts commit b22bccfc65.
2026-02-05 09:22:21 +00:00
Megan Rogge
b40b1dbc3f improve specificity for chat selector to fix smoketest (#292922) 2026-02-04 12:36:26 -08:00
Megan Rogge
f54be1c26f fix flakey test (#292874) 2026-02-04 17:30:27 +00:00
Robo
27b960f73d fix: flaky chat accessibility smoke tests (#292859) 2026-02-04 10:38:25 -06:00
Robo
b22bccfc65 fix: associate extHost lifecycle to window (#292672)
* fix: associate extHost lifecycle to window

* chore: update test/smoke/src/areas/extensions/extension-host-restart.test.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: add grace period when tracking extension host lifecycle

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2026-02-04 11:42:45 +01:00
Robo
d0e516655a fix: rename product executable on macOS (#291948)
* fix: rename product executable name on macOS

* chore: update test/automation/src/electron.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* chore: update test/automation/src/electron.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* chore: rename in additional places

* chore: rename in code-perf.js

* chore: create symlink for backwards compatibility

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2026-02-03 14:50:21 -08:00
Megan Rogge
80e6a921e8 add aria label for todo clear button, fix a11y smoketest violation (#292671)
fixes #292665
2026-02-03 13:10:06 -08:00
Megan Rogge
2f87e3fa5d add chat response tests, discover and fix a11y issues (#286622) 2026-02-03 11:06:14 -08:00
Benjamin Pasero
1adb77d0f4 can send a chat message with anonymous access (fix #292582) (#292593) 2026-02-03 17:04:40 +00:00
Robo
2bf84bff1b chore: update missing lock file changes (#292584) 2026-02-03 16:23:02 +00:00
Benjamin Pasero
159ca554bf smoke - make chat anonymous test less flaky (#292569) 2026-02-03 14:57:22 +00:00
Tyler James Leonhardt
c8d90ab45f Get rid of dependency on playwright-mcp (#292432) 2026-02-02 23:16:17 -08:00
Peng Lyu
5366853409 Support multi window scenarios in vscode mcp server (#289250)
* Add window management tools for multi-window support

* Refactor window management tools to remove title references and simplify responses

* Refactor PlaywrightDriver to use readonly page property and remove _currentPage references

* Update test/mcp/src/automationTools/windows.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Fix URL matching and CDP session handling in multi-window support (#289261)

* Initial plan

* Address code review feedback: improve URL matching and CDP session handling

- Improve URL matching in switchToWindow to prefer exact matches before substring matches
- Clear CDP session when switching windows to prevent using stale sessions
- Add comprehensive documentation explaining the matching strategy and CDP session behavior

Co-authored-by: rebornix <876920+rebornix@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: rebornix <876920+rebornix@users.noreply.github.com>

* Add automation tools for window interactions and update multiplex server configuration

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: rebornix <876920+rebornix@users.noreply.github.com>
2026-02-02 16:11:12 -08:00
Dmitriy Vasyura
0e1c5103cd Remove macOS signing checks exclusions (#291875) 2026-02-02 09:24:43 -08:00
Benjamin Pasero
1951d88056 Chat Anonymous: can send a chat message with anonymous access (fix #292296) (#292341) 2026-02-02 17:14:52 +00:00
Matt Bierner
e6f0ffde9c Merge pull request #291937 from mjbvz/dev/mjbvz/severe-buzzard
Update build ts versions
2026-01-31 15:34:15 -08:00
Copilot
b31c729a39 Add smoke test for anonymous chat access (#291953)
* Initial plan

* Add smoke test for anonymous chat access

Co-authored-by: bpasero <900690+bpasero@users.noreply.github.com>

* fix

* .

* .

* .

* .

* .

* .

* .

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: bpasero <900690+bpasero@users.noreply.github.com>
Co-authored-by: Benjamin Pasero <benjamin.pasero@microsoft.com>
2026-01-31 16:33:11 +00:00
Matt Bierner
ee01088b74 Update roots 2026-01-30 13:12:58 -08:00
Dmitriy Vasyura
f905cf48fc Add CLI DevTunnel sanity test (#291813)
* Add CLI -> DevTunnel -> Web tests

* PR feedback
2026-01-30 20:31:33 +09:00
Dmitriy Vasyura
4ac8b5ed98 Enable Windows ARM sanity tests on the new pool (#291753)
* Enable Windows ARM sanity tests on the new pool

* Update README
2026-01-29 23:30:36 +00:00