Commit Graph

851 Commits

Author SHA1 Message Date
Megan Rogge
a2f5ec29b2 Revert "Revert "be sure that terminal target gets set for the instance (#138875)""
This reverts commit 8605d7aeff.
2021-12-13 17:08:29 -06:00
Megan Rogge
0602587ff2 re-enable smoke tests, keep editor fix (#139012) 2021-12-13 12:50:58 -06:00
Rob Lourens
7e4942dcb7 Revert "Re-enable additional notebook smoke tests"
This reverts commit b3b9d4e2e7.
2021-12-13 09:18:17 -08:00
Daniel Imms
8605d7aeff Revert "be sure that terminal target gets set for the instance (#138875)"
This reverts commit 578eb0d4ae.
2021-12-13 08:15:32 -08:00
Matt Bierner
b3b9d4e2e7 Re-enable additional notebook smoke tests
For #126371

These pass for me locally
2021-12-10 17:08:02 -08:00
Matt Bierner
02c3551a59 Re-enable notebook smoke suite
For #126371

This single test passes for me. Will look at re-enabling individual tests next
2021-12-10 17:01:02 -08:00
Megan Rogge
86ee106054 skip failing tests 2021-12-10 16:06:13 -08:00
Megan Rogge
578eb0d4ae be sure that terminal target gets set for the instance (#138875) 2021-12-10 14:51:45 -08:00
Daniel Imms
69dcf8b0f6 Revert "Re-enable tests now that runCommandWithValue is more reliable"
This reverts commit 4554eac76d.
2021-12-10 13:05:53 -08:00
Daniel Imms
4554eac76d Re-enable tests now that runCommandWithValue is more reliable
Part of #138658
2021-12-10 10:59:40 -08:00
Benjamin Pasero
c5ea0fa337 fix some recent test failures 2021-12-10 14:34:14 +01:00
Benjamin Pasero
05de5834b0 smoke - add test to verify an editor can be saved 2021-12-10 13:45:08 +01:00
Benjamin Pasero
4667cac14b smoke - more obvious tests setup 2021-12-10 13:32:08 +01:00
Rob Lourens
e5637ce9af Fix #138748 2021-12-09 10:00:25 -08:00
Johannes Rieken
ee3e404b71 disable failing smoketest, https://github.com/microsoft/vscode/issues/138748 2021-12-09 12:53:27 +01:00
Benjamin Pasero
c04c29d496 smoke - mention playwright trace website 2021-12-09 12:36:41 +01:00
Benjamin Pasero
9c7387bb5a smoke - bring back stable smoke tests 2021-12-09 11:05:41 +01:00
Benjamin Pasero
27e38a8e27 smoke - always create screenshot on failure on desktop 2021-12-09 09:51:55 +01:00
Benjamin Pasero
ae0ee547ba smoke - reimplement test handlers 2021-12-09 09:33:51 +01:00
Benjamin Pasero
158bd2507e smoke - always have a logger 2021-12-09 08:48:42 +01:00
Benjamin Pasero
acc0803f38 cleanup automation 2021-12-09 07:03:29 +01:00
Rob Lourens
1341ca3d7f Remove timeouts in search smoketest.
Improvements came from waiting for search to complete before clicking buttons, clearing previous results before starting the search, and adding a retry around the clicking.
2021-12-08 15:34:35 -08:00
Benjamin Pasero
18cba4882d smoke - more logging 2021-12-08 15:23:27 +01:00
Benjamin Pasero
64562e2a0e smoke - reimplement logging 2021-12-08 14:13:41 +01:00
Benjamin Pasero
2c68d4de7e smoke - always log with trace 2021-12-08 10:50:27 +01:00
Benjamin Pasero
fbad065eea Playwright: record a trace per failing test, not suite (#138600)
* smoke - record traces per test and not entire suite

* smoke - only persist failing tests

* smoke - cleanup

* smoke - more logging

* smoke - push a test failure to proof the point

* smoke - switch back to chrome for smoke tests

* smoke - warn when exit takes 10s

* Revert "smoke - push a test failure to proof the point"

This reverts commit e572a0c40d.
2021-12-08 10:09:30 +01:00
Benjamin Pasero
13c0ed811e 🆙 playwright & set trace names (#138539) 2021-12-06 19:42:05 +01:00
Benjamin Pasero
2085b19a51 smoke - allow 30s max for deleting test path (#137725) 2021-12-06 14:09:02 +01:00
Benjamin Pasero
e8e0fb874d smoke - disable test that is flaky still 2021-12-06 13:44:01 +01:00
Benjamin Pasero
fe227dacb7 lifecycle - introduce and adopt finalVeto for backups (#138055) 2021-12-06 11:16:57 +01:00
Benjamin Pasero
e1caacebce backup - cancel pending operations on shutdown and handle cancellation better (#138055) 2021-12-06 10:55:33 +01:00
Benjamin Pasero
9d427e4df4 smoke test tweaks
- remove timeout on shutdown
- log exactly where time is spend on shutdown (web)
- stop spawning code when terminated
2021-12-02 07:34:13 +01:00
Megan Rogge
4a21019476 fix #138238, skip failing test 2021-12-01 08:50:26 -08:00
Megan Rogge
c0f21fa378 fix #138239, skip test 2021-12-01 08:38:28 -08:00
Megan Rogge
7b3078d931 fix #137795 2021-11-30 12:48:58 -08:00
Megan Rogge
7f7fad2f9e fix #137798 2021-11-30 12:38:52 -08:00
Daniel Imms
faf6f0e1fd Setup terminal tests for 3 retries to minimize impact on build
This isn't a great long term solution but it should help reduce failures
for now.

Part of #137725
2021-11-30 12:19:10 -08:00
Megan Rogge
005947e3b8 fix #137722
fix #137808
2021-11-30 11:54:28 -08:00
Megan Rogge
e89889fe54 fix #137799 2021-11-30 11:21:01 -08:00
Megan Rogge
18725fc147 set default profile to pwsh for only windows for #137225 2021-11-30 10:57:59 -08:00
Megan Rogge
4be98a3bce set default to pwsh instead of bash for #137725 2021-11-30 10:21:15 -08:00
Benjamin Pasero
7b6c1065c7 smoke - temporary bring back timeout 2021-11-30 11:04:39 +01:00
Benjamin Pasero
1af6cb0edc smoke test tweaks 2021-11-29 17:53:11 +01:00
Benjamin Pasero
e241749320 smoke - print more backup info 2021-11-29 14:05:40 +01:00
Benjamin Pasero
5bb653374f smoke - diagnose failing backup test 2021-11-29 09:56:19 +01:00
Benjamin Pasero
cbbba8e69a smoke - unique user data dir for stable tests too 2021-11-29 09:11:23 +01:00
Benjamin Pasero
c42793d035 smoke - do not fail build when unable to delete workspace folder (workaround #137725) 2021-11-29 08:49:37 +01:00
Benjamin Pasero
a5efd80ee0 Revert "smoke - print task list when deleting workspace path fails"
This reverts commit 368154bd0b.
2021-11-29 08:46:35 +01:00
Benjamin Pasero
368154bd0b smoke - print task list when deleting workspace path fails 2021-11-29 08:04:30 +01:00
Benjamin Pasero
e71b28a444 Smoke test lifecycle changes (#137969)
* rewrite teardown

* 💄

* avoid spam errors

* 💄

* split spawning browser from electron

* await copyExtension

* cleanup

* refactor methods

* cleanup

* cleanup

* cleanup

* 🆙 deps
2021-11-28 10:30:52 +01:00