Commit Graph

102 Commits

Author SHA1 Message Date
Benjamin Pasero
17a7edb8bb smoke - remove some unused methods from driver 2022-04-05 08:04:40 +02:00
Benjamin Pasero
44aea76875 💄 2022-04-04 15:47:21 +02:00
Benjamin Pasero
2ada17080c Use playwright for desktop smoke tests (#146692)
* Use `playwright` for desktop smoke tests

* fix distro issues

* tests - enable prefs tests for web
2022-04-04 10:13:08 +02:00
Robo
01df559c18 chore: update to electron 16 (#137241)
* chore: bump electron@15.3.0

* chore: bump node@16.x

* chore: enable render process reuse

* Revert "watcher - use `type` property for crash reporter location"

This reverts commit bfa488dd8f.

* Revert "watcher - enable crash reports on linux (#136264)"

This reverts commit af261488f8.

* chore: enable crashpad on linux

* chore: bump electron@15.3.1

* chore: update api changes

* chore: bump @vscode/sqlite3@5.0.3

* spec: skip non-context aware module unittests

* chore: fix perf hook integration with node environment

* fix: adopt fs api changes

* chore: fix integration tests

* chore: bump electron@15.3.2

* chore: bump electron@16.0.0

* temp(macOS): kill test instances in OSS

* Revert "temp(macOS): kill test instances in OSS"

This reverts commit b0d796c8d64227a5ec012c060bbbee7d9da27568.

* chore: update chromium version for clang downloader

* some 💄 changes

* align with changes

* adopt more fs.rm

* 💄

* chore: bump @vscode/sqlite3@5.0.4

* fix layers check to account for duplicated types from node.js

* update todo for type casts

* smoke - fix compile issue

* chore: update module cache

* watcher - fix unhandled rejection (fix #137416)

* ci: update node version

* enable stack dumping

* update electron types to 16.x

* chore: bump @vscode/sqlite3@5.0.5

Refs https://github.com/microsoft/vscode/issues/137496

* fix layer issue

* add `AbortSignal` to core types

* chore: update linux compile flags

Refs 797723ec83

* ci: fix linux build

* ci: update github ci cache

* ci: fix remote build in github ci

* ci: better fix for remote build

* chore: bump azure cache

* chore: fix merge conflict

* :chore: update to electron@16.0.2

* chore: bump @vscode/sqlite3@5.0.7

* ci: update to gcc-4.9 for remote

Refs https://github.com/microsoft/vscode/issues/137659

* ci: switch to buster for linux arm

Refs https://github.com/microsoft/vscode/issues/137927

* ci: fix build on linux arm64

* ci: fix arm client compiler toolchain

Refs #137927

* chore: bump electron@16.0.3

* ci: fix compile flags for the c toolchain

* chore: bump electron@16.0.4

* Add experimental dark mode flag (#139109)

* Add experimental dark mode flag

* Apply PR feedback

* chore: bump electron@16.0.6

* chore: bump electron@16.0.7

Fixes https://github.com/microsoft/vscode/issues/138792
Fixes https://github.com/microsoft/vscode/issues/139300

* chore: experimental highlight API

* smoke - fix compile issue

* FIXME: custom ELECTRON_RUN_AS_NODE with node worker

* Revert "chore: bump electron@16.0.7"

This reverts commit 5fd01cf37c.

* Revert "Revert "chore: bump electron@16.0.7""

This reverts commit a7f1b73951.

* chore: fix github linux workflow

* chore: address review feedback

* chore: bump electron@16.0.8

* ci: revert to stretch distro for linux arm

Refs https://github.com/microsoft/vscode/issues/137927

* ci: force build

* chore: update yarn.lock

* address feedback

* Revert "FIXME: custom ELECTRON_RUN_AS_NODE with node worker"

This reverts commit 7b48fa3732.

* ci: fix remote folder build

* chore: fix github linux ci

* 🆙 `versionSpec`

Co-authored-by: Benjamin Pasero <benjamin.pasero@microsoft.com>
Co-authored-by: Raymond Zhao <raymondzhao@microsoft.com>
2022-02-08 20:09:00 +01:00
Johannes Rieken
4a130c40ed enable @typescript-eslint/member-delimiter-style, https://github.com/microsoft/vscode/issues/140391 2022-02-02 14:35:33 +01:00
João Moreno
8c9870d298 Smoke Test: forcefully kill electron if exit doesn't work (#140570)
* smoke test: forcefully kill electron if exit doesn't work

* use tree-kill

* roll back veto
2022-01-12 17:02:52 +01:00
Benjamin Pasero
18a7108073 smoke - select tab over quick pick (#139944)
* smoke - further try to reduce usages of quick pick

* poke
2021-12-30 22:38:59 +01:00
Benjamin Pasero
99fabbdb27 smoke - more logging 2021-12-29 17:46:52 +01:00
Benjamin Pasero
b2e79a699f smoke - improve app lifecycle (#139693)
* smoke - make sure app is closed when `app.start` fails

* smoke - `capturePage` to fallback to active window

* smoke - more logging around remote resolving
2021-12-23 16:38:54 +01:00
Benjamin Pasero
fa739870a2 smoke - remove doubleClick usage 2021-12-16 14:27:21 +01:00
Benjamin Pasero
ec3ba7a320 smoke - rewrite killing 2021-12-09 07:55:25 +01:00
Benjamin Pasero
acc0803f38 cleanup automation 2021-12-09 07:03:29 +01:00
Benjamin Pasero
18cba4882d smoke - more logging 2021-12-08 15:23:27 +01:00
Benjamin Pasero
64562e2a0e smoke - reimplement logging 2021-12-08 14:13:41 +01:00
Benjamin Pasero
fbad065eea Playwright: record a trace per failing test, not suite (#138600)
* smoke - record traces per test and not entire suite

* smoke - only persist failing tests

* smoke - cleanup

* smoke - more logging

* smoke - push a test failure to proof the point

* smoke - switch back to chrome for smoke tests

* smoke - warn when exit takes 10s

* Revert "smoke - push a test failure to proof the point"

This reverts commit e572a0c40d.
2021-12-08 10:09:30 +01:00
Benjamin Pasero
13c0ed811e 🆙 playwright & set trace names (#138539) 2021-12-06 19:42:05 +01:00
Benjamin Pasero
ff970e88e5 Revert "smoke - 🆙 retry timeout"
This reverts commit d60b844aa3.
2021-12-02 07:38:04 +01:00
Benjamin Pasero
9d427e4df4 smoke test tweaks
- remove timeout on shutdown
- log exactly where time is spend on shutdown (web)
- stop spawning code when terminated
2021-12-02 07:34:13 +01:00
Benjamin Pasero
d60b844aa3 smoke - 🆙 retry timeout 2021-12-01 11:34:25 +01:00
Benjamin Pasero
e71b28a444 Smoke test lifecycle changes (#137969)
* rewrite teardown

* 💄

* avoid spam errors

* 💄

* split spawning browser from electron

* await copyExtension

* cleanup

* refactor methods

* cleanup

* cleanup

* cleanup

* 🆙 deps
2021-11-28 10:30:52 +01:00
Benjamin Pasero
df4b5d6d04 smoke - strengthen shutdown path 2021-11-26 18:08:27 +01:00
Benjamin Pasero
6f2239307b Smoke test tweaks (#137809)
* smoke - move data migration tests into one and align

* fix app starting

* `createWorkspaceFile` is not async

* 💄

* support screenshot on failure even for stable app

* smoke - try to remove timeout (#137847)

* improve exit call
2021-11-25 14:37:22 +01:00
Benjamin Pasero
954ce2c3f4 proper await exit 2021-11-23 10:31:46 +01:00
Megan Rogge
239a94cee8 remove debug log 2021-11-17 14:01:31 -08:00
Megan Rogge
00fa317c43 Add terminal profile smoke tests (#137079) 2021-11-17 14:00:01 -08:00
Benjamin Pasero
bef4dba21f Parcel update and CI improvements (#136830)
* 🆙 product

* 🆙 parcel/watcher

* 🆙 parcel/watcher

* tests - separate remote logs from others

* store server logs too

* more tweaks

* fix name

* error when 10s passed
2021-11-10 08:13:56 +01:00
Benjamin Pasero
b96644b15f smoke tests - drop 'tmp' and try to deal with tmp path ourself (#130102) 2021-08-05 10:04:00 +02:00
Benjamin Pasero
6c3bb99c63 smoke - better exit application handling 2021-08-05 09:05:17 +02:00
João Moreno
a28d028d2d Enable automated smoketests on Windows (#128224) 2021-07-08 19:10:25 +02:00
Dirk Baeumer
ae52915f0c Improve localization tests 2021-07-06 13:15:43 +02:00
Dirk Baeumer
1f2a6cc331 Improve localization smoke test 2021-06-21 13:54:16 +02:00
Benjamin Pasero
2ddc1e4fc5 Produce logs during test runs (integration, smoke) and publish as artefacts (#126065)
* first cut upload log files from integration test runs

* always publish log files

* move logs into integration-tests folder

* also produce logs for smoke tests

* store remote log files

* wire in logspath arg properly

* always publish logs

* enable logs for browser based smoke tests

* log only in verbose
2021-06-15 08:33:26 +02:00
João Moreno
85a36ae074 enable smoketest on linux 2021-06-11 12:19:17 +02:00
Benjamin Pasero
33f84b36fd tests - disable getting started in integration tests and smoke tests (#125808)
* tests - disable getting started in integration tests and smoke tests

* --skip-getting-started => --skip-welcome

Co-authored-by: Jackson Kearl <jakearl@microsoft.com>
2021-06-09 18:36:42 +00:00
Ladislau Szomoru
b0509196f6 Disable workspace trust during tests 2021-06-03 10:21:19 +02:00
João Moreno
541a5d4fa7 smoke: trust dialog should appear in 5 seconds, and we can ignore if it doesn't 2021-05-28 11:38:10 +02:00
Benjamin Pasero
041e4d9b1f fix smoke tests with stable build (fix #117420) 2021-02-23 19:04:51 +01:00
Benjamin Pasero
9de38fc9a8 Disable keytar in our integration tests (#116852)
* tests - extract and use ALL_PLATFORMS_API_TESTS_EXTRA_ARGS

* tests - throw when accessing keytar from API tests
2021-02-17 15:09:40 +01:00
Sandeep Somavarapu
066c584405 enable remote smoke tests 2021-02-03 19:20:44 +01:00
Martin Aeschlimann
4bd2d367e7 Remote smoketest timeout (fixes #115159) 2021-01-27 15:52:25 +01:00
Benjamin Pasero
781e0e3192 windows - remove not needed and confusing disable-restore-windows CLI arg 2020-10-01 11:36:45 +02:00
Benjamin Pasero
d41ca1ce5f tests - also use --no-cached-data for normal integration tests 2020-06-09 10:29:01 +02:00
Rob Lourens
4d6da3154c Get notebook smoketest working in web
Fix #98364
2020-06-07 17:27:47 -05:00
Rob Lourens
9bc11824c3 Add notebook smoketests 2020-05-20 12:01:52 -05:00
Benjamin Pasero
6a8b201c8a smoke - restore skip-release-notes CLI arg (#96459) 2020-04-29 12:40:04 +02:00
Benjamin Pasero
9f1aa3c9fe debt - remove node pieces from environment (#82598) 2020-04-06 09:12:41 +02:00
Benjamin Pasero
88d189b479 quick access - more renames towards less quick open usage 2020-03-26 13:38:59 +01:00
Benjamin Pasero
29c2c6079e smoke - do not restore windows 2020-02-26 12:03:05 +01:00
Joao Moreno
f0066fe680 automation: refactor web tests not to use outPath 2020-02-26 11:55:48 +01:00
Benjamin Pasero
35379aba75 smoke - headless option is troublesome 2020-02-11 17:35:53 +01:00