Connor Peet
8730f56c09
eng: add io warmup for webkit tests in ci ( #193711 )
...
Should fix the issue that @roblourens and @Yoyokrazy were hitting with snapshot tests on macOS WebKit in CI. Not pretty, but I'd rather do this than spend a bunch of time chasing down something that certainly seems to be a browser issue.
2023-09-21 11:03:20 -07:00
Connor Peet
6a847ba6d1
eng: add support for snapshot tests ( #190444 )
...
* eng: add support for snapshot tests
This adds Jest-like support for snapshot testing.
Developers can do something like:
```js
await assertSnapshot(myComplexObject)
```
The first time this is run, the snapshot expectation file is written
to a `__snapshots__` directory beside the test file. Subsequent runs
will compare the object to the snapshot, and fail if it doesn't match.
You can see an example of this in the test for snapshots themselves!
After a successful run, any unused snapshots are cleaned up. On a failed
run, a gitignored `.actual` snapshot file is created beside the
snapshot for easy processing and inspection.
Shortly I will do some integration with the selfhost test extension to
allow developers to easily update snapshots from the vscode UI.
For #189680
cc @ulugbekna @hediet
* fix async stacktraces getting clobbered
* random fixes
* comment out leak detector, for now
* add option to snapshot file extension
2023-08-15 12:03:51 -07:00
Benjamin Pasero
424388032a
tests - increase timeout when running in CI ( #182288 )
2023-05-12 13:02:15 +02:00
Robo
e5f61433b5
chore: update to Electron 22 ( #177600 )
...
* Revert "chore: revert to Electron 19 (#175851 )"
This reverts commit 3a11b47eee#178919 )
* Revert "chore: revert to Electron 19 (#175851 )"
This reverts commit 3a11b47eee💄
* compile
---------
Co-authored-by: deepak1556 <hop2deep@gmail.com >
---------
Co-authored-by: Benjamin Pasero <benjamin.pasero@microsoft.com >
2023-04-03 09:09:31 +02:00
Alexandru Dima
06b97f6be7
Add more logging and perf markers around resolving the connection token and the socket factory ( #170490 )
...
* Add more logging and perf markers around resolving the connection token and the socket factory
* set `exposeFunction` earlier
* bla windows
* also expose function for unit tests beofre opening
Co-authored-by: Benjamin Pasero <benjamin.pasero@microsoft.com >
2023-01-05 10:17:19 +01:00
Benjamin Pasero
86e7410278
unit tests - help diagnose test failure reason for web tests ( #155967 )
2022-07-22 18:50:34 +02:00
Alexandru Dima
3530e85ba8
Properly return a non 0 exit code in case a test times out and fix tests which used to time out ( #152329 )
2022-06-16 13:02:37 +00:00
Johannes
0656d21d11
auto-fixed prefer-const violation
2022-06-08 17:49:21 +02:00
Benjamin Pasero
2ada17080c
Use playwright for desktop smoke tests ( #146692 )
...
* Use `playwright` for desktop smoke tests
* fix distro issues
* tests - enable prefs tests for web
2022-04-04 10:13:08 +02:00
Alex Dima
cab9713422
Fixes #141994 : Address eslint problems
2022-02-02 13:18:12 +01:00
Benjamin Pasero
9be2757019
🆙 playwright@1.18 ( #140767 )
...
* tests - use `@playwright/test@1.18 .0-rc1`
* fix bad dependency
* clear more weird ts dependencies
2022-01-15 09:35:39 +01:00
Benjamin Pasero
af5de88a44
tests - add --sequential option and use in CI runs
2022-01-11 10:48:20 +01:00
Connor Peet
fa9255c0de
almost complete update for run configurations
2021-07-12 17:28:01 -07:00
Connor Peet
583f6d1418
open the devtools for browser tests when debug is passed
2021-07-07 12:58:19 -07:00
Robo
92999c339e
fix: setuid helper permission ( #126798 )
...
* ci: fix setuid helper binary permission
* ci: allow privilege for CLONE_NEWPID | CLONE_NEWNET
* ci: fix chrome-sandbox permission with rpm
* ci: fix permissions on snap
* ci: download electron earlier for arm builds
2021-06-22 08:42:30 -07:00
Benjamin Pasero
e2954beb4b
Remove --no-sandbox ( #122909 )
...
* linux - remove `--no-sandbox` flag
We should not disable sandbox on Linux.
We only added this to support running on Kernel <= 3.8 where setuid sandbox is used.
* fix ci
* add some docs
2021-05-04 11:18:19 +02:00
Benjamin Pasero
7a6a45fb2c
browser tests - fix regression from updating playwright
2021-02-02 16:53:30 +01:00
Johannes Rieken
b90166177b
reuse stats collector for EchoRunner, fix missing titlePath-property, fixes https://github.com/microsoft/vscode/issues/114190
2021-01-12 11:21:32 +01:00
Connor Peet
04d7411785
eng: update mocha 2 -> 8
2020-12-17 11:24:15 -08:00
Ladislau Szomoru
41b661eb3d
Add process.arch into unit test results file names
2020-08-18 18:08:37 +02:00
Ladislau Szomoru
cf4e4c1754
Add JUnit reporter for unit tests ( #104354 )
2020-08-10 11:20:34 +02:00
Benjamin Pasero
45552c0a2d
sandbox - reduce clipboard dependencies in renderer
2020-05-26 08:12:09 +02:00
Benjamin Pasero
9f45c20088
🆙 playwright@0.15.0 ( #96218 )
...
* playwright@0.15 .0
* close to dumpio: true
* reduce logging
2020-04-27 08:50:50 +02:00
Johannes Rieken
0549900aa5
run web-unit-tests in chromium, webkit, and firefox
...
@bpasero fyi that I have disabled the "editor observer copy group" test for web
2020-04-07 10:47:23 +02:00
Matt Bierner
273a4a389d
Convert most ts-ignore-calls to ts-expect-error ( #93617 )
...
Changes over to use ts-expect-error: https://devblogs.microsoft.com/typescript/announcing-typescript-3-9-beta/#ts-expect-error-comments
This revealed a number of places where we no longer need to supress errors
2020-03-30 17:31:37 -07:00
Benjamin Pasero
a7ed9c9572
🆙 playwright@0.11.0 ( #90663 )
2020-02-14 09:56:08 +01:00
Benjamin Pasero
4b359a57a5
build - address some issues
...
- run local and remote integration tests separately
- enable playwright on Linux with -no-sandbox trick
2020-02-12 12:07:44 +01:00
Benjamin Pasero
cdf4026fb6
Add browser unit tests to product build ( #90353 )
...
* wip - add browser unit tests to product build
* run with more output
* load loader via script tag
2020-02-10 12:44:28 +01:00
Johannes Rieken
f9c5a5511e
add help printing
2020-02-07 16:20:09 +01:00
Johannes Rieken
4f875f8d25
Merge branch 'master' into joh/continous-browser-tests
2020-02-07 15:06:46 +01:00
Johannes Rieken
3e19c9765e
test - remove unsupported options, fix bad file warning
2020-02-07 15:06:29 +01:00
Johannes Rieken
37ef5e45af
Merge branch 'master' into joh/continous-browser-tests
2020-02-07 14:48:21 +01:00
Johannes Rieken
03fb0b117f
support --run argument as before, #90063
2020-02-07 14:07:39 +01:00
Johannes Rieken
8a1ca2b6c0
Merge branch 'master' into joh/continous-browser-tests
2020-02-07 10:02:38 +01:00
Benjamin Pasero
310c969fce
tests - run browser unit tests in default window
2020-02-07 09:53:24 +01:00
Benjamin Pasero
5393954877
tests - have a test/unit folder
2020-02-07 09:51:28 +01:00
