Commit Graph

46 Commits

Author SHA1 Message Date
Johannes
8f4d4d4bad workaround browser bug, fix browser test debugging 2023-09-05 11:47:13 +02:00
Connor Peet
6a847ba6d1 eng: add support for snapshot tests (#190444)
* eng: add support for snapshot tests

This adds Jest-like support for snapshot testing.
Developers can do something like:

```js
await assertSnapshot(myComplexObject)
```

The first time this is run, the snapshot expectation file is written
to a `__snapshots__` directory beside the test file. Subsequent runs
will compare the object to the snapshot, and fail if it doesn't match.

You can see an example of this in the test for snapshots themselves!

After a successful run, any unused snapshots are cleaned up. On a failed
run, a gitignored `.actual` snapshot file is created beside the
snapshot for easy processing and inspection.

Shortly I will do some integration with the selfhost test extension to
allow developers to easily update snapshots from the vscode UI.

For #189680

cc @ulugbekna @hediet

* fix async stacktraces getting clobbered

* random fixes

* comment out leak detector, for now

* add option to snapshot file extension
2023-08-15 12:03:51 -07:00
Benjamin Pasero
424388032a tests - increase timeout when running in CI (#182288) 2023-05-12 13:02:15 +02:00
Robo
e5f61433b5 chore: update to Electron 22 (#177600)
* Revert "chore: revert to Electron 19 (#175851)"

This reverts commit 3a11b47eee.

* chore: bump electron@22.3.3

* build: use custom version for V8 sandbox

* chore: update electron@22.4.1

* chore: enable forceAllocationsToV8Sandbox for extension host

* chore: bump electron@22.4.2

* chore: bump electron@22.4.3

* sandbox - cleanup from electron 22 update (#178919)

* Revert "chore: revert to Electron 19 (#175851)"

This reverts commit 3a11b47eee.

* chore: bump electron@22.3.3

* build: use custom version for V8 sandbox

* chore: update electron@22.4.1

* chore: enable forceAllocationsToV8Sandbox for extension host

* chore: bump electron@22.4.2

* chore: bump electron@22.4.3

* temp: update distro

* sandbox - cleanup from electron 22 update

* missing comile

* more changes

* fix build

* restore

* 💄

* compile

---------

Co-authored-by: deepak1556 <hop2deep@gmail.com>

---------

Co-authored-by: Benjamin Pasero <benjamin.pasero@microsoft.com>
2023-04-03 09:09:31 +02:00
Alexandru Dima
06b97f6be7 Add more logging and perf markers around resolving the connection token and the socket factory (#170490)
* Add more logging and perf markers around resolving the connection token and the socket factory

* set `exposeFunction` earlier

* bla windows

* also expose function for unit tests beofre opening

Co-authored-by: Benjamin Pasero <benjamin.pasero@microsoft.com>
2023-01-05 10:17:19 +01:00
Benjamin Pasero
0a7226e9ad Revert "Increase timeout of web unit tests" (#157065)
Revert "Increase timeout of web unit tests (#156894)"

This reverts commit f86beb18e8.
2022-08-04 11:52:56 +02:00
Benjamin Pasero
f86beb18e8 Increase timeout of web unit tests (#156894)
* Windows: some Firefox web tests are timing out randomly (#155760)

See if this is a fundamental issue or really Firefox is slower.

* mention issue
2022-08-03 06:55:58 +02:00
Benjamin Pasero
86e7410278 unit tests - help diagnose test failure reason for web tests (#155967) 2022-07-22 18:50:34 +02:00
Alexandru Dima
3530e85ba8 Properly return a non 0 exit code in case a test times out and fix tests which used to time out (#152329) 2022-06-16 13:02:37 +00:00
Johannes
0656d21d11 auto-fixed prefer-const violation 2022-06-08 17:49:21 +02:00
Benjamin Pasero
2ada17080c Use playwright for desktop smoke tests (#146692)
* Use `playwright` for desktop smoke tests

* fix distro issues

* tests - enable prefs tests for web
2022-04-04 10:13:08 +02:00
Alex Dima
cab9713422 Fixes #141994: Address eslint problems 2022-02-02 13:18:12 +01:00
Benjamin Pasero
9be2757019 🆙 playwright@1.18 (#140767)
* tests - use `@playwright/test@1.18.0-rc1`

* fix bad dependency

* clear more weird ts dependencies
2022-01-15 09:35:39 +01:00
Benjamin Pasero
eecbd962ef debt - rename iconv-lite-umd package (#140650) 2022-01-14 07:28:41 +01:00
Benjamin Pasero
af5de88a44 tests - add --sequential option and use in CI runs 2022-01-11 10:48:20 +01:00
Connor Peet
fa9255c0de almost complete update for run configurations 2021-07-12 17:28:01 -07:00
Connor Peet
583f6d1418 open the devtools for browser tests when debug is passed 2021-07-07 12:58:19 -07:00
Robo
92999c339e fix: setuid helper permission (#126798)
* ci: fix setuid helper binary permission

* ci: allow privilege for CLONE_NEWPID | CLONE_NEWNET

* ci: fix chrome-sandbox permission with rpm

* ci: fix permissions on snap

* ci: download electron earlier for arm builds
2021-06-22 08:42:30 -07:00
Henning Dieterichs
00123b32a7 Updates sinon from 1.17 to 11.1. 2021-06-09 10:03:46 +02:00
Henning Dieterichs
294b3bdf16 Revert "Include sinon-test in renderer.html / index.html"
This reverts commit e4e0f8be89.
2021-06-08 17:18:34 +02:00
Henning Dieterichs
e4e0f8be89 Include sinon-test in renderer.html / index.html 2021-06-08 17:16:54 +02:00
Benjamin Pasero
e2954beb4b Remove --no-sandbox (#122909)
* linux - remove `--no-sandbox` flag

We should not disable sandbox on Linux.
We only added this to support running on Kernel <= 3.8 where setuid sandbox is used.

* fix ci

* add some docs
2021-05-04 11:18:19 +02:00
Benjamin Pasero
7a6a45fb2c browser tests - fix regression from updating playwright 2021-02-02 16:53:30 +01:00
Johannes Rieken
b90166177b reuse stats collector for EchoRunner, fix missing titlePath-property, fixes https://github.com/microsoft/vscode/issues/114190 2021-01-12 11:21:32 +01:00
Connor Peet
04d7411785 eng: update mocha 2 -> 8 2020-12-17 11:24:15 -08:00
Ladislau Szomoru
41b661eb3d Add process.arch into unit test results file names 2020-08-18 18:08:37 +02:00
Ladislau Szomoru
cf4e4c1754 Add JUnit reporter for unit tests (#104354) 2020-08-10 11:20:34 +02:00
Fedor Nezhivoi
05613d7a1c Move read and write logic from nativeTextFileService to textFileService for #79275 (#100804)
* move encoding logic from NativeTextFileService to AbstractTextFileService for #79275

* some cleanup things - just cosmetic

* fix tests

* review

* use correct comparison

Co-authored-by: Benjamin Pasero <benjpas@microsoft.com>
2020-07-03 15:55:44 +02:00
Benjamin Pasero
45552c0a2d sandbox - reduce clipboard dependencies in renderer 2020-05-26 08:12:09 +02:00
Benjamin Pasero
9f45c20088 🆙 playwright@0.15.0 (#96218)
* playwright@0.15.0

* close to dumpio: true

* reduce logging
2020-04-27 08:50:50 +02:00
Johannes Rieken
0549900aa5 run web-unit-tests in chromium, webkit, and firefox
@bpasero fyi that I have disabled the "editor observer copy group" test for web
2020-04-07 10:47:23 +02:00
Matt Bierner
273a4a389d Convert most ts-ignore-calls to ts-expect-error (#93617)
Changes over to use ts-expect-error: https://devblogs.microsoft.com/typescript/announcing-typescript-3-9-beta/#ts-expect-error-comments

This revealed a number of places where we no longer need to supress errors
2020-03-30 17:31:37 -07:00
Benjamin Pasero
a7ed9c9572 🆙 playwright@0.11.0 (#90663) 2020-02-14 09:56:08 +01:00
Benjamin Pasero
4b359a57a5 build - address some issues
- run local and remote integration tests separately
- enable playwright on Linux with -no-sandbox trick
2020-02-12 12:07:44 +01:00
Daniel Imms
5cfae257fd Merge pull request #90245 from microsoft/tyriar/browser_tests
Move terminal unit tests to browser and common
2020-02-10 04:58:40 -08:00
Benjamin Pasero
cdf4026fb6 Add browser unit tests to product build (#90353)
* wip - add browser unit tests to product build

* run with more output

* load loader via script tag
2020-02-10 12:44:28 +01:00
Daniel Imms
8a4cd00f8f Move terminal tests to common and browser 2020-02-07 08:52:37 -08:00
Johannes Rieken
f9c5a5511e add help printing 2020-02-07 16:20:09 +01:00
Johannes Rieken
4f875f8d25 Merge branch 'master' into joh/continous-browser-tests 2020-02-07 15:06:46 +01:00
Johannes Rieken
3e19c9765e test - remove unsupported options, fix bad file warning 2020-02-07 15:06:29 +01:00
Johannes Rieken
37ef5e45af Merge branch 'master' into joh/continous-browser-tests 2020-02-07 14:48:21 +01:00
Johannes Rieken
03fb0b117f support --run argument as before, #90063 2020-02-07 14:07:39 +01:00
Alex Dima
97f826b007 Move assert.js into test/unit 2020-02-07 12:32:06 +01:00
Johannes Rieken
8a1ca2b6c0 Merge branch 'master' into joh/continous-browser-tests 2020-02-07 10:02:38 +01:00
Benjamin Pasero
310c969fce tests - run browser unit tests in default window 2020-02-07 09:53:24 +01:00
Benjamin Pasero
5393954877 tests - have a test/unit folder 2020-02-07 09:51:28 +01:00