* Switch to TestContainers for manging services in Playwright
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Flip fixture dependency order
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Remove mas dep
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Update matrix-authentication-service in Playwright tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* delint
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix SMTP port
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Comments
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Strip ansi from playwright logs to make them more readable
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Actually do the update
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Remove access to homeserver.config.baseUrl field in favour of homeserver.baseUrl
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Use sane default_server_config and specify server.invalid in the specific tests which demand it
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix mas run
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* break cycle
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* typo
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* prettier
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Wire up basics of dendriteHomeserver
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Run Playwright tests against Dendrite & Pinecone periodically
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix playwright-image-updates.yaml workflow
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Add `X-Run-All-Tests` label for running all tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Ignore failing tests in stale-screenshot-reporter.ts to avoid confusing errors
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Specify Synapse ui_auth.session_timeout only on tests which require it
As Dendrite lacks this configuration option
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* React to MatrixEvent sender/target sentinels being updated for rendering state events
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Remove test code
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* React to sentinel changes in EventListSummary
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Docs
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Avoid reusing user1234
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix stale-screenshot-reporter.ts
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Clean up public rooms between tests on reused homeserver
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Deflake spotlight when homeserver is reused
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Deflake more tests using existing username
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Clean mailhog between tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix more flakes
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix missing _request
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix playwright flaky tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Wipe mailhog between test runs
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Delint
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* delint
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Deflake more tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix flaky tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix flaky tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix mas config
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix another flaky test
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix playwright flakes due to floating promises
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix flaky playwright tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Update services.ts
---------
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix playwright-image-updates.yaml workflow
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Add `X-Run-All-Tests` label for running all tests
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Ignore failing tests in stale-screenshot-reporter.ts to avoid confusing errors
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
---------
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Switch to using @fontsource for Inter & Inconsolata
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Remove unused font Open_Sans
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Switch to less broken imports
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Switch to Ubuntu 24.04
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Discard changes to res/themes/dark/css/dark.pcss
* Discard changes to res/themes/legacy-light/css/_fonts.pcss
* Discard changes to res/themes/light-high-contrast/css/light-high-contrast.pcss
* Discard changes to res/themes/light/css/light.pcss
* Discard changes to .github/workflows/end-to-end-tests.yaml
* Set outputDir for fonts
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Use headed mode for Playwright
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Switch to new Chrome headless mode instead
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Cache bust playwright browser install in CI
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Update screenshots
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Try with 22.04
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Update to Ubuntu Noble
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
---------
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Make the version file part of webpack output
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix outputFile path for Windows compat
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
---------
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Split up slow Playwright tests
To optimise parallelism
Deals with:
```
Slow test file: read-receipts/redactions.spec.ts (5.4m)
Slow test file: read-receipts/new-messages.spec.ts (3.9m)
Slow test file: read-receipts/high-level.spec.ts (3.6m)
Slow test file: read-receipts/editing-messages.spec.ts (3.1m)
Slow test file: read-receipts/reactions.spec.ts (2.2m)
Slow test file: crypto/crypto.spec.ts (2.4m)
Slow test file: settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts (1.2m)
Slow test file: composer/composer.spec.ts (1.1m)
Slow test file: crypto/verification.spec.ts (1.1m)
```
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Move around snapshots
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Add test reporter to prevent stale screenshots
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix test
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Remove darwin screenshots which should not have been checked in
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix absolute vs relative path mismatch
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Revert "Remove darwin screenshots which should not have been checked in"
This reverts commit 1e189977fa9ec873339fc02b2b231a314809b2d5.
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Revert "Revert "Remove darwin screenshots which should not have been checked in""
This reverts commit 5144b9b28e31ca543b2c5d02820c3f957dbd8c04.
* Iterate
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Remove stale screenshots
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Revert "Remove stale screenshots"
This reverts commit 9beae9974557c1ffa99c2372da280bb0da407bd1.
* Apply same sanitization as Playwright for file name consistency
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* add dev dep
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Remove stale screenshots
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Discard changes to playwright/flaky-reporter.ts
* Update end-to-end-tests.yaml
---------
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
Currently our GH workflows all use nodejs 18, but that's not compatible with the
stated support range of matrix-js-sdk, which requires the latest LTS nodejs;
so, when we attermpt to `yarn install` on an older nodejs, we get an error.
Switch to LTS nodejs for all the places we set up nodejs.
* Build the playwright html report in the main workflow
so we can get the report for MQ
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* fix
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
---------
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Simplify Playwright CI
and apply the least privilege principle
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix playwright.needs
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Remove spurious report.needs
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Add a completion stage to simplify branch protections
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
---------
Signed-off-by: Michael Telatynski <7t3chguy@gmail.com>
* Fix playwright result reporting for js-sdk upstream tests
Make the reporter job check out the react sdk explictly so it gets
the right thing when used from other workflows like the js-sdk.
* Remove c+ped lines from above that would have broken it
