Add ability to stress test flakes in CI #4127
Annotations
10 errors, 5 warnings, and 1 notice
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
1) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_ZjgFJpINOrTjbDTqIyFh_17gXbK#/home"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_ZjgFJpINOrTjbDTqIyFh_17gXbK"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_ZjgFJpINOrTjbDTqIyFh_17gXbK#/soft_logout"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_ZjgFJpINOrTjbDTqIyFh_17gXbK#/home"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
1) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_MCVtdvmtXybhuwPXWPUm_2BHNO4#/home"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_MCVtdvmtXybhuwPXWPUm_2BHNO4"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_MCVtdvmtXybhuwPXWPUm_2BHNO4#/soft_logout"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_MCVtdvmtXybhuwPXWPUm_2BHNO4#/home"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
1) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_LyqAkyyHgsNkMQCuWnfw_2pCcjj#/soft_logout"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
6 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_LyqAkyyHgsNkMQCuWnfw_2pCcjj"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_LyqAkyyHgsNkMQCuWnfw_2pCcjj#/soft_logout"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
2) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_ydEQwWPRfuMQtftnEYTP_2LXEtl#/soft_logout"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_ydEQwWPRfuMQtftnEYTP_2LXEtl"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_ydEQwWPRfuMQtftnEYTP_2LXEtl#/soft_logout"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
2) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_WADLwvJXqdUpmHtxoWOZ_4Edshl#/home"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_WADLwvJXqdUpmHtxoWOZ_4Edshl"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_WADLwvJXqdUpmHtxoWOZ_4Edshl#/soft_logout"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_WADLwvJXqdUpmHtxoWOZ_4Edshl#/home"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
2) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_oRoJSoiQxUVNRBGoIqfq_247GBe#/home"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_oRoJSoiQxUVNRBGoIqfq_247GBe"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_oRoJSoiQxUVNRBGoIqfq_247GBe#/soft_logout"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_oRoJSoiQxUVNRBGoIqfq_247GBe#/home"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
3) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_FxdLxwskYodmqtSxRaPr_1A7XVC#/home"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_FxdLxwskYodmqtSxRaPr_1A7XVC"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_FxdLxwskYodmqtSxRaPr_1A7XVC#/soft_logout"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_FxdLxwskYodmqtSxRaPr_1A7XVC#/home"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
3) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_jjYAdvSjQsinlvWMIpBQ_1JVGUZ#/home"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_jjYAdvSjQsinlvWMIpBQ_1JVGUZ"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_jjYAdvSjQsinlvWMIpBQ_1JVGUZ#/soft_logout"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_jjYAdvSjQsinlvWMIpBQ_1JVGUZ#/home"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
3) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_whYvTPtouJIPhDHZYBPT_2lUW0W#/home"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_whYvTPtouJIPhDHZYBPT_2lUW0W"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_whYvTPtouJIPhDHZYBPT_2lUW0W#/soft_logout"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_whYvTPtouJIPhDHZYBPT_2lUW0W#/home"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
playwright/e2e/login/soft_logout_oauth.spec.ts#L56
4) [Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
Error: Timed out 5000ms waiting for expect(locator).toHaveURL(expected)
Locator: locator(':root')
Expected pattern: /\/#\/home$/
Received string: "http://localhost:8080/?loginToken=syl_BWSKBwMTAELECeaAMhSc_1QESsP#/home"
Call log:
- expect.toHaveURL with timeout 5000ms
- waiting for locator(':root')
5 × locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_BWSKBwMTAELECeaAMhSc_1QESsP"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_BWSKBwMTAELECeaAMhSc_1QESsP#/soft_logout"
- locator resolved to <html lang="en">…</html>
- unexpected value "http://localhost:8080/?loginToken=syl_BWSKBwMTAELECeaAMhSc_1QESsP#/home"
54 |
55 | // back to the welcome page
> 56 | await expect(page).toHaveURL(/\/#\/home$/);
| ^
57 | await expect(page.getByRole("heading", { name: "Welcome Alice", exact: true })).toBeVisible();
58 | });
59 | });
at /home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:56:28
|
|
Run Playwright tests:
[Firefox] › spotlight/spotlight.spec.ts#L1
[Firefox] › spotlight/spotlight.spec.ts took 3.7m
|
|
Run Playwright tests:
[Firefox] › read-receipts/redactions-in-threads.spec.ts#L1
[Firefox] › read-receipts/redactions-in-threads.spec.ts took 3.5m
|
|
Run Playwright tests:
[Firefox] › read-receipts/new-messages-in-threads.spec.ts#L1
[Firefox] › read-receipts/new-messages-in-threads.spec.ts took 2.3m
|
|
Run Playwright tests:
[Firefox] › timeline/timeline.spec.ts#L1
[Firefox] › timeline/timeline.spec.ts took 1.8m
|
|
Run Playwright tests:
[Firefox] › read-receipts/read-receipts.spec.ts#L1
[Firefox] › read-receipts/read-receipts.spec.ts took 1.7m
|
|
Run Playwright tests
8 failed
[Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
[Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
[Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
[Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
[Firefox] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login
[Firefox] › room/room.spec.ts:56:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A
[Firefox] › sliding-sync/sliding-sync.spec.ts:114:5 › Sliding Sync › should move rooms around as new events arrive
[Firefox] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
2 flaky
[Firefox] › read-receipts/redactions-main-timeline.spec.ts:201:17 › Read receipts › redactions › in the main timeline › Redacting all unread messages makes the room read after restart @mergequeue
[Firefox] › sliding-sync/sliding-sync.spec.ts:191:5 › Sliding Sync › should not show unread indicators
68 skipped
297 passed (1.2h)
|
Loading