Skip to content

chore(ES): update CTAs and eligibility logic (#6803) #26088

chore(ES): update CTAs and eligibility logic (#6803)

chore(ES): update CTAs and eligibility logic (#6803) #26088

Triggered via push January 27, 2025 22:20
Status Failure
Total duration 19m 46s
Artifacts 2

ci.yml

on: push
fast_tests_matrix_prep
0s
fast_tests_matrix_prep
slow_tests_matrix_prep
0s
slow_tests_matrix_prep
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

16 errors, 22 warnings, and 3 notices
test-e2e (macos)
Worker teardown timeout of 30000ms exceeded. Failed worker ran 10 tests: test/e2e/chat-atFile.test.ts:48:7 › @-mention file in chat test/e2e/chat-atFile.test.ts:229:3 › editing a chat message with @-mention test/e2e/chat-atFile.test.ts:271:3 › @-mention file range test/e2e/chat-atFile.test.ts:310:3 › @-mention symbol in chat test/e2e/chat-atFile.test.ts:367:3 › Add Selection to Cody Chat test/e2e/chat-history.test.ts:17:3 › restore chat from sidebar history view test/e2e/chat-history.test.ts:50:3 › delete chat from sidebar history view test/e2e/chat-input.test.ts:191:3 › chat model selector test/e2e/chat-input.test.ts:242:3 › editing follow-up messages in chat view test/e2e/chat-messages.test.ts:17:5 › chat assistant response code buttons
test-e2e (macos)
Worker teardown timeout of 30000ms exceeded. Failed worker ran 1 test: test/e2e/chat-messages.test.ts:17:5 › chat assistant response code buttons
auto-edits.test.ts:182:3 › autoedits: triggers a multi-line diff view when edit affects existing lines: vscode/test/e2e/auto-edits.test.ts#L160
1) auto-edits.test.ts:182:3 › autoedits: triggers a multi-line diff view when edit affects existing lines Error: Screenshot comparison failed: 44076 pixels (ratio 0.03 of all image pixels) are different. Expected: /Users/runner/work/cody/cody/vscode/test/e2e/__snapshots__/auto-edits.test.ts/macos/autoedits-suffix-decoration-70-suggested.png Received: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-1c59f-edit-affects-existing-lines/macos/autoedits-suffix-decoration-70-suggested-actual.png Diff: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-1c59f-edit-affects-existing-lines/macos/autoedits-suffix-decoration-70-suggested-diff.png Call log: - expect.toHaveScreenshot(macos/autoedits-suffix-decoration-70-suggested.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 44077 pixels (ratio 0.03 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 44076 pixels (ratio 0.03 of all image pixels) are different. 158 | await page.waitForTimeout(500) 159 | > 160 | await expect(page).toHaveScreenshot( | ^ 161 | [snapshotPlatform, `${snapshotName}-suggested.png`], 162 | SNAPSHOT_ASSERTIONS 163 | ) at autoeditsTestHelper (/Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:160:28) at /Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:186:9
auto-edits.test.ts:182:3 › autoedits: triggers a multi-line diff view when edit affects existing lines: vscode/test/e2e/auto-edits.test.ts#L160
1) auto-edits.test.ts:182:3 › autoedits: triggers a multi-line diff view when edit affects existing lines Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 44076 pixels (ratio 0.03 of all image pixels) are different. Expected: /Users/runner/work/cody/cody/vscode/test/e2e/__snapshots__/auto-edits.test.ts/macos/autoedits-suffix-decoration-70-suggested.png Received: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-1c59f-edit-affects-existing-lines-retry1/macos/autoedits-suffix-decoration-70-suggested-actual.png Diff: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-1c59f-edit-affects-existing-lines-retry1/macos/autoedits-suffix-decoration-70-suggested-diff.png Call log: - expect.toHaveScreenshot(macos/autoedits-suffix-decoration-70-suggested.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 44077 pixels (ratio 0.03 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 44076 pixels (ratio 0.03 of all image pixels) are different. 158 | await page.waitForTimeout(500) 159 | > 160 | await expect(page).toHaveScreenshot( | ^ 161 | [snapshotPlatform, `${snapshotName}-suggested.png`], 162 | SNAPSHOT_ASSERTIONS 163 | ) at autoeditsTestHelper (/Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:160:28) at /Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:186:9
auto-edits.test.ts:198:3 › autoedits: triggers an inline completion when edit is an insertion immediately after the cursor: vscode/test/e2e/auto-edits.test.ts#L160
2) auto-edits.test.ts:198:3 › autoedits: triggers an inline completion when edit is an insertion immediately after the cursor Error: Screenshot comparison failed: 20127 pixels (ratio 0.01 of all image pixels) are different. Expected: /Users/runner/work/cody/cody/vscode/test/e2e/__snapshots__/auto-edits.test.ts/macos/autoedits-inline-completion-29-suggested.png Received: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-912dc-mmediately-after-the-cursor/macos/autoedits-inline-completion-29-suggested-actual.png Diff: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-912dc-mmediately-after-the-cursor/macos/autoedits-inline-completion-29-suggested-diff.png Call log: - expect.toHaveScreenshot(macos/autoedits-inline-completion-29-suggested.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 28719 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 8628 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 20127 pixels (ratio 0.01 of all image pixels) are different. 158 | await page.waitForTimeout(500) 159 | > 160 | await expect(page).toHaveScreenshot( | ^ 161 | [snapshotPlatform, `${snapshotName}-suggested.png`], 162 | SNAPSHOT_ASSERTIONS 163 | ) at autoeditsTestHelper (/Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:160:28) at /Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:202:9
auto-edits.test.ts:198:3 › autoedits: triggers an inline completion when edit is an insertion immediately after the cursor: vscode/test/e2e/auto-edits.test.ts#L160
2) auto-edits.test.ts:198:3 › autoedits: triggers an inline completion when edit is an insertion immediately after the cursor Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 20127 pixels (ratio 0.01 of all image pixels) are different. Expected: /Users/runner/work/cody/cody/vscode/test/e2e/__snapshots__/auto-edits.test.ts/macos/autoedits-inline-completion-29-suggested.png Received: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-912dc-mmediately-after-the-cursor-retry1/macos/autoedits-inline-completion-29-suggested-actual.png Diff: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-912dc-mmediately-after-the-cursor-retry1/macos/autoedits-inline-completion-29-suggested-diff.png Call log: - expect.toHaveScreenshot(macos/autoedits-inline-completion-29-suggested.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 28719 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 8628 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 20127 pixels (ratio 0.01 of all image pixels) are different. 158 | await page.waitForTimeout(500) 159 | > 160 | await expect(page).toHaveScreenshot( | ^ 161 | [snapshotPlatform, `${snapshotName}-suggested.png`], 162 | SNAPSHOT_ASSERTIONS 163 | ) at autoeditsTestHelper (/Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:160:28) at /Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:202:9
auto-edits.test.ts:214:3 › autoedits: triggers an inline decoration when an inline completion is desired: vscode/test/e2e/auto-edits.test.ts#L160
3) auto-edits.test.ts:214:3 › autoedits: triggers an inline decoration when an inline completion is desired, but the insertion position is before the cursor position Error: Screenshot comparison failed: 26568 pixels (ratio 0.02 of all image pixels) are different. Expected: /Users/runner/work/cody/cody/vscode/test/e2e/__snapshots__/auto-edits.test.ts/macos/autoedits-inline-decoration-insertion-30-suggested.png Received: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-c9082--before-the-cursor-position/macos/autoedits-inline-decoration-insertion-30-suggested-actual.png Diff: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-c9082--before-the-cursor-position/macos/autoedits-inline-decoration-insertion-30-suggested-diff.png Call log: - expect.toHaveScreenshot(macos/autoedits-inline-decoration-insertion-30-suggested.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 26550 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 26568 pixels (ratio 0.02 of all image pixels) are different. 158 | await page.waitForTimeout(500) 159 | > 160 | await expect(page).toHaveScreenshot( | ^ 161 | [snapshotPlatform, `${snapshotName}-suggested.png`], 162 | SNAPSHOT_ASSERTIONS 163 | ) at autoeditsTestHelper (/Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:160:28) at /Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:218:9
auto-edits.test.ts:214:3 › autoedits: triggers an inline decoration when an inline completion is desired: vscode/test/e2e/auto-edits.test.ts#L160
3) auto-edits.test.ts:214:3 › autoedits: triggers an inline decoration when an inline completion is desired, but the insertion position is before the cursor position Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 26550 pixels (ratio 0.02 of all image pixels) are different. Expected: /Users/runner/work/cody/cody/vscode/test/e2e/__snapshots__/auto-edits.test.ts/macos/autoedits-inline-decoration-insertion-30-suggested.png Received: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-c9082--before-the-cursor-position-retry1/macos/autoedits-inline-decoration-insertion-30-suggested-actual.png Diff: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-c9082--before-the-cursor-position-retry1/macos/autoedits-inline-decoration-insertion-30-suggested-diff.png Call log: - expect.toHaveScreenshot(macos/autoedits-inline-decoration-insertion-30-suggested.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 26550 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 26550 pixels (ratio 0.02 of all image pixels) are different. 158 | await page.waitForTimeout(500) 159 | > 160 | await expect(page).toHaveScreenshot( | ^ 161 | [snapshotPlatform, `${snapshotName}-suggested.png`], 162 | SNAPSHOT_ASSERTIONS 163 | ) at autoeditsTestHelper (/Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:160:28) at /Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:218:9
auto-edits.test.ts:230:3 › autoedits: triggers inline decorations when multiple insertions are required on different lines: vscode/test/e2e/auto-edits.test.ts#L160
4) auto-edits.test.ts:230:3 › autoedits: triggers inline decorations when multiple insertions are required on different lines Error: Screenshot comparison failed: 23241 pixels (ratio 0.02 of all image pixels) are different. Expected: /Users/runner/work/cody/cody/vscode/test/e2e/__snapshots__/auto-edits.test.ts/macos/autoedits-inline-decoration-multiple-insertions-different-lines-44-suggested.png Received: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-d9853-required-on-different-lines/macos/autoedits-inline-decoration-multiple-insertions-different-lines-44-suggested-actual.png Diff: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-d9853-required-on-different-lines/macos/autoedits-inline-decoration-multiple-insertions-different-lines-44-suggested-diff.png Call log: - expect.toHaveScreenshot(macos/autoedits-inline-decoration-multiple-insertions-different-lines-44-suggested.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 23240 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 23241 pixels (ratio 0.02 of all image pixels) are different. 158 | await page.waitForTimeout(500) 159 | > 160 | await expect(page).toHaveScreenshot( | ^ 161 | [snapshotPlatform, `${snapshotName}-suggested.png`], 162 | SNAPSHOT_ASSERTIONS 163 | ) at autoeditsTestHelper (/Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:160:28) at /Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:234:9
auto-edits.test.ts:230:3 › autoedits: triggers inline decorations when multiple insertions are required on different lines: vscode/test/e2e/auto-edits.test.ts#L160
4) auto-edits.test.ts:230:3 › autoedits: triggers inline decorations when multiple insertions are required on different lines Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 23241 pixels (ratio 0.02 of all image pixels) are different. Expected: /Users/runner/work/cody/cody/vscode/test/e2e/__snapshots__/auto-edits.test.ts/macos/autoedits-inline-decoration-multiple-insertions-different-lines-44-suggested.png Received: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-d9853-required-on-different-lines-retry1/macos/autoedits-inline-decoration-multiple-insertions-different-lines-44-suggested-actual.png Diff: /Users/runner/work/cody/cody/vscode/test-results/auto-edits-autoedits-trigg-d9853-required-on-different-lines-retry1/macos/autoedits-inline-decoration-multiple-insertions-different-lines-44-suggested-diff.png Call log: - expect.toHaveScreenshot(macos/autoedits-inline-decoration-multiple-insertions-different-lines-44-suggested.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 23240 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 23241 pixels (ratio 0.02 of all image pixels) are different. 158 | await page.waitForTimeout(500) 159 | > 160 | await expect(page).toHaveScreenshot( | ^ 161 | [snapshotPlatform, `${snapshotName}-suggested.png`], 162 | SNAPSHOT_ASSERTIONS 163 | ) at autoeditsTestHelper (/Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:160:28) at /Users/runner/work/cody/cody/vscode/test/e2e/auto-edits.test.ts:234:9
command-edit.test.ts:143:1 › edit (fixup) input - model selection: vscode\test\e2e\command-edit.test.ts#L159
1) command-edit.test.ts:143:1 › edit (fixup) input - model selection ───────────────────────────── Error: expect(locator).toBeVisible() Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" 157 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') 158 | await nap() > 159 | expect(modelItem).toBeVisible() | ^ 160 | 161 | // Open the model input and check it has the correct item selected 162 | await modelItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:159:23
command-edit.test.ts:143:1 › edit (fixup) input - model selection: vscode\test\e2e\command-edit.test.ts#L159
1) command-edit.test.ts:143:1 › edit (fixup) input - model selection ───────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toBeVisible() Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" 157 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') 158 | await nap() > 159 | expect(modelItem).toBeVisible() | ^ 160 | 161 | // Open the model input and check it has the correct item selected 162 | await modelItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:159:23
command-edit.test.ts:143:1 › edit (fixup) input - model selection: vscode\test\e2e\command-edit.test.ts#L159
1) command-edit.test.ts:143:1 › edit (fixup) input - model selection ───────────────────────────── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toBeVisible() Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" 157 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') 158 | await nap() > 159 | expect(modelItem).toBeVisible() | ^ 160 | 161 | // Open the model input and check it has the correct item selected 162 | await modelItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:159:23
command-edit.test.ts:143:1 › edit (fixup) input - model selection: vscode\test\e2e\command-edit.test.ts#L159
1) command-edit.test.ts:143:1 › edit (fixup) input - model selection ───────────────────────────── Retry #3 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toBeVisible() Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" 157 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') 158 | await nap() > 159 | expect(modelItem).toBeVisible() | ^ 160 | 161 | // Open the model input and check it has the correct item selected 162 | await modelItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:159:23
command-edit.test.ts:143:1 › edit (fixup) input - model selection: vscode\test\e2e\command-edit.test.ts#L159
1) command-edit.test.ts:143:1 › edit (fixup) input - model selection ───────────────────────────── Retry #4 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toBeVisible() Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" - locator resolved to <a class="label-name">…</a> - unexpected value "hidden" 157 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a') 158 | await nap() > 159 | expect(modelItem).toBeVisible() | ^ 160 | 161 | // Open the model input and check it has the correct item selected 162 | await modelItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:159:23
test-e2e (windows)
Process completed with exit code 1.
fast_tests_matrix_prep
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
slow_tests_matrix_prep
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-integration (ubuntu)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
build
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-unit (ubuntu, 20)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-unit (ubuntu, 18)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-e2e (ubuntu)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Slow Test: vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.4m
Slow Test: vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.2m
Slow Test: vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 54.7s
Slow Test: vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 45.5s
Slow Test: vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 45.5s
Slow Test: vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.3m
Slow Test: vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.1m
Slow Test: vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 48.2s
Slow Test: vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 38.0s
Slow Test: vscode/chat-rateLimit.test.ts#L1
vscode/chat-rateLimit.test.ts took 33.0s
Slow Test: vscode\chat-atFile.test.ts#L1
vscode\chat-atFile.test.ts took 1.6m
Slow Test: vscode\command-custom.test.ts#L1
vscode\command-custom.test.ts took 1.4m
Slow Test: vscode\initial-context.test.ts#L1
vscode\initial-context.test.ts took 1.1m
Slow Test: vscode\command-core.test.ts#L1
vscode\command-core.test.ts took 52.9s
Slow Test: vscode\chat-rateLimit.test.ts#L1
vscode\chat-rateLimit.test.ts took 42.8s
🎭 Playwright Run Summary
17 skipped 41 passed (10.2m)
🎭 Playwright Run Summary
8 failed auto-edits.test.ts:182:3 › autoedits: triggers a multi-line diff view when edit affects existing lines auto-edits.test.ts:198:3 › autoedits: triggers an inline completion when edit is an insertion immediately after the cursor auto-edits.test.ts:214:3 › autoedits: triggers an inline decoration when an inline completion is desired, but the insertion position is before the cursor position auto-edits.test.ts:230:3 › autoedits: triggers inline decorations when multiple insertions are required on different lines auto-edits.test.ts:246:3 › autoedits: triggers inline decorations when multiple separate insertions are required on the same line auto-edits.test.ts:260:1 › autoedits: triggers a suffix decoration and renders correctly in files that use tab based indentation auto-edits.test.ts:274:1 › autoedits: does not show any suggestion if the suffix decoration spans further than the end of the file chat-messages.test.ts:17:5 › chat assistant response code buttons ────────────────────────────── 1 flaky command-edit.test.ts:105:1 › edit (fixup) input - range selection ────────────────────────────── 10 skipped 39 passed (14.9m)
🎭 Playwright Run Summary
1 failed command-edit.test.ts:143:1 › edit (fixup) input - model selection ────────────────────────────── 17 skipped 40 passed (13.0m)

Artifacts

Produced during runtime
Name Size
playwright-recordings macos
13.4 MB
playwright-recordings windows
55.1 KB