Skip to content

Use rules (.sourcegraph/*.rule.md) in chat and auto-edit #26250

Use rules (.sourcegraph/*.rule.md) in chat and auto-edit

Use rules (.sourcegraph/*.rule.md) in chat and auto-edit #26250

Triggered via pull request February 1, 2025 10:26
Status Failure
Total duration 9m 15s
Artifacts

ci.yml

on: pull_request
fast_tests_matrix_prep
0s
fast_tests_matrix_prep
slow_tests_matrix_prep
0s
slow_tests_matrix_prep
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

30 errors, 15 warnings, and 5 notices
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > analytics events for the suggested -> accepted transition: vscode/src/autoedits/autoedits-provider.test.ts#L94
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:94:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > analytics events for the suggested -> rejected transition: vscode/src/autoedits/autoedits-provider.test.ts#L233
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:233:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > marks the suggestion as read after a certain timeout: vscode/src/autoedits/autoedits-provider.test.ts#L302
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:302:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > rejects the current suggestion when the new one is shown: vscode/src/autoedits/autoedits-provider.test.ts#L354
AssertionError: expected "recordEvent" to be called 1 times, but got 0 times ❯ src/autoedits/autoedits-provider.test.ts:354:27
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > set the cody.supersuggest.active context for inline decoration items: vscode/src/autoedits/autoedits-provider.test.ts#L393
Error: Snapshot `AutoeditsProvider > set the cody.supersuggest.active context for inline decoration items 1` mismatched - Expected + Received - [ - [ - "setContext", - "cody.supersuggest.active", - true, - ], - ] + [] ❯ src/autoedits/autoedits-provider.test.ts:393:34
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > unset the cody.supersuggest.active context for inline decoration rejection: vscode/src/autoedits/autoedits-provider.test.ts#L418
Error: Snapshot `AutoeditsProvider > unset the cody.supersuggest.active context for inline decoration rejection 1` mismatched - Expected + Received - [ - [ - "setContext", - "cody.supersuggest.active", - true, - ], - ] + [] ❯ src/autoedits/autoedits-provider.test.ts:418:34
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > trigger the editBuilder for inline decorations items: vscode/src/autoedits/autoedits-provider.test.ts#L453
AssertionError: expected +0 to be 1 // Object.is equality - Expected + Received - 1 + 0 ❯ src/autoedits/autoedits-provider.test.ts:453:34
src/context/openctx.test.ts > getOpenCtxProviders > dotcom user: vscode/src/context/openctx.test.ts#L44
AssertionError: expected [ 'internal-web-provider', …(1) ] to deeply equal [ 'internal-web-provider' ] - Expected + Received Array [ "internal-web-provider", + "internal-rules-provider", ] ❯ src/context/openctx.test.ts:44:51
src/context/openctx.test.ts > getOpenCtxProviders > enterprise user: vscode/src/context/openctx.test.ts#L54
AssertionError: expected [ 'internal-web-provider', …(4) ] to deeply equal [ 'internal-web-provider', …(3) ] - Expected + Received Array [ "internal-web-provider", + "internal-rules-provider", "internal-remote-repository-search", "internal-remote-directory-search", "internal-remote-file-search", ] ❯ src/context/openctx.test.ts:54:51
src/autoedits/prompt/default-prompt-strategy.test.ts > DefaultUserPromptStrategy > creates prompt with the context source with context: vscode/src/autoedits/prompt/default-prompt-strategy.test.ts#L193
AssertionError: expected 'Help me finish a coding change. In pa…' to deeply equal 'Help me finish a coding change. In pa…' - Expected + Received Help me finish a coding change. In particular, you will see a series of snippets from current open files in my editor, files I have recently viewed, the file I am editing, then a history of my recent codebase changes, then current compiler and linter errors, content I copied from my codebase. You will then rewrite the <code_to_rewrite>, to match what you think I would do next in the codebase. Note: I might have stopped in the middle of typing. Here are some snippets of code I have extracted from open files in my code editor. It's possible these aren't entirely relevant to my code change: <extracted_code_snippets> <snippet> (`test1.ts`) jaccard similarity context 1 </snippet> <snippet> (`test2.ts`) jaccard similarity context 2 </snippet> </extracted_code_snippets> Here are some snippets of code I have recently viewed, roughly from oldest to newest. It's possible these aren't entirely relevant to my code change: <recently_viewed_snippets> <snippet> (`test3.ts`) view port context 4 </snippet> <snippet> (`test2.ts`) view port context 3 </snippet> <snippet> (`test1.ts`) view port context 2 </snippet> <snippet> (`test0.ts`) view port context 1 </snippet> </recently_viewed_snippets> Here is the file that I am looking at (`test.ts`) <file> <<<AREA_AROUND_CODE_TO_REWRITE_WILL_BE_INSERTED_HERE>>> </file> Here is my recent series of edits from oldest to newest. <diff_history> test2.ts recent edits context 5 test3.ts recent edits context 4 test3.ts recent edits context 3 test0.ts recent edits context 2 test0.ts recent edits context 1 </diff_history> Here are some linter errors from the code that you will rewrite. <lint_errors> (`test1.ts`) diagnostics context 1 diagnostics context 2 (`test2.ts`) diagnostics context 3 </lint_errors> Here is some recent code I copied from the editor. <recent_copy> (`test1.ts`) recent copy context 1 (`test2.ts`) recent copy context 2 </recent_copy> <area_around_code_to_rewrite> line 37 line 38 line 39 line 40 line 41 line 42 line 43 line 44 line 45 line 46 <code_to_rewrite> line 47 line 48 line 49 line 50 line 51 line 52 line 53 </code_to_rewrite> line 54 line 55 line 56 line 57 line 58 line 59 line 60 line 61 line 62 line 63 line 64 </area_around_code_to_rewrite> + Now, continue where I left off and finish my change by rewriting "code_to_rewrite": ❯ src/autoedits/prompt/default-prompt-strategy.test.ts:193:35
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > analytics events for the suggested -> accepted transition: vscode/src/autoedits/autoedits-provider.test.ts#L94
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:94:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > analytics events for the suggested -> rejected transition: vscode/src/autoedits/autoedits-provider.test.ts#L233
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:233:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > marks the suggestion as read after a certain timeout: vscode/src/autoedits/autoedits-provider.test.ts#L302
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:302:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > rejects the current suggestion when the new one is shown: vscode/src/autoedits/autoedits-provider.test.ts#L354
AssertionError: expected "recordEvent" to be called 1 times, but got 0 times ❯ src/autoedits/autoedits-provider.test.ts:354:27
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > set the cody.supersuggest.active context for inline decoration items: vscode/src/autoedits/autoedits-provider.test.ts#L393
Error: Snapshot `AutoeditsProvider > set the cody.supersuggest.active context for inline decoration items 1` mismatched - Expected + Received - [ - [ - "setContext", - "cody.supersuggest.active", - true, - ], - ] + [] ❯ src/autoedits/autoedits-provider.test.ts:393:34
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > unset the cody.supersuggest.active context for inline decoration rejection: vscode/src/autoedits/autoedits-provider.test.ts#L418
Error: Snapshot `AutoeditsProvider > unset the cody.supersuggest.active context for inline decoration rejection 1` mismatched - Expected + Received - [ - [ - "setContext", - "cody.supersuggest.active", - true, - ], - ] + [] ❯ src/autoedits/autoedits-provider.test.ts:418:34
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > trigger the editBuilder for inline decorations items: vscode/src/autoedits/autoedits-provider.test.ts#L453
AssertionError: expected +0 to be 1 // Object.is equality - Expected + Received - 1 + 0 ❯ src/autoedits/autoedits-provider.test.ts:453:34
src/context/openctx.test.ts > getOpenCtxProviders > dotcom user: vscode/src/context/openctx.test.ts#L44
AssertionError: expected [ 'internal-web-provider', …(1) ] to deeply equal [ 'internal-web-provider' ] - Expected + Received Array [ "internal-web-provider", + "internal-rules-provider", ] ❯ src/context/openctx.test.ts:44:51
src/context/openctx.test.ts > getOpenCtxProviders > enterprise user: vscode/src/context/openctx.test.ts#L54
AssertionError: expected [ 'internal-web-provider', …(4) ] to deeply equal [ 'internal-web-provider', …(3) ] - Expected + Received Array [ "internal-web-provider", + "internal-rules-provider", "internal-remote-repository-search", "internal-remote-directory-search", "internal-remote-file-search", ] ❯ src/context/openctx.test.ts:54:51
src/autoedits/prompt/default-prompt-strategy.test.ts > DefaultUserPromptStrategy > creates prompt with the context source with context: vscode/src/autoedits/prompt/default-prompt-strategy.test.ts#L193
AssertionError: expected 'Help me finish a coding change. In pa…' to deeply equal 'Help me finish a coding change. In pa…' - Expected + Received Help me finish a coding change. In particular, you will see a series of snippets from current open files in my editor, files I have recently viewed, the file I am editing, then a history of my recent codebase changes, then current compiler and linter errors, content I copied from my codebase. You will then rewrite the <code_to_rewrite>, to match what you think I would do next in the codebase. Note: I might have stopped in the middle of typing. Here are some snippets of code I have extracted from open files in my code editor. It's possible these aren't entirely relevant to my code change: <extracted_code_snippets> <snippet> (`test1.ts`) jaccard similarity context 1 </snippet> <snippet> (`test2.ts`) jaccard similarity context 2 </snippet> </extracted_code_snippets> Here are some snippets of code I have recently viewed, roughly from oldest to newest. It's possible these aren't entirely relevant to my code change: <recently_viewed_snippets> <snippet> (`test3.ts`) view port context 4 </snippet> <snippet> (`test2.ts`) view port context 3 </snippet> <snippet> (`test1.ts`) view port context 2 </snippet> <snippet> (`test0.ts`) view port context 1 </snippet> </recently_viewed_snippets> Here is the file that I am looking at (`test.ts`) <file> <<<AREA_AROUND_CODE_TO_REWRITE_WILL_BE_INSERTED_HERE>>> </file> Here is my recent series of edits from oldest to newest. <diff_history> test2.ts recent edits context 5 test3.ts recent edits context 4 test3.ts recent edits context 3 test0.ts recent edits context 2 test0.ts recent edits context 1 </diff_history> Here are some linter errors from the code that you will rewrite. <lint_errors> (`test1.ts`) diagnostics context 1 diagnostics context 2 (`test2.ts`) diagnostics context 3 </lint_errors> Here is some recent code I copied from the editor. <recent_copy> (`test1.ts`) recent copy context 1 (`test2.ts`) recent copy context 2 </recent_copy> <area_around_code_to_rewrite> line 37 line 38 line 39 line 40 line 41 line 42 line 43 line 44 line 45 line 46 <code_to_rewrite> line 47 line 48 line 49 line 50 line 51 line 52 line 53 </code_to_rewrite> line 54 line 55 line 56 line 57 line 58 line 59 line 60 line 61 line 62 line 63 line 64 </area_around_code_to_rewrite> + Now, continue where I left off and finish my change by rewriting "code_to_rewrite": ❯ src/autoedits/prompt/default-prompt-strategy.test.ts:193:35
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > analytics events for the suggested -> accepted transition: vscode/src/autoedits/autoedits-provider.test.ts#L94
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:94:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > analytics events for the suggested -> rejected transition: vscode/src/autoedits/autoedits-provider.test.ts#L233
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:233:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > marks the suggestion as read after a certain timeout: vscode/src/autoedits/autoedits-provider.test.ts#L302
AssertionError: expected undefined to be 'const x = 1\n' // Object.is equality - Expected: "const x = 1 " + Received: undefined ❯ src/autoedits/autoedits-provider.test.ts:302:36
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > rejects the current suggestion when the new one is shown: vscode/src/autoedits/autoedits-provider.test.ts#L354
AssertionError: expected "recordEvent" to be called 1 times, but got 0 times ❯ src/autoedits/autoedits-provider.test.ts:354:27
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > set the cody.supersuggest.active context for inline decoration items: vscode/src/autoedits/autoedits-provider.test.ts#L393
Error: Snapshot `AutoeditsProvider > set the cody.supersuggest.active context for inline decoration items 1` mismatched - Expected + Received - [ - [ - "setContext", - "cody.supersuggest.active", - true, - ], - ] + [] ❯ src/autoedits/autoedits-provider.test.ts:393:34
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > unset the cody.supersuggest.active context for inline decoration rejection: vscode/src/autoedits/autoedits-provider.test.ts#L418
Error: Snapshot `AutoeditsProvider > unset the cody.supersuggest.active context for inline decoration rejection 1` mismatched - Expected + Received - [ - [ - "setContext", - "cody.supersuggest.active", - true, - ], - ] + [] ❯ src/autoedits/autoedits-provider.test.ts:418:34
src/autoedits/autoedits-provider.test.ts > AutoeditsProvider > trigger the editBuilder for inline decorations items: vscode/src/autoedits/autoedits-provider.test.ts#L453
AssertionError: expected +0 to be 1 // Object.is equality - Expected + Received - 1 + 0 ❯ src/autoedits/autoedits-provider.test.ts:453:34
src/context/openctx.test.ts > getOpenCtxProviders > dotcom user: vscode/src/context/openctx.test.ts#L44
AssertionError: expected [ 'internal-web-provider', …(1) ] to deeply equal [ 'internal-web-provider' ] - Expected + Received Array [ "internal-web-provider", + "internal-rules-provider", ] ❯ src/context/openctx.test.ts:44:51
src/context/openctx.test.ts > getOpenCtxProviders > enterprise user: vscode/src/context/openctx.test.ts#L54
AssertionError: expected [ 'internal-web-provider', …(4) ] to deeply equal [ 'internal-web-provider', …(3) ] - Expected + Received Array [ "internal-web-provider", + "internal-rules-provider", "internal-remote-repository-search", "internal-remote-directory-search", "internal-remote-file-search", ] ❯ src/context/openctx.test.ts:54:51
src/autoedits/prompt/default-prompt-strategy.test.ts > DefaultUserPromptStrategy > creates prompt with the context source with context: vscode/src/autoedits/prompt/default-prompt-strategy.test.ts#L193
AssertionError: expected 'Help me finish a coding change. In pa…' to deeply equal 'Help me finish a coding change. In pa…' - Expected + Received Help me finish a coding change. In particular, you will see a series of snippets from current open files in my editor, files I have recently viewed, the file I am editing, then a history of my recent codebase changes, then current compiler and linter errors, content I copied from my codebase. You will then rewrite the <code_to_rewrite>, to match what you think I would do next in the codebase. Note: I might have stopped in the middle of typing. Here are some snippets of code I have extracted from open files in my code editor. It's possible these aren't entirely relevant to my code change: <extracted_code_snippets> <snippet> (`test1.ts`) jaccard similarity context 1 </snippet> <snippet> (`test2.ts`) jaccard similarity context 2 </snippet> </extracted_code_snippets> Here are some snippets of code I have recently viewed, roughly from oldest to newest. It's possible these aren't entirely relevant to my code change: <recently_viewed_snippets> <snippet> (`test3.ts`) view port context 4 </snippet> <snippet> (`test2.ts`) view port context 3 </snippet> <snippet> (`test1.ts`) view port context 2 </snippet> <snippet> (`test0.ts`) view port context 1 </snippet> </recently_viewed_snippets> Here is the file that I am looking at (`test.ts`) <file> <<<AREA_AROUND_CODE_TO_REWRITE_WILL_BE_INSERTED_HERE>>> </file> Here is my recent series of edits from oldest to newest. <diff_history> test2.ts recent edits context 5 test3.ts recent edits context 4 test3.ts recent edits context 3 test0.ts recent edits context 2 test0.ts recent edits context 1 </diff_history> Here are some linter errors from the code that you will rewrite. <lint_errors> (`test1.ts`) diagnostics context 1 diagnostics context 2 (`test2.ts`) diagnostics context 3 </lint_errors> Here is some recent code I copied from the editor. <recent_copy> (`test1.ts`) recent copy context 1 (`test2.ts`) recent copy context 2 </recent_copy> <area_around_code_to_rewrite> line 37 line 38 line 39 line 40 line 41 line 42 line 43 line 44 line 45 line 46 <code_to_rewrite> line 47 line 48 line 49 line 50 line 51 line 52 line 53 </code_to_rewrite> line 54 line 55 line 56 line 57 line 58 line 59 line 60 line 61 line 62 line 63 line 64 </area_around_code_to_rewrite> + Now, continue where I left off and finish my change by rewriting "code_to_rewrite": ❯ src/autoedits/prompt/default-prompt-strategy.test.ts:193:35
Slow Test: vscode/auth.test.ts#L1
vscode/auth.test.ts took 33.8s
Slow Test: vscode/attribution.test.ts#L1
vscode/attribution.test.ts took 24.1s
Slow Test: vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 55.6s
Slow Test: vscode/support-menu-items.test.ts#L1
vscode/support-menu-items.test.ts took 21.5s
Slow Test: vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.4m
Slow Test: vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 31.6s
Slow Test: vscode/chat-history.test.ts#L1
vscode/chat-history.test.ts took 23.8s
Slow Test: vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 45.6s
Slow Test: vscode/code-actions.test.ts#L1
vscode/code-actions.test.ts took 36.4s
Slow Test: vscode/chat-rateLimit.test.ts#L1
vscode/chat-rateLimit.test.ts took 35.6s
Slow Test: vscode/chat-messages.test.ts#L1
vscode/chat-messages.test.ts took 24.1s
Slow Test: vscode/command-commit.test.ts#L1
vscode/command-commit.test.ts took 15.2s
Slow Test: vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.3m
Slow Test: vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 46.3s
Slow Test: vscode/enterprise-cody-ignore.test.ts#L1
vscode/enterprise-cody-ignore.test.ts took 19.2s
🎭 Playwright Run Summary
8 skipped 5 passed (1.0m)
🎭 Playwright Run Summary
4 skipped 7 passed (1.6m)
🎭 Playwright Run Summary
3 skipped 9 passed (2.4m)
🎭 Playwright Run Summary
2 skipped 10 passed (2.7m)
🎭 Playwright Run Summary
10 passed (2.9m)