Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments
Labels
Area-Infrastructure Area-Watch Known Build Error untriaged Request triage from a team member
Milestone
10.0.1xx

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024 •
edited by build-analysis bot
Loading

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
929761 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46297
929746 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #46310
929744 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #46309
929739 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #46308
929731 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46286
929659 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46305
929684 dotnet/sdk dotnet.Tests.dll.24.WorkItemExecution #46307
929672 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46306
929487 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45836
929407 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46290
929410 dotnet/sdk dotnet.Tests.dll.44.WorkItemExecution #46281
929297 dotnet/sdk dotnet-sln.Tests.dll.1.WorkItemExecution #46297
929256 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #46281
929169 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46299
929143 dotnet/sdk Microsoft.NET.Publish.Tests.dll.11.WorkItemExecution #46298
929122 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46297
929118 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46296
927610 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46257
928278 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46275
928195 dotnet/sdk Microsoft.NET.Build.Tests.dll.22.WorkItemExecution #46244
928008 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46249
928130 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46269
928112 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46261
927641 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46184
928066 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.5.WorkItemExecution #46268
924618 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #37872
927996 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution #46264
927929 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46045
927842 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46021
927625 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46259
927509 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46183
919402 dotnet/sdk dotnet-sln.Tests.dll.1.WorkItemExecution #46033
927121 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46184
926310 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #46232
926195 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46226
927441 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46255
927208 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.14.WorkItemExecution #46238
927418 dotnet/sdk Microsoft.NET.Build.Tests.dll.4.WorkItemExecution #45419
927364 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46254
927341 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.14.WorkItemExecution #46063
927315 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46253
926867 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46216
926779 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46243
926765 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46101
926656 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46209
926618 dotnet/sdk dotnet.Tests.dll.24.WorkItemExecution #46237
926172 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46223
926113 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46222
926102 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #46188
925430 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46213
924828 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46195
925972 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #46220
918817 dotnet/sdk Microsoft.NET.Build.Tests.dll.18.WorkItemExecution #46010
925907 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46101
925869 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46184
925579 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.20.WorkItemExecution #46186
925765 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45969
925467 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46215
925445 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution #46214
925439 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #46108
925397 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45932
925359 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46045
925341 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46211
925270 dotnet/sdk Microsoft.NET.Publish.Tests.dll.2.WorkItemExecution #46209
925259 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45362
925244 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46208
924843 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #46200
924794 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46190
924723 dotnet/sdk dotnet.Tests.dll.1.WorkItemExecution #46164
924720 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46141
924714 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46188
924692 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46166
924379 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #46141
924465 dotnet/sdk Microsoft.NET.Build.Tests.dll.16.WorkItemExecution #46179
924419 dotnet/sdk Microsoft.NET.Publish.Tests.dll.2.WorkItemExecution #46178
924389 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #46177
923505 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #46002
924106 dotnet/sdk Microsoft.NET.Publish.Tests.dll.11.WorkItemExecution #45362
924083 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.20.WorkItemExecution #46168
924068 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.21.WorkItemExecution #46142
923901 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #46164
924003 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46055
923301 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #46142
923662 dotnet/sdk Microsoft.NET.Publish.Tests.dll.11.WorkItemExecution #46158
923563 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46146
923562 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46145
923127 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46136
923023 dotnet/sdk Microsoft.NET.Build.Tests.dll.17.WorkItemExecution #46127
923345 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46141
923343 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46137
923312 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46143
923210 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #45932
923196 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46139
922434 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45997
923136 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution #46137
923117 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46132
923102 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #46134
923090 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #46045
922994 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45792
922961 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46045
Displaying 100 of 324 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
10 111 324
@dotnet-issue-labeler dotnet-issue-labeler bot added Area-Infrastructure untriaged Request triage from a team member labels Apr 9, 2024
@ericstj ericstj mentioned this issue May 20, 2024
Merged
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024 •
edited
Loading

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@ViktorHofer ViktorHofer mentioned this issue Jun 20, 2024
Merged
@ellahathaway ellahathaway mentioned this issue Jul 2, 2024
Closed
@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

@akoeplinger akoeplinger changed the title Darwin Build_Release failure on Helix tests - Tests timing out Failure on Helix tests - Tests timing out Nov 15, 2024
@akoeplinger akoeplinger mentioned this issue Nov 15, 2024
Closed
@marcpopMSFT marcpopMSFT added this to the 10.0.1xx milestone Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Area-Infrastructure Area-Watch Known Build Error untriaged Request triage from a team member
Projects
None yet
Milestone
10.0.1xx
Development

No branches or pull requests
5 participants
@tmat @baronfel @marcpopMSFT @MiYanni @nagilson