Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert task interrupted because worker gets killed #120

Open
wetneb opened this issue Aug 30, 2024 · 0 comments
Open

Revert task interrupted because worker gets killed #120

wetneb opened this issue Aug 30, 2024 · 0 comments

Comments

@wetneb
Copy link
Member

wetneb commented Aug 30, 2024

This happened today on editgroups-commons:

[2024-08-30 14:24:21,458: INFO/MainProcess] Task revert_batch[ddf63a4e-27fc-4a66-8152-dcf2b323b53f] received
[2024-08-30 14:24:33,246: INFO/Beat] Scheduler: Sending due task inspect_batches (inspect_batches)
[2024-08-30 14:24:33,259: INFO/MainProcess] Task inspect_batches[d6fe33ba-b88c-4d21-8fdb-50f7bc1283e6] received
[2024-08-30 14:24:33,351: ERROR/MainProcess] Process 'ForkPoolWorker-8' pid:16 exited with 'signal 9 (SIGKILL)'
[2024-08-30 14:24:33,389: ERROR/MainProcess] Task handler raised error: WorkerLostError('Worker exited prematurely: signal 9 (SIGKILL) Job: 120.')
Traceback (most recent call last):
  File "/data/project/editgroups-commons/www/python/venv/lib/python3.11/site-packages/billiard/pool.py", line 1264, in mark_as_worker_lost
    raise WorkerLostError(
billiard.einfo.ExceptionWithTraceback: 
"""
Traceback (most recent call last):
  File "/data/project/editgroups-commons/www/python/venv/lib/python3.11/site-packages/billiard/pool.py", line 1264, in mark_as_worker_lost
    raise WorkerLostError(
billiard.exceptions.WorkerLostError: Worker exited prematurely: signal 9 (SIGKILL) Job: 120.
"""
[2024-08-30 14:24:33,659: INFO/ForkPoolWorker-9] Task inspect_batches[d6fe33ba-b88c-4d21-8fdb-50f7bc1283e6] succeeded in 0.3911465781275183s: None
[2024-08-30 14:34:33,243: INFO/Beat] Scheduler: Sending due task inspect_batches (inspect_batches)
[2024-08-30 14:34:33,252: INFO/MainProcess] Task inspect_batches[0b0219a3-9f82-4ac0-a9fe-096660cdab84] received
/data/project/editgroups-commons/www/python/src/tasks.sh: line 18:     7 Killed                  /data/project/editgroups-commons/www/python/venv/bin/python3 /data/project/editgroups-commons/www/python/venv/bin/celery --app=editgroups.celery:app worker -l INFO -B
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant