Issue:
A recent release of the Python click module, version 8.3.0, has been observed to cause Airflow worker pods to enter a CrashLoopBackOff state in certain environments. When this happens:
Worker pods continuously fail and restart.
Tasks scheduled to run on those workers get stuck in the queue and do not execute.
The error affects systems using
clickv8.3.0 as a dependency (directly or transitively).
PyPI release notes: https://pypi.org/project/click/8.3.0/
General error noticed in workers:
[2025-09-23 07:51:57 +0000] [33] [INFO] Starting gunicorn 23.0.0
[2025-09-23 07:51:57 +0000] [33] [INFO] Listening at: http://[::]:8793 (33)
[2025-09-23 07:51:57 +0000] [33] [INFO] Using worker: sync
[2025-09-23 07:51:57 +0000] [34] [INFO] Booting worker with pid: 34
[2025-09-23 07:51:57 +0000] [35] [INFO] Booting worker with pid: 35
[2025-09-23 07:51:57 +0000] [33] [INFO] Handling signal: term
[2025-09-23 07:51:57 +0000] [34] [INFO] Worker exiting (pid: 34)
[2025-09-23 07:51:57 +0000] [35] [INFO] Worker exiting (pid: 35)
[2025-09-23 07:51:57 +0000] [33] [INFO] Shutting down: Master
In some cases, users notice the following error on workers:
File "/usr/local/lib/python3.12/site-packages/celery/bin/base.py", line 135, in caller
return f(ctx, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/celery/bin/worker.py", line 351, in worker
pidfile=node_format(pidfile, hostname),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/celery/utils/nodenames.py", line 85, in node_format
shortname, host = nodesplit(name)
^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/celery/utils/nodenames.py", line 71, in nodesplit
parts = name.split(NODENAME_SEP, 1)
^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'split'
Recommended Action / Workaround
To restore stable operation, pin click to v8.2.1 until a version is released that resolves these issues.
-
In your requirements.txt
click==8.2.1
Comments
0 comments
Please sign in to leave a comment.