Pain point · Reliability & bugs · Causes churn
Reschedule-mode sensors fail with executor state mismatch, hurting SLAs
2 source threads · first seen 2020-09 · last seen 2024-05
Summary
Thousands of tasks, about 2000 a day for one team, move to retry with an executor reports finished while queued error, causing significant SLA impact.
- Affects
- Teams using ExternalTaskSensors with Celery
Evidence
Excerpts are copied word for word from the source; follow the link to read it in full.
“every day I see my tasks being killed randomly without good reasoning behind why it got killed/failed”
“I'm copying over a JIRA for a bug that has significant negative impact on our pipeline SLAs”