Questions tagged [celery]

0 votes
0 replies
Unable to broadcast message using celery
I'm trying to use celery's build in support for broadcast routing using Broadcast and using rabbitmq as the broker. I have been able to successfu...
0 votes
1 replies
Removing items from celery_beat doesn't remove them from database schedule
I'm using django-celery-beat in a django app (this stores the schedule in the database instead of a local file). I've configured my schedule via...
asked 1 month ago
0 votes
0 replies
celery:why is it useful when I delete the item “search localdomain” in /etc/resolv.conf
when I use " celery -A tasks worker -l info " , then the worker node occurs following : [2019-04-26 20:27:00,290: ERROR/MainProcess] consumer: C...
asked 1 month ago
0 votes
0 replies
Starting Celery jobs from CouchDB _changes
CouchDB can produce "notifications" by polling on a _changes endpoint. I would like to have Celery pull it's task arguments from _changes. I am f...
asked 1 month ago
0 votes
0 replies
Unable to run Django Celery after following documentation
I'm attempting to implement celery into a current ongoing django 2 project. I'm using django 2.13 and celery 4.3. Here the code in the init.py:...
0 votes
0 replies
Adding Queues to Rabbitmq and workers to the queues in Celery
Trying to execute about 66 python scripts that do some data manipulation tasks. Three scripts take an awful amount of time to execute as they are...
asked 1 month ago
0 votes
1 replies
Why does Celery have different behaviors in two ways of starting the worker?
I added a Celery worker into package app: proj ├── app │   ├── worker.py │   └── server.py └── db ├── db.sql ├── check_db_health.py...
0 votes
0 replies
Flask - jsonify Celery task results
I have a long Celery task: @celery.task(queue='cache') def cache_user_tracks(user_id): # generator - yields external api calls tracks =...
asked 1 month ago
0 votes
1 replies
celery: print the status of each task within a group started with apply_async
I am trying to print the status of 4 remote tasks, obaining info from each AsyncResult within the group. So far I am able to print the status,...
asked 1 month ago
0 votes
0 replies
Celery: The module was not found
I am using Open Semantic Search (OSS) and I would like to monitor its processes using the Flower tool. The workers that Celery needs should be gi...
asked 1 month ago
0 votes
1 replies
How can I change the name of a task that Celery sends to a backend?
I have built a queue system using Celery that accepts web requests and executes some tasks to act on those requests. I'm using Redis as the backe...
asked 1 month ago
0 votes
0 replies
Ramification of using unique queue for each task with redis backend
I realized that Redis backend for celery stores each task request in a list under a queue. This makes deleting (aborting) a pending task horribl...
asked 1 month ago
0 votes
0 replies
Airflow operators on_kill and celery timeout
We would like to set a celery timeout to 2 hours with visibility_timeout option. our dag submits the jobs to an external api's to be run in their...
asked 1 month ago
0 votes
1 replies
Celery Accepting more tasks than worker concurrency
I am running few long running tasks in dedicated queue. So there are no short time running tasks. Currently when i start many multiple tasks on...
0 votes
1 replies
Cannot import name App when using Celery in Flask
I am writing a simple Flask app that uses Celery to run a background task, but when i try to run the app on terminal i get the following error me...
asked 1 month ago
0 votes
2 replies
Failed to starting the worker process Celery task with Django in debug = False (production)
This is a Celery task for sending email, the funny thing that everything works correctly in DEBUG = True mode, but it does not work in production...
asked 1 month ago
0 votes
1 replies
Query results from Celery Results Backend MYSQL
What is the simplest way to query all results from a result backend in celery? I am using a MySQL datastore as my result backend. Celery stores...
asked 1 month ago
2 votes
2 replies
Not able to see the output messages of the tasks performed in celery-rabbitMQ combination
I am trying out celery and rabbitMQ combinations for asynchronous task scheduling, below is the sample program I tried on Pycharm IDE....Everythi...
0 votes
1 replies
How can a worker (thread) reserve disk space and communicate the reservation with other workers
I am trying to set up an autoscaling class that will check the disk resource to see if a worker can safely run. The disk usage can be estimated p...
asked 1 month ago
0 votes
0 replies
convert rrule to cron value in python to support celery beat
Hi I am trying to implement celery-beat to schedule services, but our UI is designed to send data in rrule format in json request. Is there any w...
asked 2 months ago
0 votes
1 replies
Unable to start the celery workers (Flask Application)
I am trying out celery with Python Flask. celery_example.py from __future__ import absolute_import, unicode_literals from flask import Flask fr...
asked 2 months ago
0 votes
0 replies
Is it possible to call a task in a chain with the option *max_retries* being parameterized?
I need to perform the same task in different chains with different behavior. For chain A, I want to limit the number of restarts, so I specify th...
asked 2 months ago
1 votes
1 replies
Celery task calling itself after task succeeds without celerybeat
I want to call my celery task occasionally like every 30minutes after the current task done, But sometimes task takes longer than expected becaus...
asked 2 months ago
1 votes
0 replies
What is the meaning of CELERY_TIMEZONE variable in the settings.py file of a Django project?
I know that USE_TZ=True saves all the datetime objects in UTC in the database. In that case, when a task is scheduled to run at regular period of...
asked 3 months ago
0 votes
1 replies
Unhandled exception in celery freezes workers
I am running celery in docker via a redis backend. I have celery-beat container celery-worker container redis container The celery worker c...
asked 2 months ago