Celery (software)

This article is about the software. For the vegetable, see Celery.
Celery
Stable release
4.0.0 / November 4, 2016 (2016-11-04)
Repository github.com/celery/celery
Written in Python
Platform Cross-platform
Available in Python
Type Message-oriented middleware
License BSD License
Website celeryproject.org

Celery is an open source asynchronous task queue or job queue which is based on distributed message passing. While it supports scheduling its focus is on operations in real time.[1]

Overview

The execution units, called tasks, are executed concurrently on one or more worker nodes using multiprocessing, eventlet or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready). Celery is used in production systems, by the likes of Instagram and AdRoll, to process millions of tasks every day.[1]

Technology

Celery is written in Python, but the protocol can be implemented in any language. It can also operate with other languages using webhooks.[2] There is also a Ruby-Client called RCelery,[3] a PHP client,[4] and a Node.js client.[5]

The recommended message broker is RabbitMQ, or Redis. Additionally, MongoDB, Beanstalk,[lower-roman 1][lower-roman 2] Amazon SQS, CouchDB, IronMQ and databases (using SQLAlchemy or the Django ORM) are supported in status experimental.[7]

See also

References

  1. 1 2 Celery: Distributed Task Queue
  2. ↑ "HTTP Callback Tasks (Webhooks) — Celery 3.1.23 documentation". docs.celeryproject.org. Retrieved 2016-08-17.
  3. ↑ "leapfrogonline/rcelery". GitHub. Retrieved 2016-08-17.
  4. ↑ "gjedeer/celery-php". GitHub. Retrieved 2016-08-17.
  5. ↑ "mher/node-celery". GitHub. Retrieved 2016-08-17.
  6. ↑ http://docs.celeryproject.org/en/latest/getting-started/brokers/beanstalk.html
  7. ↑ "Brokers — Celery 3.1.23 documentation". docs.celeryproject.org. Retrieved 2016-08-17.
Notes
  1. ↑ NB - This is not Amazon's Elastic Beanstalk
  2. ↑ "currently not working well"[6]

External links


This article is issued from Wikipedia - version of the 11/7/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.