[source code analysis] sending Task & AMQP of distributed task queue Celery

[source code analysis] sending task & AMQP of distributed task queue Celery 0x00 summary Celery is a simple, flexible and reliable distributed system that processes a large number of messages. It focuses on asynchronous task queue for real-time processing, and also supports task scheduling. In the previous article, we saw the analysi ...

Posted by feldon23 on Fri, 04 Mar 2022 07:41:19 +0100

A task of Django+Celery is revoked

Premise: it is necessary to perform the function of suspending (revoking) a task without affecting the continued execution of other tasks Find out that celery 3.0 has the revoke function The official document of celery describes revoke Here is the test code Django3.2.8 (this version is not important, but the following two are important) django ...

Posted by AKA Panama Jack on Fri, 15 Oct 2021 04:39:48 +0200

Mongodb update array $pull modifier

1. $pull modifier deletes qualifying elements from the array in the following format: { $pull: { <field1>: <value|condition>, <field2>: <value|condition>, ... } } 2. Specify a value to delete all lists Give a document under a stores collection { _id: 1, fruits: [ "apples", "pears", "oranges", "grapes", "bana ...

Posted by vex__ on Mon, 20 Jul 2020 16:51:29 +0200

9. Three times class (December 20) 17.3 / 17.4 cellular multi instance 17.5 cellular and scheduled tasks

9. Three classes (December 20) 17.3 / 17.4 cellery multi instance Multiple worker s, multiple queues [root@localhost celery]# cat tasks.py #!/usr/bin/env python #-*- coding:utf-8 -*- from celery import Celery app = Celery() app.config_from_object("celeryconfig") @app.task def taskA(x,y): return x + y @app.task de ...

Posted by neostrife on Tue, 05 May 2020 21:39:28 +0200

Air flow FAQ

@[toc] Air flow FAQ Installation problem 1. ERROR "Python setup. Py XXX" appears during installation. Question: First, you need to update pip Version required'pip install --upgrade pip' command. Second is setuptools The version is too old, so there are the following problems Command "python setup.py egg_info" failed with error code ...

Posted by ryanthegecko on Sun, 29 Dec 2019 18:31:02 +0100

Celery Manually Configure Routing

Running environment: Win10 celery 3.1.18 RabbitMQ 1. Demand We have many different tasks with different priorities, such as video upload and compression tasks, photo compression upload tasks and other unimportant tasks.These tasks take different time and require different worker s to process them.Just using celery's default queue won't ...

Posted by cohq82 on Mon, 15 Jul 2019 18:22:54 +0200

Asynchronous Task Artifact Celery Quick Start Tutorial

In the process of running programs, we often encounter time-consuming and resource-consuming operations. To avoid them blocking the main program, we often use multithreaded or asynchronous tasks.For example, in Web development, when a new user is registered, we usually send him an activation email, which is an IO blocking task. If you put it di ...

Posted by teng84 on Mon, 24 Jun 2019 18:34:46 +0200

Operations and Maintenance Management Platform Development Ideas

1 Application Technology back-end Python3.7 Django2.x Celery4.x Saltstack Restful Mysql Redis Front end jquery bootstrap bootstrap-table bootstrap-fileinput 2 Implementation process 2.1 CMDB Asset Management 2.1.1 Asset Input Fill in the form on the front page. Submit data to Django background. Write to Mysql database through Django Orm o ...

Posted by herbal_lavender on Sat, 18 May 2019 08:39:29 +0200

Swift 4.03 Learning Notes (1)

Basic knowledge Declare variables or constants Variables are defined with var and constants are defined with let. var myVariable = 42 myVariable = 50 let myConstant = 42 When the type variable or constant type is not specified, the system automatically infers the type of the variable or constant. If the type==myVariable=== is inferred as an i ...

Posted by kiss_FM on Sat, 11 May 2019 03:03:21 +0200

Integration of Django+Django-Celery+Celery

This article is mainly due to the plan to use django to write a planned task, which can rotate the name of the staff on duty or execute scripts on time and other functions. After Baidu has countless pits, it can finally make use of this set of things to deploy. My English is not good, English is good or people who want to learn ...

Posted by tinkertron on Fri, 10 May 2019 11:12:03 +0200