Programmer Think

background From the perspective of source code, this paper mainly analyzes how the bottom layer of flink allocates tasks to each task executor for execution, as well as the thread model of task execution. It will involve how jobmaster distributes tasks to taskExecutor, the detailed process of task execution by taskExecutor, and the mailBox thr ...

Timer used in Flink program Sometimes, we need to use timers in computing tasks to help us deal with business, such as automatic settlement of orders? Automatic praise? Regular collection? Wait However, it should be noted that we cannot flexibly configure CRON expressions for computing tasks, but only specify the trigger time. 1, What kind o ...

preface This article belongs to the column "1000 problems to solve big data technology system", which is original by the author. Please indicate the source of quotation. Please help point out the deficiencies and errors in the comment area. Thank you! Please refer to table of contents and references for this column 1000 problems ...

Real time is the future. Recently, we shared real-time computing services at Tencent cloud computing Oceanus (Flink)~Project backgroundThis paper introduces how to build a real-time data warehouse by combining MySQL database, stream computing Oceanus (Flink), HBase and cloud data warehouse ClickHouse, read MySQL data through stream computing Oc ...

This article was first published in Simple book of mooring and floating purpose:https://www.jianshu.com/u/204...editiondateremarks1.02021.12.20Article launch0. PrefaceWhen I first came into contact with Flink, it was shared by some leading players in the industry - we will use it to process massive data. In this scenario, the problem of how to ...

Broadcast status mode In this section, you will learn how to use broadcast status in practice. See yes Stateful Stream Processing To understand the concepts behind stateful flow processing. API provided In order to demonstrate the provided API s, we will start with an example and then show their full functionality before showing their fu ...

WeChat official account: big data development and operation framework Follow to learn more about big data. For official account, please leave a message. If you think "big data development operation and maintenance architecture" is helpful to you, please forward it to the circle of friends Copy from WeChat official account, some of ...

For distributed execution, Flink links the subtasks of operators together to form tasks, and the operators in each subtask are connected into a chain, that is, the Operator chain. Compared with each task executed by one thread, linking operators into tasks is a useful optimization: it reduces the overhead of inter thread switching and buffe ...

Statement: this series of blogs is compiled according to SGG's videos, which is very suitable for you to learn. Some articles are collected by crawlers and other technical means in order to learn and share. If there is a copyright problem, please leave a message and delete it at any time. The latest version of big data interview questions in 2 ...

Statement: this series of blogs is compiled according to SGG's videos, which is very suitable for you to learn. Some articles are collected by crawlers and other technical means in order to learn and share. If there is a copyright problem, please leave a message and delete it at any time. The latest version of big data interview questions in 2 ...