Take you to understand K8s DeltaFIFO from five functions

Abstract: DeltaFIFO is a Queue used to store and process data in K8s. Compared with traditional FIFO, it not only stores data and ensures first in first out, but also stores the type of K8s resource object. It is an important channel connecting reflector (producer) and indexer (consumer). This article is shared from Huawei cloud community&lt ...

Posted by jmantra on Thu, 24 Feb 2022 09:15:58 +0100

Understanding its core concepts from hudi persistence files

[overview] This is the first article in the hudi series, which first deepens the understanding of the concept from the core concept and the stored file format, and then gradually shares the use (spark/flink into hudi, hudi synchronous hive, etc.) and principles (compression mechanism, index, clustering, etc.) [what is a d ...

Posted by QbertsBrother on Sun, 20 Feb 2022 05:10:02 +0100

[Special Topic on Redis source code analysis] from the essence analysis, why is the data you wrote in Redis missing?

Introduction to Redis database As a mature data storage middleware, Redis provides perfect data management functions, such as data expiration mentioned earlier and the data evict strategy we want to talk about today. Data locality principle The principle of locality, which runs through computer science, can clearly tell you that there are tw ...

Posted by mtucker6784 on Fri, 12 Nov 2021 21:03:21 +0100