Programmer Think

Abstract: DeltaFIFO is a Queue used to store and process data in K8s. Compared with traditional FIFO, it not only stores data and ensures first in first out, but also stores the type of K8s resource object. It is an important channel connecting reflector (producer) and indexer (consumer). This article is shared from Huawei cloud community&lt ...

[overview] This is the first article in the hudi series, which first deepens the understanding of the concept from the core concept and the stored file format, and then gradually shares the use (spark/flink into hudi, hudi synchronous hive, etc.) and principles (compression mechanism, index, clustering, etc.) [what is a d ...

Introduction to Redis database As a mature data storage middleware, Redis provides perfect data management functions, such as data expiration mentioned earlier and the data evict strategy we want to talk about today. Data locality principle The principle of locality, which runs through computer science, can clearly tell you that there are tw ...