Programmer Think

catalogue 0. Links to related articles 1. Introduction to flinksql integration Hive 2. Basic ways of integrating Hive 2.1. Persistent metadata 2.2. Use Flink to read and write Hive's table 3. Preparation 4. SQL CLI 5. Code demonstration 0. Links to related articles Flink article summary 1. Introduction to flinksql integration Hive ...

self-introduction xdm well, I'm a jump table, an ordered data structure. There is an array in each of my nodes. I maintain multiple pointers that can point to other nodes, so I can quickly access these nodes. That's why I'm a jump table. My average time complexity is O(logN). At worst, it is O(N). In most cases, I can compare with the efficie ...

This article is translated from Python & APIs: A Winning Combo for Reading Public Data Article code address https://github.com/realpython/materials/tree/master/consuming-apis-python?__s=kea6w26ii09uqhijmy0b Python+API: a perfect match for reading public data go to top Learning to use different APIs is a magical skill, and many applica ...

9.1 migrate the data of the original CM node to the new node 9.1.1 backup the original CM node data It mainly backs up the monitoring data and management information of CM. The data directory includes: /var/lib/cloudera-host-monitor /var/lib/cloudera-service-monitor /var/lib/cloudera-scm-server /var/lib/cloudera-scm-eventserver /var/lib/clou ...

1, Analysis target 1. Establish daily operation index system; 2. Analyze the composition of existing users and count the composition of daily users; 3. Analyze the re purchase situation of users and guide the subsequent re purchase operation. 2, Data description User_info user information table: user_action user behavior table: 3, Imp ...

3.2 RDD programming In Spark, RDD is represented as an object, and RDD is converted through method calls on the object. After defining RDD through a series of transformations, you can call actions to trigger the calculation of RDD. Actions can be to return results to the application (count, collect, etc.) or to save data to the storage system ...

1. Classes and objects 1.1 what is the object? Everything is an object, and everything that exists objectively is an object 1.2 what is object-oriented? The action of paying attention to objects is called object-oriented For example, I'm going to the supermarket to buy fruit. Fruit is an object. I pay attention to its type, size, acidity a ...

👨‍🎓 Blogger introduction: IT Bond, a Jianghu person jeames007，10 year DBA hands-on background China DBA union(ACDU)Member, currently engaged in DBA And program programming SQL is almost a necessary skill for the production and research position of Internet companies, but if you only know SQL, you can't do anything. 1. If you are a da ...

Introduction to LEFT SEMI JOIN The main use scenario of SEMI JOIN (equivalent to LEFT SEMI JOIN) is to solve EXISTS IN. LEFT SEMI JOIN is a more efficient implementation of IN/EXISTS sub query. Although LEFT SEMI JOIN contains LEFT, its implementation effect is equivalent to INNER JOIN, but the JOIN result only takes the columns in the orig ...

Note that we should distinguish between data skew and excessive data. Data skew means that a few tasks are assigned most of the data, so a few tasks run slowly; Excessive data means that the amount of data allocated to all tasks is very large, the difference is not much, and all tasks run slowly. What is data skew In short, data s ...