Programmer Think

Elasticsearch Version: 7.16.2 Official website: https://www.elastic.co/cn/elasticsearch/ file: https://www.elastic.co/guide/index.html 1 Introduction 1.1 what is Elasticsearch Elasticsearch is a distributed search and analysis engine located at the core of Elastic Stack. Logstash and Beats help you collect, aggregate, enrich, and s ...

0. Introduction The data synchronization from mysql to es involves the data synchronization of parent-child tables. It is hereby recorded for subsequent reference For details on synchronizing mysql to es, please refer to my previous blog: Elastic actual combat: through canal1 1.5 realize mysql8 0 data increment / full synchronization to elast ...

Catalog 0. Links to related articles 1. select operator 2. where operator 3. distinct operator 4. group by operator 5. union and union all operators 6. join operator 7. group window operator 7.1. tumble window operator 7.2. hop window operator 7.3. session window operator 0. Links to related articles Flink Article Summary 1. sele ...

DataStream common operators In the Flink application, whether your application is a batch program or a stream program, it is the model shown in the figure above. There are data sources and data sink s. The applications we write mostly do a series of operations on the data from the data source, which are summarized as follows. Source: da ...

Here we introduce the use of free and open source Pytdx interface to obtain real-time market data and store it in the database in real time (mongodb/myslq). Pytdx is an implementation of market data interface similar to TradeX developed in pure Python language. It provides real-time market data of various stocks / futures / options and so on. ...

Environmental description and purpose Preparation: I prepared three virtual machines myself Using Hyper-V to build virtual machine cluster environment on windows platform_ a18792721831 blog - CSDN blog The environment is as follows hostnameNodedataNoderesourceManagernodeManagerOpening to the outside worldhadoop01start-upDo not startstart ...

1. Introduction to processfunction 1.1 description on API A function that processes elements of a stream. For every element in the input stream processElement(Object, ProcessFunction.Context, Collector) is invoked. This can produce zero or more elements as output. Implementations can also query the time and set timers through the p ...

1. Hype-V virtual machine installation openEuler There are many virtual machine platforms, such as vmware, Hype-V, VirtualBox, etc. Considering the compatibility with wsl2, Hype-V is selected here to install the x86 architecture openEuler Turn on the hype-v virtual machine Download the x86 architecture openEuler image Open the openEuler of ...

1, HDFS overview 1. HDFS generation background With the increasing amount of data, if there is not enough data in one operating system, it will be allocated to more operating systems But it is not convenient for management and maintenance. There is an urgent need for a system to manage files on multiple machines Distributed file managemen ...

I Cluster environment construction Environmental preparation (1) Server configuration IP host name Environment configuration install 10.100.100.42 node01 Close the firewall and selinux,host mapping, and clock synchronization JDK,NameNode,ResourceManager,Zookeeper 10.100.100.43 node02 Close the firewall and selinux,host mapping ...