[ES source code analysis] initialization of Transport module

Initialization of Transport module The initialization of the transport module is mainly completed in the constructor when the node is started. When the node is started, the communication module is initialized mainly in the build function. protected Node( final Environment environment, Collection<Class<? extends Plug ...

Posted by romano2717 on Thu, 20 Jan 2022 12:55:35 +0100

[big data platform construction] Greenplum 6.17 cluster construction

Cluster planning HostIPfunctioncentos01192.168.52.221mastercentos02192.168.52.222segmentcentos03192.168.52.223segment It is a cluster composed of three machines in total, and the standby node is not set up System environment nameexplainoperating systemCentos7GreenplumGreenplum 6.17JavaJDK8GCCGCC 4.8.5 Modify system files Modify the system r ...

Posted by noginn on Thu, 20 Jan 2022 05:19:02 +0100

Elasticsearch Chinese character completion and spelling correction

1 effect achieved using ES Chinese character completion Spelling correction 2 product search and automatic completion Term Advisor: term advisor. Word segmentation is performed for the input text, and word item suggestions are provided for each word segmentation Phrase suggester: phrase suggester. Based on terms, it will consider th ...

Posted by KindredHyperion on Thu, 20 Jan 2022 02:17:31 +0100

Prediction of future disease burden using GBD database

Recently, I saw a literature that used the data in GBD database to predict the development trend of disease burden. I found it very interesting, so I took the time to repeat the key methods in R language. reference: Changing trends in the disease burden of esophageal cancer in China from 1990 to 2017 and its predicted level in 25 years DOI: 10 ...

Posted by realjumper on Thu, 20 Jan 2022 00:46:55 +0100

Elasticsearch introduction to mastery - Elasticsearch IK automatic hot update principle and Implementation

1, Thermal renewal principle elasticsearch will refresh the dictionary every 60s after the function of loading external dictionary is enabled. The specific principle code is as follows: public void loadDic(HttpServletRequest req,HttpServletResponse response){ String eTag =req.getParameter("If-None-Match"); try { OutputStream o ...

Posted by byenary on Wed, 19 Jan 2022 07:30:00 +0100

Elastic: backup and recovery

In my previous article“ Elasticsearch: Cluster backup Snapshot and Restore API ”, I will describe in detail how to backup and restore the desired index or cluster state using the snapshot and restore API interfaces officially provided by Elastic. In today's article, we will use another method to backup and restore an index in an el ...

Posted by Niel Roos on Wed, 19 Jan 2022 07:23:38 +0100

Big data cluster software installation manual 1

1. Install Centos system The software list is as follows: WMware Workstation 12 CentOS-7-x86_64-DVD-1810.iso jdk-8u181-linux-x64.tar.gz hadoop-2.7.3.tar.gz hbase-1.2.7-bin.tar.gz apache-hive-2.1.1-bin.tar.gz kafka_2.11-1.1.0.tgz spark-2.3.2-bin-hadoop2.7.tgz apache-flume-1.8.0-bin.tar.gz Note: since three hosts need to be simulated on the ...

Posted by snakez on Tue, 18 Jan 2022 09:25:26 +0100

Flink parsing: time window

catalogue Time concept WaterMarks and window concept watermark data structure Multi source watermark processing window Tumbling Windows scrolling window Sliding Windows sliding window Session Windows session window Global Windows global window Triggers window trigger Fire and purge WindowAssigner default Triggers Built in Triggers ...

Posted by tharagleb on Mon, 17 Jan 2022 22:58:46 +0100

How to build hadoop cluster

How to build hadoop cluster 1. Mapping of host name and corresponding IP Open the hosts file vi /etc/hosts Add host name and corresponding ip address 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 10.192.30.40 hadoop101 10.192 ...

Posted by gum1982 on Mon, 17 Jan 2022 03:59:43 +0100

Data science and big data technology -- cloud computing ● virtualization course final examination paper and brief answer

  comprehensive review of virtual cloud computing   review question 1:   I. multiple choice questions (3 points for each question, 48 points in total)    1. (multiple choice) common types of virtualization are ABCD.   (A) server virtualization   (B) desktop virtualization   (C) storage virtualizati ...

Posted by almightyegg on Sun, 16 Jan 2022 20:31:41 +0100