[ES source code analysis] initialization of Transport module
Initialization of Transport module
The initialization of the transport module is mainly completed in the constructor when the node is started.
When the node is started, the communication module is initialized mainly in the build function.
protected Node(
final Environment environment, Collection<Class<? extends Plug ...
Posted by romano2717 on Thu, 20 Jan 2022 12:55:35 +0100
[big data platform construction] Greenplum 6.17 cluster construction
Cluster planning
HostIPfunctioncentos01192.168.52.221mastercentos02192.168.52.222segmentcentos03192.168.52.223segment
It is a cluster composed of three machines in total, and the standby node is not set up
System environment
nameexplainoperating systemCentos7GreenplumGreenplum 6.17JavaJDK8GCCGCC 4.8.5
Modify system files
Modify the system r ...
Posted by noginn on Thu, 20 Jan 2022 05:19:02 +0100
Elasticsearch Chinese character completion and spelling correction
1 effect achieved using ES
Chinese character completion Spelling correction
2 product search and automatic completion
Term Advisor: term advisor. Word segmentation is performed for the input text, and word item suggestions are provided for each word segmentation Phrase suggester: phrase suggester. Based on terms, it will consider th ...
Posted by KindredHyperion on Thu, 20 Jan 2022 02:17:31 +0100
Prediction of future disease burden using GBD database
Recently, I saw a literature that used the data in GBD database to predict the development trend of disease burden. I found it very interesting, so I took the time to repeat the key methods in R language.
reference: Changing trends in the disease burden of esophageal cancer in China from 1990 to 2017 and its predicted level in 25 years DOI: 10 ...
Posted by realjumper on Thu, 20 Jan 2022 00:46:55 +0100
Elasticsearch introduction to mastery - Elasticsearch IK automatic hot update principle and Implementation
1, Thermal renewal principle
elasticsearch will refresh the dictionary every 60s after the function of loading external dictionary is enabled. The specific principle code is as follows:
public void loadDic(HttpServletRequest req,HttpServletResponse response){
String eTag =req.getParameter("If-None-Match");
try {
OutputStream o ...
Posted by byenary on Wed, 19 Jan 2022 07:30:00 +0100
Elastic: backup and recovery
In my previous article“ Elasticsearch: Cluster backup Snapshot and Restore API ”, I will describe in detail how to backup and restore the desired index or cluster state using the snapshot and restore API interfaces officially provided by Elastic.
In today's article, we will use another method to backup and restore an index in an el ...
Posted by Niel Roos on Wed, 19 Jan 2022 07:23:38 +0100
Big data cluster software installation manual 1
1. Install Centos system
The software list is as follows:
WMware Workstation 12 CentOS-7-x86_64-DVD-1810.iso jdk-8u181-linux-x64.tar.gz hadoop-2.7.3.tar.gz hbase-1.2.7-bin.tar.gz apache-hive-2.1.1-bin.tar.gz kafka_2.11-1.1.0.tgz spark-2.3.2-bin-hadoop2.7.tgz apache-flume-1.8.0-bin.tar.gz Note: since three hosts need to be simulated on the ...
Posted by snakez on Tue, 18 Jan 2022 09:25:26 +0100
Flink parsing: time window
catalogue
Time concept
WaterMarks and window concept
watermark data structure
Multi source watermark processing
window
Tumbling Windows scrolling window
Sliding Windows sliding window
Session Windows session window
Global Windows global window
Triggers window trigger
Fire and purge
WindowAssigner default Triggers
Built in Triggers ...
Posted by tharagleb on Mon, 17 Jan 2022 22:58:46 +0100
How to build hadoop cluster
How to build hadoop cluster
1. Mapping of host name and corresponding IP
Open the hosts file
vi /etc/hosts
Add host name and corresponding ip address
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
10.192.30.40 hadoop101
10.192 ...
Posted by gum1982 on Mon, 17 Jan 2022 03:59:43 +0100
Data science and big data technology -- cloud computing ● virtualization course final examination paper and brief answer
comprehensive review of virtual cloud computing
review question 1:
I. multiple choice questions (3 points for each question, 48 points in total)
1. (multiple choice) common types of virtualization are ABCD. (A) server virtualization (B) desktop virtualization (C) storage virtualizati ...
Posted by almightyegg on Sun, 16 Jan 2022 20:31:41 +0100