Programmer Think

Set up hadoop,zookeeper,kafka in the environment of data warehouse collection Previous Aliyun ECS environment has been installed, now start to formally set up the project environment hadoop installation configuration 1. Cluster Planning Server hadoop102Server hadoop103Server hadoop104HDFSNameNodeDataNodeDataNodeDataNodeSecondaryNameNod ...

principle summary NameNode active / standby switchover is mainly realized by three components: ZKFailoverController, HealthMonitor and ActiveStandbyElector. HealthMonitor is responsible for monitoring the health of NN, starting a thread to send rpc request, confirming the NN status according to the response, and notifying zkfc through cal ...

1, Deployment planning hadoop high availability cluster deployment reference: Hadoop 3. X distributed high availability cluster deployment 1.1 version description Softwareeditionoperating systemCentOS Linux release 7.8.2003 (Core)JAVAjdk-8u271-linux-x64Hadoophadoop-3.2.2Hivehive-3.1.2 1.2 cluster planning hive remote mode & & hivese ...

How to connect hbase stand-alone version (using external zk) and java api 0 create modify information timecontentremarks20210927create documents 0 version Component nameeditionDownload addressoperating systemcentos7CentOS-7-x86_64-DVD-2009.isojdk1.8jdk-8u301-linux-x64.tar.gzhadoop3.0.0hadoop-3.0.0.tar.gzzookeeper3.4.5zookeeper-3.4.5.tar.gzhb ...

Configuring eclipse development environment with hadoop 1, Foreword Due to the learning needs of my junior year and the vagueness of the online tutorials, I have taken a lot of detours. Therefore, I write this blog. This article is for reference only. If there are deficiencies, I hope to point out. 2, Install eclipse 1. Download eclipse jee ...

2021SC@SDUSC catalogue HBase overview HBase cluster installation Hadoop installation and configuration ZooKeeper installation and configuration Hbase installation and configuration   Hbase source code download Intra group division of labor 2021SC@SDUSC HBase overview HBase is a distributed, high reliable The NoSQL ...

HDFS troubleshooting 1. NameNode fault handling Requirements: The NameNode process hangs and the stored data is lost. How to recover the NameNode fault simulation kill -9 NameNode processDelete data stored in NameNode:[codecat@hadoop102 dfs]$ rm -rf /opt/module/hadoop-3.1.3/data/dfs/name/* Solution Copy the data in the SecondaryNa ...

From Hadoop high availability to HBase environment construction (in virtual machine) Objective: to build and install HBase in the environment Idea: after completing the basic configuration of the master master, use cloning to complete the high availability cluster 1. Configure network First, check the network address of the local computer ...

This article is about Learning Guide for Big Data Specialists from Zero (Full Upgrade) Added in part by Haop. 1. Template Virtual Machine Environment Preparation 0) Install template virtual machine, IP address 192.168.10.100, host name hadoop100, memory 4G, hard disk 50G 1) The configuration requirements for hadoop100 virtual machine are a ...

No one has to help you. Everything has to be done by yourself Hadoop source code compilation preparation (1) CentOS networking Configure CentOS to connect to the Internet. Linux virtual machine ping is smooth Note: use root role compilation to reduce the folder permissions (2) jar package preparation (hadoop source code, JDK8, maven, ant, p ...