Ambari Custom Service
1. Ambari Basic Architecture
img016.jpg
Ambari Server reads the configuration files for Stack and Service.When creating services with Ambari, Ambari Server passes configuration files for Stack and Service and control scripts for the service life cycle to Ambari Agent.When the Agent gets the configuration file, it downloads and installs the p ...
Posted by justindublin on Sun, 09 Jun 2019 20:57:13 +0200
Hbase cluster deployment
Hhase cluster deployment
Software used
hadoop-2.7.4
hbase-1.2.6
jdk-8u144
zookeeper-3.4.10
Hbase comes with zookeeper, where you use your own deployed zookeeper
zookeeper cluster deployment
Install jdk
Download zookeeper program
Modify zoo.cfg
tickTime=2000
initLimit=10
syncLimit=5
dataLogDir=/zookeeper/logs
dataDir=/zookeeper ...
Posted by jebadoa on Wed, 29 May 2019 21:53:18 +0200
A brief introduction to prometheus
prometheus monitoring system
Recently, due to the company's need to build a large data platform, prometheus monitoring system has been replaced as required by consultants.
prometheus official website: https://prometheus.io/
Personal understanding (not necessarily right): prometheus monitoring consists of three parts: prometheus (server), ex ...
Posted by chintupintu03 on Mon, 27 May 2019 20:41:26 +0200
JAVA Communications (2) - Implementing a Simple RPC Framework
1. Introduction to RPC
RPC, fully known as Remote Procedure Call, or Remote Procedure Call, is a computer communication protocol.It allows remote services to be called as local services.It can be implemented in different ways.Examples include RMI (remote method call), Hessian, Http invoker, and so on.In addition, RPC is language independent.R ...
Posted by paulieo10 on Tue, 21 May 2019 20:07:32 +0200
Java Collection Knowledge Points Overview and Code Interpretation
Collection (List And Set)
1. In practical development, it is necessary to store the objects used in specific data structure containers. JDK provides such a container-collection.
2.Collection is an interface whose sub-interfaces are List and Set
3. The difference between List and Set: List is an ordered repeatable set (which ca ...
Posted by a2bardeals on Sat, 18 May 2019 23:17:39 +0200
Big Data Learning Series 5 - Hive Integrating HBase Graphics and Texts
http://www.cnblogs.com/xuwujing/p/8059079.html
Introduction
In the last article Big Data Learning Series IV - --- Hadoop+Hive Environment Construction Graphics and Text Details (stand-alone) And before Big Data Learning Series II
- HBase Environment Construction (stand-alone) Hive and HBase environments were successfully built and teste ...
Posted by dirkbonenkamp on Sat, 18 May 2019 16:02:04 +0200
Setting up a hadoop cluster environment with a single machine
One preparation
First create the folder with the following structure:
weim@weim:~/myopt$ ls
ubuntu1 ubuntu2 ubuntu3
And extract the downloaded JDK (version: 8u172), Hadoop (version: hadoop-2.9.1) into three folders, as follows:
weim@weim:~/myopt$ ls ubuntu1
hadoop jdk
weim@weim:~/myopt$ ls ubuntu2
hadoop jdk
weim@weim:~/myopt$ ls ubuntu ...
Posted by pmzq on Thu, 16 May 2019 05:04:16 +0200
Hadoop 2.0 HA 3 Node High Availability Cluster Construction
overview
1. Cluster Planning
2. preparation
3. Modify the Hadoop configuration file
4. Copy content
5. Start the cluster
6. view jps
7. test
1. Cluster Planning
HDFS HA Background
There is a single point of failure (SPOF) in NameNode in HDFS cluster. For a cluster with only one NameNode, if an accident occurs on the NameNode ...
Posted by JoeZ on Fri, 10 May 2019 10:10:04 +0200