Use and Analysis of [Curator] Distributed Queue
Distributed Queue
Distributed queue
A distributed queue implementation based on ZK.
The messages put in guarantee order (ordered persistent nodes based on zk).
For individual consumers, queues are a FIFO (first in first out) approach.
If you need to control the order, you can specify a Leader Selector for the consumer to customize the consumpti ...
Posted by chombone on Sun, 16 Jun 2019 20:54:15 +0200
zookeeper distributed lock
There are many distributed locks. redis can also implement distributed locks.http://shangdc.blog.51cto.com/10093778/1914852 (see redis distributed locks)zookeeper Distributed Lock Step:1. Zookeeper is a node, similar to the file directory, so we abstract the lock into a directory. Zookeeper has a node of EPHEMERAL_SEQUENTIAL type. When multiple ...
Posted by CoolAsCarlito on Sat, 01 Jun 2019 01:15:55 +0200
ZooKeeper Learn Notes
Introduction to ZooKeeper
ZooKeeper(wiki,home,github ) is an open source distributed coordination service for distributed applications.By exposing simple primitives, distributed applications can build higher-level services on top of them, such as synchronization, configuration management, and group membership management.The design is easy to ...
Posted by rsassine on Thu, 30 May 2019 18:17:54 +0200
Hbase cluster deployment
Hhase cluster deployment
Software used
hadoop-2.7.4
hbase-1.2.6
jdk-8u144
zookeeper-3.4.10
Hbase comes with zookeeper, where you use your own deployed zookeeper
zookeeper cluster deployment
Install jdk
Download zookeeper program
Modify zoo.cfg
tickTime=2000
initLimit=10
syncLimit=5
dataLogDir=/zookeeper/logs
dataDir=/zookeeper ...
Posted by jebadoa on Wed, 29 May 2019 21:53:18 +0200
CentOS Technology (6) - - Deployment of zookeeper Service
1. Connect to CentOS 7 server with Linux client tools such as SecureCRT or XShell.
Enter into the / usr/local/tools directory:
cd /usr/local/
If this directory is not available, create:
mkdir -p tools
3 Download zookeeper-3.4.8.tar.gz:
wget http://apache.fayea.com/zookeeper/zookeeper-3.4.8/zookeeper-3.4.8.tar.gz
4 Return to the previous d ...
Posted by subwayman on Wed, 22 May 2019 03:19:01 +0200
zookeeper global unique id generation
One backgroundThe traditional method of generating id can be realized by the self-increment of database, but it is not suitable in distributed environment. Dependence on databases can easily lead to singletons.Why not use UUID? When you read someone's introduction on the internet, you should analyze it from two aspects:In the case of large conc ...
Posted by hemlata on Tue, 21 May 2019 01:50:38 +0200
Introduction to Dubbox and Zookeeper and a small introductory case
Dubbox
1: IntroductionDubbox is a distributed service framework. Its predecessor is Dubbo, an open source project of Alibaba, which is used in domestic e-commerce and Internet projects. In the later period, Alibaba stopped the maintenance of the project. Dangdang Networks optimized and maintained on the basis of Dubbo. In order to distinguish ...
Posted by drbigfresh on Sat, 11 May 2019 14:56:42 +0200
Hadoop 2.0 HA 3 Node High Availability Cluster Construction
overview
1. Cluster Planning
2. preparation
3. Modify the Hadoop configuration file
4. Copy content
5. Start the cluster
6. view jps
7. test
1. Cluster Planning
HDFS HA Background
There is a single point of failure (SPOF) in NameNode in HDFS cluster. For a cluster with only one NameNode, if an accident occurs on the NameNode ...
Posted by JoeZ on Fri, 10 May 2019 10:10:04 +0200