hive opens the Kerberos beeline connection
1.kerberos installation
kerberos installation configuration and use: https://blog.csdn.net/qq_21383435/article/details/83625252
2. Generate keytab
Execute the following command on cdh1 node, KDC server node:
cd /var/kerberos/krb5kdc/
kadmin.local -q "addprinc -randkey hive/cdh-server1@YONG.COM "
kadmin.local -q "addprinc - ...
Posted by smpdawg on Tue, 10 Dec 2019 17:22:35 +0100
[Hadoop cluster building] ssh password free login setting
[Hadoop cluster building] ssh password free login setting
There are three hosts, their IP addresses and roles in the cluster are as follows:
172.17.0.2 //master
172.17.0.3 //slave1
172.17.0.4 //slave2
Now you want to make the two of them able to log in through ssh, the steps are as follows:
Create public key and configure acc ...
Posted by pskZero7 on Mon, 09 Dec 2019 12:24:20 +0100
Hadoop configuration under ECS
Article directory
Cluster SSH password free login settings
Hadoop installation configuration
Open port
To configure
Format HDFS (Master, Slave)
Start Hadoop
Verify installation succeeded
In the previous article, we have discussed how to write hadoop under virtual machine. On this basis, due to the particularity of cloud ...
Posted by silverspy18 on Mon, 09 Dec 2019 05:49:02 +0100
Connect ssh using paramiko
paramiko
Paramiko is a module for remote control that allows command or file operations on remote servers. It is worth noting that remote management within fabric s and ansible is achieved using paramiko.
install
pip install paramiko
Module usage
Execute Command - User Name + Password
#!/usr/bin/env python
#coding:utf-8
import paramiko
# Cre ...
Posted by headrush on Thu, 05 Dec 2019 04:15:51 +0100
hexo combined with git to build blog Foundation
background
How to own your own blog without spending money (server, domain name)? gitpage+hexo, realize your wish
Preparation
Install git client by yourself
Self registration of git account
Install npm and node.js by yourself
Operation steps
Building database
Create a new one named( Your user name.github.io )For exampl ...
Posted by tomboy78 on Wed, 04 Dec 2019 11:40:45 +0100
A few lines of commands to understand that the remote server creates a user with no secret login
Upgrade package management system
First, use the following command to upgrade the package management system:
sudo apt-get update && sudo apt-get upgrade
Create users and configure account permissions
For the sake of server security, we should avoid using the root user to log in directly; instead, we should create a new user and use this ...
Posted by s1akr on Sun, 01 Dec 2019 10:53:25 +0100
Archlinux/Manjaro install MariaDB Hadoop Hive (pseudo distributed)
Hadoop 2.x.y (pseudo distributed)
Refer to the single node setup section of the corresponding version of the official websitehttps://hadoop.apache.org/docs/
First, ssh and rsync
Then download the bin package and extract it. Add the extracted root directory as the environment variable Hadoop? Home
# example
export HADOOP_HOME=/home/yzj/Applicat ...
Posted by beerman on Sat, 30 Nov 2019 22:12:43 +0100
High availability configuration of Hadoop distributed environment
The previous article introduced Hadoop distributed configuration , but designed to be highly available, this time use zookeeper to configure Hadoop highly available.
1. Environmental preparation
1) modify IP 2) modify the mapping of host name and host name and IP address 3) turn off the firewall 4) ssh password free login 5) create hado ...
Posted by eflopez on Tue, 26 Nov 2019 18:53:08 +0100
Distributed Version Control System - Git Details
Preface:
The biggest difference between distributed and centralized is that developers can submit code locally, and each developer clones a complete git repository on the local machine.
The following is a classic git development process:
The git features are as follows:
Clone a complete git repository (including code and version informatio ...
Posted by J@ystick_FI on Wed, 13 Nov 2019 20:02:00 +0100
The vue element component realizes uploading pictures to the local
My qq 2038373094
Components used
The function of this component
1. Copy the pictures uploaded by users to Qianniu cloud server
2. Then Qianniu cloud returns a picture link blob:http://localhost:8088/42786950-1ef1-44a3-8315-f3f7d83ed9fc
What we want to achieve now is to send the pictures uploaded by users to the local ...
Posted by spicerje on Tue, 12 Nov 2019 22:52:21 +0100