Introduction to R language
install
Just started R language, R (R language version) and RStudio (r compilation platform) R: R RStudio: Rstudio Detailed installation process
R language is an object-oriented programming language R language is more like python. The statement format is very similar to py. Use {} instead of: (colon) The processing object of R language is vec ...
Posted by whiterecluse on Fri, 17 Dec 2021 12:33:41 +0100
spark io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s)
Error log:
1. Error log:
WARN TaskSetManager: Lost task 29.0 in stage 22.0 (TID 1851, wn108-cdlcns.bjduloineequ3adfbkrpgi4p2c.shax.internal.chinacloudapp.cn, executor 25): FetchFailed(BlockManagerId(2, wn107-cdlcns.bjduloineequ3adfbkrpgi4p2c.shax.internal.chinacloudapp.cn, 7447, None), shuffleId=12, mapId=4, reduceId=29, message=
org.apach ...
Posted by godster on Fri, 17 Dec 2021 02:33:23 +0100
flink sql knows why | flink sql dating call (read this article is enough)
Thank you for your little love (attention + praise + look again). Your affirmation of the blogger will urge the blogger to continuously output more high-quality practical content!!!
1. Preface - structure of this paper
Big data sheep said
Using data to improve the probability of good things~
32 original content
official account
Thi ...
Posted by pococool on Thu, 16 Dec 2021 17:36:46 +0100
Introduction to kafka configuration parameters
Configuration and parameter description
Configuration parameters of consumer
#If 'enable auto. If commit 'is true, the frequency (in milliseconds) that the consumer automatically submits to Kafka is offset, and the default value is 5000.
spring.kafka.consumer.auto-commit-interval = 5000;
#What to do when there is no initial offset in Kafka o ...
Posted by sun14php on Thu, 16 Dec 2021 08:26:05 +0100
Research on storm source code analysis
2021SC@SDUSC
Bolt actuator in Trident
2021SC@SDUSC Similar to the coordination bolt in transaction Topology, Trident uses the tridentboltexecution to execute the SubTopologyBolt in Trident.
ITridentBatchBolt.java
public interface ITridentBatchBolt extends IComponent {
void prepare(Map<String, Object> conf, TopologyContext context, ...
Posted by TTT on Thu, 16 Dec 2021 02:53:02 +0100
Use of HBase ImportTSV tool
1. Importtsv function description
Load text data in the format of tsv (or csv, each field in each row of data is separated by a separator) into the HBase table. 1) . load and import in Put mode 2) . bulk load and import are adopted Use the following command to view the instructions for the official HBase built-in tool class:
HADOOP_HOME ...
Posted by margarette_a on Wed, 15 Dec 2021 21:19:27 +0100
Installation, configuration and use of HBase
catalogue
Installation, configuration and use of HBase
preface
(1) Produced by Xiao Du (special version for big data of Haida Jike), please use it by the recipient!!!
(2) Pay attention to the directory of this tutorial and modify it according to the specific situation of users!
(3) Most directories with "~" should use the install ...
Posted by irkevin on Wed, 15 Dec 2021 19:59:14 +0100
kettle+mysql+Python (Pandas, Patplotlip) to realize big data preprocessing (pie chart, histogram)
Environmental preparation
kettle mysql database Python environment
requirement
Use the preprocessing tool (kettle) to clean up the provided text data and import it into the database;Analyze and count the cleaned data, count the average expenditure of users in each city on traffic and voice, draw a chart with Python, and save the results;Coun ...
Posted by jeev on Wed, 15 Dec 2021 18:20:39 +0100
Reflect ion object of ES new feature
Hello, I'm A bowl week , a front end that doesn't want to be drunk. If you are lucky enough to get your favor, I am very lucky~
summary
Reflect is an object provided by ECMAScript2015. It provides some static methods to intercept JavaScript operations. These methods are similar to Proxy The methods in handlers in are consistent.
Reflect is ...
Posted by gojiita on Wed, 15 Dec 2021 13:40:56 +0100
A complete collection of common commands for big data development
Linux(vi/vim)
Pattern
Edit mode
Instruction mode
Compression and decompression
gzip/gunzip compression
(1) Only files can be compressed, not directories
(2) Do not keep the original file
gzip compression: gzip hello txt
Gunzip extract file: gunzip hello txt. gz
zip/unzip compression
You can compress directories a ...
Posted by mwd2005 on Wed, 15 Dec 2021 07:17:59 +0100