Introduction to R language

install Just started R language, R (R language version) and RStudio (r compilation platform) R: R RStudio: Rstudio Detailed installation process R language is an object-oriented programming language R language is more like python. The statement format is very similar to py. Use {} instead of: (colon) The processing object of R language is vec ...

Posted by whiterecluse on Fri, 17 Dec 2021 12:33:41 +0100

spark io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s)

Error log: 1. Error log: ​ WARN TaskSetManager: Lost task 29.0 in stage 22.0 (TID 1851, wn108-cdlcns.bjduloineequ3adfbkrpgi4p2c.shax.internal.chinacloudapp.cn, executor 25): FetchFailed(BlockManagerId(2, wn107-cdlcns.bjduloineequ3adfbkrpgi4p2c.shax.internal.chinacloudapp.cn, 7447, None), shuffleId=12, mapId=4, reduceId=29, message= org.apach ...

Posted by godster on Fri, 17 Dec 2021 02:33:23 +0100

flink sql knows why | flink sql dating call (read this article is enough)

Thank you for your little love (attention + praise + look again). Your affirmation of the blogger will urge the blogger to continuously output more high-quality practical content!!! 1. Preface - structure of this paper Big data sheep said Using data to improve the probability of good things~ 32 original content official account Thi ...

Posted by pococool on Thu, 16 Dec 2021 17:36:46 +0100

Introduction to kafka configuration parameters

Configuration and parameter description Configuration parameters of consumer #If 'enable auto. If commit 'is true, the frequency (in milliseconds) that the consumer automatically submits to Kafka is offset, and the default value is 5000. spring.kafka.consumer.auto-commit-interval = 5000; #What to do when there is no initial offset in Kafka o ...

Posted by sun14php on Thu, 16 Dec 2021 08:26:05 +0100

Research on storm source code analysis

2021SC@SDUSC Bolt actuator in Trident 2021SC@SDUSC Similar to the coordination bolt in transaction Topology, Trident uses the tridentboltexecution to execute the SubTopologyBolt in Trident. ITridentBatchBolt.java public interface ITridentBatchBolt extends IComponent { void prepare(Map<String, Object> conf, TopologyContext context, ...

Posted by TTT on Thu, 16 Dec 2021 02:53:02 +0100

Use of HBase ImportTSV tool

1. Importtsv function description Load text data in the format of tsv (or csv, each field in each row of data is separated by a separator) into the HBase table. 1) . load and import in Put mode 2) . bulk load and import are adopted Use the following command to view the instructions for the official HBase built-in tool class: HADOOP_HOME ...

Posted by margarette_a on Wed, 15 Dec 2021 21:19:27 +0100

Installation, configuration and use of HBase

catalogue Installation, configuration and use of HBase preface (1) Produced by Xiao Du (special version for big data of Haida Jike), please use it by the recipient!!! (2) Pay attention to the directory of this tutorial and modify it according to the specific situation of users! (3) Most directories with "~" should use the install ...

Posted by irkevin on Wed, 15 Dec 2021 19:59:14 +0100

kettle+mysql+Python (Pandas, Patplotlip) to realize big data preprocessing (pie chart, histogram)

Environmental preparation kettle mysql database Python environment requirement Use the preprocessing tool (kettle) to clean up the provided text data and import it into the database;Analyze and count the cleaned data, count the average expenditure of users in each city on traffic and voice, draw a chart with Python, and save the results;Coun ...

Posted by jeev on Wed, 15 Dec 2021 18:20:39 +0100

Reflect ion object of ES new feature

Hello, I'm A bowl week , a front end that doesn't want to be drunk. If you are lucky enough to get your favor, I am very lucky~ summary Reflect is an object provided by ECMAScript2015. It provides some static methods to intercept JavaScript operations. These methods are similar to Proxy The methods in handlers in are consistent. Reflect is ...

Posted by gojiita on Wed, 15 Dec 2021 13:40:56 +0100

A complete collection of common commands for big data development

Linux(vi/vim) Pattern   Edit mode   Instruction mode   Compression and decompression gzip/gunzip compression (1) Only files can be compressed, not directories (2) Do not keep the original file gzip compression: gzip hello txt Gunzip extract file: gunzip hello txt. gz zip/unzip compression You can compress directories a ...

Posted by mwd2005 on Wed, 15 Dec 2021 07:17:59 +0100