Hadoop3.x Fully Distributed Setup (Detailed)
Python WeChat Subscription Applet Course Video
https://edu.csdn.net/course/detail/36074
Python Actual Quantitative Transaction Finance System
https://edu.csdn.net/course/detail/35475 Environmental preparation
vm virtual machine (self-installing Centos7 system)hadoop3.x Installation Package (linux version)java1.8 installation package (linux ...
Posted by acidHL on Wed, 09 Mar 2022 18:15:48 +0100
Flink tutorial (26) - Flink multilingual development
01 introduction
In the previous blog, we learned the advanced features of Flink. Interested students can refer to the following:
Flink tutorial (01) - Flink knowledge mapFlink tutorial (02) - getting started with FlinkFlink tutorial (03) - Flink environment constructionFlink tutorial (04) - getting started with FlinkFlink tutorial (05) - ...
Posted by funguse on Wed, 09 Mar 2022 02:43:43 +0100
hive summary 4: actual training of table building (analysis of knowledge points involved in table building code)
catalogue
1: Table creation code
2: Data model
3: partition by range
4: hash bucket
V other
1: Table creation code
CREATE TABLE `heheyotubehehe_ads_people_kehuduan_experience_data` (
`day` int(11) NOT NULL DEFAULT "0" COMMENT "",
`os` varchar(50) NULL COMMENT "",
`soft_version` varchar(50) NULL COMMENT "",
`is_app_new` varc ...
Posted by soccer022483 on Tue, 08 Mar 2022 22:11:05 +0100
Graphical big data | Spark machine learning modeling and hyperparametric optimization
Author: Han Xinzi@ShowMeAI
Tutorial address: http://www.showmeai.tech/tutorials/84
Article address: http://www.showmeai.tech/article-detail/181
Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the source
1. Classification, regression and clustering model
1) Overview of classification algorithm
Cl ...
Posted by chrisuk on Tue, 08 Mar 2022 17:35:12 +0100
Graphical big data | Spark machine learning modeling and hyperparametric optimization
Author: Han Xinzi@ShowMeAI Tutorial address: http://www.showmeai.tech/tutorials/84 Article address: http://www.showmeai.tech/article-detail/181 Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the source
1. Classification, regression and clustering model
1) Overview of classification algorithm ...
Posted by kkeim on Tue, 08 Mar 2022 17:15:37 +0100
Flink tutorial (20) - Flink advanced features (dual stream Join)
01 introduction
In the previous blog, we learned about Flink's BroadcastState. Interested students can refer to the following:
Flink tutorial (01) - Flink knowledge mapFlink tutorial (02) - getting started with FlinkFlink tutorial (03) - Flink environment constructionFlink tutorial (04) - getting started with FlinkFlink tutorial (05) - si ...
Posted by andychamberlainuk on Tue, 08 Mar 2022 16:29:36 +0100
Build a jupyterhub server using the jupyterhub of dockerhub
preface
Not xiaobaiwen, not xiaobaiwen, not xiaobaiwen!!!! It needs a certain foundation. This is only my stepping on the pit, not every step is very detailed. But the key points are very detailed.
Why do we use jupyterhub?
1. What is jupyterhub?
jupyterhub is * * * *, please Baidu by yourself. It is actually a jupyter with login. Support m ...
Posted by pherrick on Tue, 08 Mar 2022 16:14:31 +0100
Java compression can be so optimized! The news is so exhilarating that everyone is celebrating and spreading it to the rest of the world
background
Recently, the function of data export is being done. Since batch export is supported and the exported files are up to 3GB, it is decided to compress when exporting the final results
first day
java compression, emmm The first thought is java util. Zip the following APIs, directly to the code:
/**
* Batch compressed file v1 0
*
...
Posted by baitubai on Tue, 08 Mar 2022 15:19:29 +0100
Installing Spark and Python exercises
1, Install Spark
Introduction to Spark 2.4.0: installation and use of Spark
Blog address: http://dblab.xmu.edu.cn/blog/1307-2/
1.1 basic environment
1.1.1 before installing Spark:
Linux system
Java environment (Java8 or JDK1.8 or above)
Hadoop environment
Hadoop installation tutorial address: http://dblab.xmu.edu.cn/blog/install-hadoop/
Follow ...
Posted by imperialized on Tue, 08 Mar 2022 12:13:09 +0100
Maxwell "Couldn't find database mysql" Troubleshooting
1, issue description
Recently, a mysql binlog data extraction maxwell process in prod environment was monitored by prometheus. There was a problem in its operation. The monitoring showed that the process hung up frequently. Because the maxwell instance service is under systemct service control, it will automatically pull up the program 20 seco ...
Posted by lhale on Mon, 07 Mar 2022 23:16:34 +0100