Hadoop3.x Fully Distributed Setup (Detailed)

Python WeChat Subscription Applet Course Video https://edu.csdn.net/course/detail/36074 Python Actual Quantitative Transaction Finance System https://edu.csdn.net/course/detail/35475 Environmental preparation vm virtual machine (self-installing Centos7 system)hadoop3.x Installation Package (linux version)java1.8 installation package (linux ...

Posted by acidHL on Wed, 09 Mar 2022 18:15:48 +0100

Flink tutorial (26) - Flink multilingual development

01 introduction In the previous blog, we learned the advanced features of Flink. Interested students can refer to the following: Flink tutorial (01) - Flink knowledge mapFlink tutorial (02) - getting started with FlinkFlink tutorial (03) - Flink environment constructionFlink tutorial (04) - getting started with FlinkFlink tutorial (05) - ...

Posted by funguse on Wed, 09 Mar 2022 02:43:43 +0100

hive summary 4: actual training of table building (analysis of knowledge points involved in table building code)

catalogue 1: Table creation code 2: Data model 3: partition by range 4: hash bucket V other 1: Table creation code CREATE TABLE `heheyotubehehe_ads_people_kehuduan_experience_data` (   `day` int(11) NOT NULL DEFAULT "0" COMMENT "",   `os` varchar(50) NULL COMMENT "",   `soft_version` varchar(50) NULL COMMENT "",   `is_app_new` varc ...

Posted by soccer022483 on Tue, 08 Mar 2022 22:11:05 +0100

Graphical big data | Spark machine learning modeling and hyperparametric optimization

Author: Han Xinzi@ShowMeAI Tutorial address: http://www.showmeai.tech/tutorials/84 Article address: http://www.showmeai.tech/article-detail/181 Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the source 1. Classification, regression and clustering model 1) Overview of classification algorithm Cl ...

Posted by chrisuk on Tue, 08 Mar 2022 17:35:12 +0100

Graphical big data | Spark machine learning modeling and hyperparametric optimization

Author: Han Xinzi@ShowMeAI Tutorial address: http://www.showmeai.tech/tutorials/84 Article address: http://www.showmeai.tech/article-detail/181 Notice: All Rights Reserved. Please contact the platform and the author for reprint and indicate the source 1. Classification, regression and clustering model 1) Overview of classification algorithm ...

Posted by kkeim on Tue, 08 Mar 2022 17:15:37 +0100

Flink tutorial (20) - Flink advanced features (dual stream Join)

01 introduction In the previous blog, we learned about Flink's BroadcastState. Interested students can refer to the following: Flink tutorial (01) - Flink knowledge mapFlink tutorial (02) - getting started with FlinkFlink tutorial (03) - Flink environment constructionFlink tutorial (04) - getting started with FlinkFlink tutorial (05) - si ...

Posted by andychamberlainuk on Tue, 08 Mar 2022 16:29:36 +0100

Build a jupyterhub server using the jupyterhub of dockerhub

preface Not xiaobaiwen, not xiaobaiwen, not xiaobaiwen!!!! It needs a certain foundation. This is only my stepping on the pit, not every step is very detailed. But the key points are very detailed. Why do we use jupyterhub? 1. What is jupyterhub? jupyterhub is * * * *, please Baidu by yourself. It is actually a jupyter with login. Support m ...

Posted by pherrick on Tue, 08 Mar 2022 16:14:31 +0100

Java compression can be so optimized! The news is so exhilarating that everyone is celebrating and spreading it to the rest of the world

background Recently, the function of data export is being done. Since batch export is supported and the exported files are up to 3GB, it is decided to compress when exporting the final results first day java compression, emmm The first thought is java util. Zip the following APIs, directly to the code: /** * Batch compressed file v1 0 * ...

Posted by baitubai on Tue, 08 Mar 2022 15:19:29 +0100

Installing Spark and Python exercises

1, Install Spark Introduction to Spark 2.4.0: installation and use of Spark Blog address: http://dblab.xmu.edu.cn/blog/1307-2/ 1.1 basic environment 1.1.1 before installing Spark: Linux system Java environment (Java8 or JDK1.8 or above) Hadoop environment Hadoop installation tutorial address: http://dblab.xmu.edu.cn/blog/install-hadoop/ Follow ...

Posted by imperialized on Tue, 08 Mar 2022 12:13:09 +0100

Maxwell "Couldn't find database mysql" Troubleshooting

1, issue description Recently, a mysql binlog data extraction maxwell process in prod environment was monitored by prometheus. There was a problem in its operation. The monitoring showed that the process hung up frequently. Because the maxwell instance service is under systemct service control, it will automatically pull up the program 20 seco ...

Posted by lhale on Mon, 07 Mar 2022 23:16:34 +0100