Spark: JupyterNotebook integrates PySpark development environment

Record Basic environment JDK8Python3.7 Setting up Spark environment in Window First install JDK8 and python 3, which will not be repeated here Install Hadoop 2 seven Download address: http://archive.apache.org/dist/hadoop/core/hadoop-2.7.7/hadoop-2.7.7.tar.gz decompression Download winutils of hadoop: https://github.com/stevelou ...

Posted by cl77 on Fri, 11 Feb 2022 15:37:58 +0100