Перейти к содержимому

Install Apache Spark and PySpark on Ubuntu 20.04 Linux Debian, Python 3.7 - Part 1a

datyrlab

0:00 / 0:00

Install Apache Spark and PySpark on Ubuntu 20.04 Linux Debian, Python 3.7 - Part 1a

20 871 просмотр · 6 л. назад
datyrlab
1,36 тыс. подписчиков
20 871 просмотр · 6 л. назад
0:00 - check if Java is already installed then install JRE and JDK 2:26 - download the Spark library from Apache website 4:22 - uncompress and install the Spark tgz file to a target directory 8:10 - update .bashrc file to include environment path variables for both Spark and PySpark 12:26 - install PySpark, and install pip3 if required 13:24 - validate Spark is working via the Spark shell (Scala prompt) 15:00 - validate PySpark is working via the PySpark shell (Python prompt) 15:36 - access Spark UI via the browser Apache Spark - Install Spark3, PySpark3 on Ubuntu 20.04, Debian, Python 3.8 - Part 1b    • Apache Spark - Install Spark3, PySpark3 on...   Follow this tutorial if you're using Python3.8 or higher You won't get any incompatible version 3 errors If you get further errors you might be installing the wrong versions of Spark and Pyspark both Spark and PySpark versions need to be compatible. If you do need to downgrade to Python 3.7 or switch between versions, then follow this tutorial on how...    • Python Install - from source, multiple ver...     / datyrlab