Spark安裝

請先安裝好Hadoop~~

下載Spark,解壓,換名字

cd /home/hadoop
wget http://apache.stu.edu.tw/spark/spark-2.4.1/spark-2.4.1-bin-hadoop2.7.tgz
tar -xvf spark-2.4.1-bin-hadoop2.7.tgz
mv spark-2.4.1-bin-hadoop2.7 spark

export HADOOP_CONF_DIR=/home/hadoop/hadoop/etc/hadoop
export SPARK_HOME=/home/hadoop/spark
export LD_LIBRARY_PATH=/home/hadoop/hadoop/lib/native:$LD_LIBRARY_PATH

(續…)

 

Leave a Reply

Your email address will not be published. Required fields are marked *