PySpark Error: Py4JJavaError For Python version being incorrect

Published: 10 October 2018
on channel: Raul Maldonado

11,785

Advance note: Audio was bad because I was traveling. haha
_____
The error in my case was: PySpark was running python 2.7 from my environment's default library. This is an issue since I have Python 3.6 for that enviroment. So, I reconfigured the PYSPARK_PYTHON path with this command:

import os
os.environ["PYSPARK_PYTHON"]="/anaconda3/envs/DIRECTORYNAME/bin/python"

I found my version of python being used in my environment by typing in "which python" Linux [Unix I think it's "find python"]

On this page of the site you can watch the video online PySpark Error: Py4JJavaError For Python version being incorrect with a duration of hours minute second in good quality, which was uploaded by the user Raul Maldonado 10 October 2018, share the link with friends and acquaintances, this video has already been watched 11,785 times on youtube and it was liked by 36 viewers. Enjoy your viewing!

13,912

323