Can't find SPARK_HOME (Windows 10)

[andreacaleo]

Hi everyone, I experienced an issue while using FindSpark as instructed on the DataQuest website. An easy solution from the community hasn't arisen and it's been suggested I open an issue here.

I am using findspark to use PySpark in a Jupyter Notebook. If I launch Spark from the command shell, it works as expected. However, findspark is unable to recognize the SPARK_HOME variable, although os.environ on it works correctly. Here are two screenshots:
https://www.dropbox.com/s/mi3wpjobqoplna0/Screenshot%202016-07-18%2016.32.08.png?dl=0
https://www.dropbox.com/s/r894asfx990ll4u/Screenshot%202016-07-18%2016.32.03.png?dl=0

I wonder if you are already aware of this issue or if I have done something incorrectly.

[minrk]

It's very strange indeed that it doesn't work if os.environ.get('SPARK_HOME') returns a string. I cannot get that to fail, even on Windows. How is the environment variable set?

[andreacaleo]

Dear minrk, thank you for your answer. I have run the code again after a couple of days and it has mysteriously worked (I made no changes to what you see above and last week I had run it several times and the error had always occurred). I don't know what it was but I haven't been able to reproduce the error. Sorry.