Good luck finding all of the right versions, configuring them to work correctly together, and setting all of the right environment variables on your own. Alternatively, if you used RunSamples.cmd to run Mobius samples, you can find runtime directory (under build directory) that can be used as SPARKCLR_HOME. If you downloaded a Mobius release, SPARKCLR_HOME should be set to the directory named runtime (for example, D:\downloads\spark-clr_2.10-1.5.200\runtime). Alternative, if you used RunSamples.cmd to run Mobius samples, you can find toos\winutils directory (under build directory) that can be used as HADOOP_HOMEĪppropriate version of Mobius release or a valid dev build It can be copied over from any Hadoop distribution. Spark in Windows needs this utility in %HADOOP_HOME%\bin directory. See Running Hadoop on Windows for details Alternatively, if you used RunSamples.cmd to run Mobius samples, you can find toos\spark* directory (under build directory) that can be used as SPARK_HOME See Mobius versioning policy for notes of Spark & Mobius versions. The version of Spark should match the one supported by the Mobius branch/release you are using.
#INSTALL SPARK ON WINDOWS WITHOUT HADOOP DOWNLOAD#
Spark can be downloaded from Spark download website. Look at the amount of stuff you have to do in order to get Spark running properly on Windows (from the Mobius for Spark project):Īfter setting JAVA_HOME, run set PATH=%PATH% %JAVA_HOME%\bin to add java to PATH
Versioned Apache Spark installation scripts for Windows.
0 kommentar(er)
