Wednesday, September 7, 2016

Installing - Apache Spark on macOS Sierra

Installing - Apache Spark on macOS Sierra






This is my step by step guide to installing Apache Spark 2.0.0 on macOS Sierra.

Pre-Requisirtes

Hardware

  Model Name: MacBook Pro
  Model Identifier: MacBookPro12,1
  Processor Name: Intel Core i7
  Processor Speed: 3.1 GHz
  Number of Processors: 1
  Total Number of Cores: 2
  L2 Cache (per Core): 256 KB
  L3 Cache: 4 MB

  Memory: 16 GB

Software

OS: macOS Sierra - OS X 10.12. - pre-release version
Package Manager: Home Brew - 1.18
Big Data: Hadoop
Cluster Computing Framework: Apache Spark 2.0.0

Installation

Install Xcode 8.0.

Xcode can be updated from
  https://developer.apple.com/xcode/downloads/
If 8.0 is installed, you may need to:
  sudo xcode-select --switch /path/to/Xcode-beta.app
bash-3.2$ sudo xcode-select --switch /Applications/Xcode-beta.app 

Install Home Brew

Open a terminal in MAC.
CMD + Space & type Terminal or open terminal from launcher


Install Spark


bash-3.2$ brew install spark
==> Auto-updated Homebrew!
Updated 1 tap (homebrew/core).
==> Updated Formulae
graphicsmagick

Warning: You are using OS X 10.12.
We do not provide support for this pre-release version.
You may encounter build failures or other breakages.
Please create pull-requests instead of filing issues.
==> Using the sandbox
==> Downloading https://github.com/holman/spark/archive/v1.0.1.tar.gz
==> Downloading from https://codeload.github.com/holman/spark/tar.gz/v1.0.1
######################################################################## 100.0%
🍺  /usr/local/Cellar/spark/1.0.1: 5 files, 6.3K, built in 3 seconds

Captain Nemo New York

No comments:

Post a Comment

Scala & Spark for Managing & Analyzing Big Data (Using Machine Learning)

Managing & Analyzing Big Data using Apache Scala & Apache Spark In this blog we will see how to use Scala and Spark to analyze Big D...