29
edits
Telemetry/Custom analysis with spark: Difference between revisions
Jump to navigation
Jump to search
Telemetry/Custom analysis with spark (view source)
Revision as of 14:16, 11 August 2016
, 11 August 2016no edit summary
(update example command) |
No edit summary |
||
| Line 17: | Line 17: | ||
# A cluster will be launched on AWS preconfigured with Spark, IPython and some handy data analysis libraries like pandas and matplotlib. | # A cluster will be launched on AWS preconfigured with Spark, IPython and some handy data analysis libraries like pandas and matplotlib. | ||
Once the cluster is ready, you can tunnel IPython through SSH by following the instructions on the dashboard, and running the ssh shell command. | Once the cluster is ready, you can tunnel IPython through SSH by following the instructions on the dashboard, and running the ssh shell command. For example: | ||
ssh -i ~/.ssh/id_rsa -L 8888:localhost:8888 hadoop@ec2-54-70-129-221.us-west-2.compute.amazonaws.com | ssh -i ~/.ssh/id_rsa -L 8888:localhost:8888 hadoop@ec2-54-70-129-221.us-west-2.compute.amazonaws.com | ||
Finally, you can launch IPython in Firefox by visiting http://localhost:8888. | Finally, you can launch IPython in Firefox by visiting http://localhost:8888. | ||