-
Notifications
You must be signed in to change notification settings - Fork 1
Description
SciSpark 303: Advanced SciSpark Usage for Building your own Climate Metrics
Abstract/Agenda:
We introduce a 3 part course module on SciSpark, our AIST14 funded project for Highly Interactive and Scalable Climate Model Metrics and Analytics. The three part course session introduces a 101, 202, and 303 class for learning how to use Spark for science.
SciSpark 303 is a course that covers advanced topics like setting up your own Spark cluster, using Spark in Amazon, and porting the SciSpark environment to build your own Climate Metrics and to perform scientific analysis using Spark. We will build on SciSpark 101 and Scala for science programming as an entry-course and SciSpark 202: Algorithms for MCC Search and PDF Clustering using SciSpark for understanding example analytics created using Spark. We will also cover in this session how to integrate SciSpark with other climate analysis frameworks including the Climate Model Diagnostic Analyzer toolkit which is now an Apache Incubator Podling effort:
- Lee, Seungwon, et al. "Climate model diagnostic analyzer." Big Data (Big Data), 2015 IEEE International Conference on. IEEE, 2015.