Big Data and Cloud Computing

0 or 3 Credits · Level: Graduate

In this course, students will learn the technology, business, science, and social implications of "big data" processing. In recent years there has been an explosion of tools, techniques, and technologies for working with massive data sets. Students will build real word systems, using stand-alone Hadoop/Spark environments running in VirtualBox on personal systems, and scalable clusters on Amazon Web Services. Topics: Big Data terminology, scaling from one computer to thousands, data storage and data privacy, Spark, data formats and data wrangling, text processing and web mining, streaming data, graph processing. Students will be provided Amazon Web accounts with allowances that are sufficient to cover the course work. Prerequisites: ANLY 501 or equivalent, working knowledge of Python and the Unix command line. Students need to own a laptop computer with at least 100GB of free disk space and 8GB of RAM. Computer Science students may register for a section of this course with ANLY department approval.