Big Data Fundamentals

ASPE | Techtown

How long?

  • 2 days
  • online

ASPE | Techtown

Disclaimer

Coursalytics is an independent platform to find, compare, and book executive courses. Coursalytics is not endorsed by, sponsored by, or otherwise affiliated with any business school or university.

Full disclaimer.

Who should attend

  • Software Engineers and Team Leads
  • Project Managers
  • Business Analysts
  • DBAs and Data Engineering teams
  • Business Customers
  • System Analysts

About the course

This course is a survey of big data – the landscape, the technology behind it, business drivers and strategic possibilities. “Big data” is a hot buzzword, but most organizations are struggling to put it to practical use. Without assuming any prior knowledge of Apache Hadoop or big data management, this course teaches a wide range of professional roles how to tap and manage the potential benefits of big data, including:

  • Discovering customer insights buried in your existing data
  • Uncovering product opportunities from data insights
  • Pinpointing decision points and criteria
  • Scaling your existing workflows and operations
  • Learning to ask questions that drive tangible business value from Big Data tools

  • Navigate the technology stacks and tools used to work with big data

  • Establish a common vocabulary on your teams for applying big data practices

  • Get an overview of how big data technologies work: Apache Hadoop, Spark, Pig, Hive, Sqoop, OOZIE, and FLUME

  • Design both functional and non-functional requirements for working with big data

  • Understand common business cases for big data

  • Differentiate between hype and what’s truly possible

  • Look at examples of real-world big data use cases

  • Select initiatives and projects that have high potential to benefit from big data applications

  • Understand what type of staffing, technical skills, and training is required for projects that incorporate or focus on big data

Course Outline

Part 1: Introduction to Big Data

  • Academic
  • Early web
  • Web-scale

    • 1994 – 2012
    • 2016
    • 2020

Part 2: Sources (Examples)

  • Internet
  • Transport systems
  • Medical, healthcare
  • Insurance
  • Military and others

Part 3: Hadoop – the free platform for working with big data

  • History
  • Yahoo
  • Platform fragmentation
  • What usage looks like in the enterprise

Part 4: The concepts

  • Load data how you find it
  • Process it when you can
  • Project it into various schemas on the fly
  • Push it back to where you need it

Part 5: The basics

  • What it’s good for
  • What can’t it do / disadvantages
  • Most common use cases for big data

Part 6: Introduction to HDFS

  • Robustness
  • Data Replication
  • Gotchas

Part 7: MapReduce – the core big data function

  • Map explained
  • Sort and shuffle explained
  • Reduce explained

Demonstration: Hadoop, HDFS, and MapReduce - Let’s try it!

Part 8: YARN

  • How it fits
  • How it works
  • Resource Manager
  • Application Master

Part 9: PIG

  • What it is
  • How it works
  • Compatibilities
  • Advantages
  • Disadvantages

Demonstration: YARN and PIG - Let’s try it!

Part 10: Processing Data

  • The Piggy Bank
  • Loading and Illustrating the data
  • Writing a Query
  • Storing the Result

Part 11: HIVE

  • Data warehousing
  • What it is, what it’s not
  • Language compatibilities
  • Advantages

Demonstration: HIVE - Let’s try it!

Example demo walkthrough: Contextual advertising

Part 12: OOZIE

  • What it is
  • Complex workflow environments
  • Reducing time-to-market
  • Frequency execution
  • How it works with other big data tools

Example demo walkthrough: How to run a job

Part 13: FLUME – stream, collect, store and analyze high-volume log data

  • How it works: Event, source, sink, channel, agent and client
  • How it works illustrated
  • How it works demonstrated

Part 14: SPARK

  • Move over 2012 Big Data tools: Apache SPARK is the new power tool
  • The new open source cluster framework
  • When SPARK performs 100 times faster
  • Performance comparison of Spark and Hadoop
  • What else can it do?

Part 15: HBASE

  • What it is
  • Common use cases

Part 16: Using External Tools

Experts

Gonçalo Veiga

ASPE’s Gonçalo Veiga is an experienced data analysis instructor that has the ability to impart technical skills and knowledge to people no matter their technical background. Gonçalo has a BS in Applied Psychology with a specialization in Clinical Psychology by the Instituto Superior de Psicologia...

Kevin Hill

Kevin Hill, Ph.D., is an expert living at the intersection of human behavior and artificial intelligence. He received his Ph.D. in Cognitive Neuroscience from the University of California, Davis, and presented internationally recognized research in the fields of Neuroeconomics and Human Decision ...

Erick Polsky

Erick Polsky's career integrating application development with training delivery started back in 1989 when he developed and introduced the first online multimedia training content system to Harvard University. Since then he has honed his business, programming, and database skills to provide high...

Videos and materials

Big Data Fundamentals at ASPE | Techtown

From  $1,295

Something went wrong. We're trying to fix this error.

Thank you for your application

We will contact the provider to ensure that seats are available and, if there is an admissions process, that you satisfy any requirements or prerequisites.

We may ask you for additional information.

To finalize your enrollment we will be in touch shortly.

Disclaimer

Coursalytics is an independent platform to find, compare, and book executive courses. Coursalytics is not endorsed by, sponsored by, or otherwise affiliated with any business school or university.

Full disclaimer.

Because of COVID-19, many providers are cancelling or postponing in-person programs or providing online participation options.

We are happy to help you find a suitable online alternative.