Hadoop Fundamentals: Essential Guide for Beginners 🚀

http://www.informit.com/store/hadoop-fundamentals-livelessons-video-training-9780133392821 Excerpt from Hadoop Fundamentals LiveLessons Video Training Apache Hadoop is a freely available open source tool-set that enables big data analysis. This Hadoop Fundamentals LiveLessons tutorial demonstrates the core components of Hadoop including Hadoop Distriuted File Systems (HDFS) and MapReduce. In addition, the tutorial demonstrates how to use Hadoop at several levels including the native Java interface, C++ pipes, and the universal streaming program interface. Examples of how to use high level tools include the Pig scripting language and the Hive "SQL like" interface. Finally, the steps for installing Hadoop on a desktop virtual machine, in a Cloud environment, and on a local stand-alone cluster are presented. Topics covered in this tutorial apply to Apache Hadoop versions 1 and 2 (i.e., MR2 or Yarn). Lesson 1, "Background Concepts," covers important Hadoop and Big Data fundamentals. You learn Hadoop history and design principles along with the introduction to the MapReduce paradigm and the components of the Hadoop ecosystem will be introduced. Lesson 2, "Running Hadoop on a Desktop or Laptop," shows you how to create a real Hadoop working installation in a virtual Linux sandbox. All software is freely available, can be easily installed to a desktop or laptop computer, and can be used for many of the examples in this tutorial. Lesson 3, "The Hadoop Distributed File System" introduces you to the distributed storage system of Hadoop. In this lesson, you learn HDFS design basics, how to perform basic file operations, and how to use HDFS in programs. Lesson 4, "Hadoop MapReduce," presents Hadoop MapReduce in more detail using simple command line examples. You also learn how to run a Java MapReduce application on a Hadoop cluster and then learn each step of the full Hadoop MapReduce process. Lesson 5, "Hadoop Examples," teaches you how to write MapReduce programs in almost any language using the Streaming and Pipes interface. You also learn how to run a "grep" like Hadoop application and use some basic debugging techniques. Lesson 6, "Higher Level Tools," shows you how to use Pig and Hive, two high level Hadoop applications. Each lesson teaches you the various execution modes and commands needed to use the tools. Lesson 7, "Setting Up Hadoop in the Cloud," demonstrates the simple steps needed to start a Hadoop Cluster in the cloud using a tool called Whirr. Lesson 8, "Setting Up Hadoop on a Local Cluster," teaches you how to install Hadoop on a basic four node cluster. You will learn the steps needed to configure, install, start, test, and monitor a fully functional Hadoop cluster.