Guide to Installing Hadoop and YARN from Installers and Validating Your Big Data Cluster

We have the executable all set. Lets start the Hadoop Yarn installation. This video is about 2nd step.
Take a look at the below code for reference.
https://github.com/Kamalabot/emr_instance_practice/blob/main/ec2_emr_files/byob_deploy.sh

1) Download Hadoop, Hive and Spark executables
***** 2) Start HDFS installation and Format ******
3) Complete Hive installation
4) Complete Spark Installation with Pyspark3
5) Configure JupyterLab

If you are new to this series, then take a look at the earlier videos tagged in this series. It all starts by understanding the basic architecture of the Cluster. Video Introduces how the Environment can Set up in Cloud Instance:
1) EC2 instance : T2 Large
2) SSH connection setup for Ubuntu user
3) Password-less login for Ubuntu User
4) Setting up Python & Docker
5) Pulling Postgres Docker and configuring Hive access

This video is part of the BYOB (Build Your Own Big data Cluster) series, located here
https://www.youtube.com/playlist?list=PLbzjzOKeYPCpr2syUKJ5w3BrDAYhB5S7d

The other supporting playlists are Python Data Engineering Playlist
https://www.youtube.com/playlist?list=PLbzjzOKeYPCo_hMXIl2URu7GL33-4_Yy0
Python Ecosystem of Libraries
https://www.youtube.com/playlist?list=PLbzjzOKeYPCoNAsZs679iXwsdP44G5SDS
ChatGPT and AI Playlist
https://www.youtube.com/playlist?list=PLbzjzOKeYPCpp3NCeQioevM0YpZa5VqcS
AWS and Python AWS Wrangler
https://www.youtube.com/playlist?list=PLbzjzOKeYPCogrhYDBgRNJDPV2CCwGrFT

PS: Got a question or have a feedback on my content. Get in touch
By leaving a Comment in the video
@twitter Handle is @KQrios
@medium https://medium.com/@kamaljp/about
@github https://github.com/Kamalabot