• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer navigation

The Geek Diary

  • OS
    • Linux
    • CentOS/RHEL
    • VCS
  • Interview Questions
  • Database
    • MariaDB
  • DevOps
    • Docker
    • Shell Scripting
  • Big Data
    • Hadoop
    • Cloudera
    • Hortonworks HDP

HDPCA Exam Objective – Decommission a node (NodeManager)

by admin

Note: This is post is part of the HDPCA exam objective series

What is a NodeManager

A NodeManager agent is deployed on each of the processing nodes in the cluster. It is the counterpart to the ResourceManager at the node level. It communicates with the ResourceManager to update the node state and receive any job requests from it. It is also responsible for the lifecycle management and the reporting of various node metrics to the ResourceManager.

YARN architecture

Decommissioning is a process that supports removing a component from the cluster. You must decommission a master or slave running on a host before removing the component or host from service. Decommissioning helps prevent potential loss of data or service disruption. Decommissioning is available for the following component types:

  • DataNodes
  • NodeManagers
  • RegionServers

Decommissioning executes the following tasks:

  • For DataNodes, safely replicates the HDFS data to other DataNodes in the cluster.
  • For NodeManagers, stops accepting new job requests from the masters and stops the component.
  • For RegionServers, turns on drain mode and stops the component.

Pre requisites

Make sure the configuration file for YARN i.e. /etc/hadoop/conf/yarn-site.xml should have the following property set:

yarn-site.xml decomissioning node HDPCA exam objective

Decommissioning NodeManager – Command Line

The steps to decommission a NodeManager is almost similar to removing a datanode. The file used here to include the NodeManager nodes to remove is /etc/hadoop/conf/yarn.exclude. Follow the steps outlined below to remove a NodeManager dn3.localdomain.

1. Login to the ResourceManager Node (dn2.localdomain in our case).

# ssh yarn@dn2.localdomain

You can find out the ResourceManager node from the YARN service page in amabri dashboard.

Find ResourceManager node from ambari web UI HDPCA

2. Add the NodeManager node you want to decomission in the file /etc/hadoop/conf/yarn.exclude

# vi /etc/hadoop/conf/yarn.exclude
dn3.localdomain

3. Update the ResourceManager with the new set of NodeManagers. On the ResourceManager host (dn2.localdomain) machine, execute the following command with the user yarn:

[root@dn2 conf]# su - yarn
[yarn@dn3 ~]$ yarn rmadmin -refreshNodes
18/07/15 20:44:59 INFO client.RMProxy: Connecting to ResourceManager at dn2.localdomain/192.168.1.4:8141

4. Verify the decommission of NodeManager on the YARN services page.

Decommission NodeManager using command line HDPCA

Decommissioning NodeManager – Using Ambari-Server Web UI

1. To delete the NodeManager dn3.localdomain, goto the hosts page from the ambari dashboard and select the NodeManager node to be decommissioned.

select NodeManager to be decomissioned in ambari dashboard

Delete the NodeManager using the Actions dropdown as shown below.

decommission NodeManager in hadoop HDPCA exam objective

HDPCA Exam Objective – Decommission a node (datanode)

Filed Under: Hadoop, HDPCA, Hortonworks HDP

Some more articles you might also be interested in …

  1. HDPCA Exam Objective – Create a home directory for a user and configure permissions
  2. HDPCA Exam Objective – View an application’s log file (Troubleshoot a failed job)
  3. CCA 131 – Install Cloudera Manager server and agents
  4. Preparing for the CCA Administrator Exam (CCA131)
  5. CCA 131 – Install CDH using Cloudera Manager
  6. Understanding the Hadoop MapReduce framework
  7. HDPCA Exam Objective – Configure a local HDP repository
  8. CCA 131 – Add a new node to an existing cluster
  9. CCA 131 – Set up a local CDH repository
  10. HDPCA Exam Objective – Configure NameNode HA

You May Also Like

Primary Sidebar

Recent Posts

  • Vanilla OS 2 Released: A New Era for Linux Enthusiasts
  • mk Command Examples
  • mixxx Command Examples
  • mix Command Examples

© 2025 · The Geek Diary

  • Archives
  • Contact Us
  • Copyright