• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer navigation

The Geek Diary

  • OS
    • Linux
    • CentOS/RHEL
    • Solaris
    • Oracle Linux
    • VCS
  • Interview Questions
  • Database
    • oracle
    • oracle 12c
    • ASM
    • mysql
    • MariaDB
  • DevOps
    • Docker
    • Shell Scripting
  • Big Data
    • Hadoop
    • Cloudera
    • Hortonworks HDP

How To Modify Hadoop Log Level

by admin

By default, Hadoop’s log level is set to INFO. This can be too much for most instances, as it will generate huge log files, even in an environment with low to moderate traffic. Changing the root logger in log4j.properties file in Hadoop will not change the log level.

Follow the steps below for changing the log level of Hadoop.

1. Shut down Hadoop if it is still running.

2. Open the [hadoop_home]/bin/hadoop-daemon.sh file. Look for the following line:

export HADOOP_ROOT_LOGGER="INFO,DRFA"

3. Modify that line to a lower or higher log level (WARN should be sufficient if the goal is to limit the size of the log file rather than debugging an issue).

export HADOOP_ROOT_LOGGER="WARN,DRFA"

4. Save the file and start Hadoop.

Filed Under: Hadoop

Some more articles you might also be interested in …

  1. Understanding the Hadoop MapReduce framework
  2. HDPCA Exam Objective – Configure ResourceManager HA
  3. CCA 131 – Add a service using Cloudera Manager
  4. HDPCA Exam Objective – Configure and manage alerts
  5. Preparing for the CCA Administrator Exam (CCA131)
  6. HDPCA Exam Objective – Install ambari agent
  7. HDPCA Exam Objective – Configure NameNode HA
  8. HDPCA Practice Exam Questions and AWS Instance Setup Details
  9. HDPCA Exam Objective – View an application’s log file (Troubleshoot a failed job)
  10. HDPCA Exam Objective – Decommission a node (NodeManager)

You May Also Like

Primary Sidebar

Recent Posts

  • qemu-system-x86_64: command not found
  • timedatectl: command not found
  • mpirun.openmpi: command not found
  • startkde: command not found

© 2022 · The Geek Diary

  • Archives
  • Contact Us
  • Copyright