• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer navigation

The Geek Diary

  • OS
    • Linux
    • CentOS/RHEL
    • Solaris
    • Oracle Linux
    • VCS
  • Interview Questions
  • Database
    • oracle
    • oracle 12c
    • ASM
    • mysql
    • MariaDB
  • DevOps
    • Docker
    • Shell Scripting
  • Big Data
    • Hadoop
    • Cloudera
    • Hortonworks HDP

How To Modify Hadoop Log Level

by admin

By default, Hadoop’s log level is set to INFO. This can be too much for most instances, as it will generate huge log files, even in an environment with low to moderate traffic. Changing the root logger in log4j.properties file in Hadoop will not change the log level.

Follow the steps below for changing the log level of Hadoop.

1. Shut down Hadoop if it is still running.

2. Open the [hadoop_home]/bin/hadoop-daemon.sh file. Look for the following line:

export HADOOP_ROOT_LOGGER="INFO,DRFA"

3. Modify that line to a lower or higher log level (WARN should be sufficient if the goal is to limit the size of the log file rather than debugging an issue).

export HADOOP_ROOT_LOGGER="WARN,DRFA"

4. Save the file and start Hadoop.

Filed Under: Hadoop

Some more articles you might also be interested in …

  1. CCA 131 – Set up a local CDH repository
  2. HDPCA Exam Objective – Decommission a node (datanode)
  3. CCA 131 – Create/restore a snapshot of an HDFS directory (Using Cloudera Manager)
  4. Preparing for the HDPCA (HDP Certified Administrator) Exam
  5. HDPCA Exam Objective – Recover a snapshot
  6. HDPCA Exam Objective – Create a snapshot of an HDFS directory
  7. HDPCA Exam Objective – Create a home directory for a user and configure permissions
  8. CCA131 – Configuring HDFS snapshot Policy
  9. HDPCA Exam Objective – Add an HDP service to a cluster using Ambari
  10. Converting Many Small Files To A Sequence File In HDFS

You May Also Like

Primary Sidebar

Recent Posts

  • ncat Command Examples in Linux
  • ncat: command not found
  • nautilus Command Examples in Linux
  • namei: command not found

© 2023 · The Geek Diary

  • Archives
  • Contact Us
  • Copyright