• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

The Geek Diary

HowTos | Basics | Concepts

  • Solaris
    • Solaris 11
    • SVM
    • ZFS
    • Zones
    • LDOMs
    • Hardware
  • Linux
    • CentOS/RHEL 7
    • RHCSA notes
    • SuSE Linux Enterprise
    • Linux Services
  • VCS
    • VxVM
  • Interview Questions
  • oracle
    • ASM
    • mysql
    • RAC
    • oracle 12c
    • Data Guard
  • DevOps
    • Docker
    • Shell Scripting
  • Hadoop
    • Hortonworks HDP
      • HDPCA
    • Cloudera
      • CCA 131

CCA131 – Configuring HDFS snapshot Policy

By admin

Note: This post is part of the CCA Administrator Exam (CCA131) objectives series

What is HDFS Snapshot Policy

You can create Snapshot Policies using Cloudera Manager for taking an automated snapshot of snapshottable paths on HDFS. The snapshot policies run at the time specified (hourly, daily, weekly etc) by the user. Before we can create a Snapshot policy we must allow snapshot on the HDFS directory first.

Configuring a Snapshot Policy

The following are the steps to create a snapshot policy for snapshottable paths on HDFS:

1. Navigate to Backups > Snapshots to configure a HDFS snapshot policy.

configure HDFS snapshot policy CCA 131 exam preparation

2. Currently, we do not have any policy configured. Click on “Create snapshot policy” to create a new policy.

create new HDFS snapshot policy using Cloudera Manager CCA131

3. As you see in the preceding screenshot, we have provided the name of the policy (test_snap_policy) and HDFS Path (/user/test) for which the policy is to be configured. You can provide multiple paths in a single policy as well.

provide name and snapshottable path to create HDFS snapshot policy using Cloudera Manager

The policy is configured to take a snapshot hourly at 55 minutes and it will save the last 2 snapshots and delete the rest. You can set the alerts to be sent on success, failure, start and abort of the policy. We have selected “On Success” and “On Failure” options to send alerts.

set schedule and alerts for HDFS snapshot policy

4. You should see the policy configured. Currently, the policy is not yet run as shown in the screenshot below.

view last run of HDFS snapshot policy from Cloudera Manager

View the Snapshot History

Once the policy is run as per the schedule you can see the “Last Run” of the snapshot policy on the “Snapshot Policies” page as shown in the screenshot below.

view last run of the HDFS snapshot policy in Cloudera Manager CCA131

To list out all the history of past snapshots taken under a specific policy, select the “Show History” option under the “Actions” drop-down menu.

view HDFS snapshot history in Cloudera Manager CCA 131 exam

Disable/delete Snapshot Policy

Snapshot policies once configured will run until you either disable them or delete them. To disable a snapshot policy select “Disable” option under “Actions” drop-down.

disable HDFS snapshot policy CCA131

Similarly, to delete the policy select “Delete” option under “Actions” drop-down.

delete HDFS snapshot policy using Cloudera Manager

Confirm the deletion of the snapshot on the next window.

confirm deletion of HDFS snapshot policy in Cloudera Manager CCA131

CCA 131 – Create/restore a snapshot of an HDFS directory (Using Cloudera Manager)

Filed Under: CCA 131, Cloudera, Hadoop

Some more articles you might also be interested in …

  1. HDPCA Exam Objective – Install and configure Ranger
  2. HDPCA Exam Objective – Recover a snapshot
  3. CCA 131 – Add a new node to an existing cluster
  4. HDPCA Exam Objective – View an application’s log file (Troubleshoot a failed job)
  5. HDPCA Exam Objective – Configure HiveServer2 HA ( Part 2 – Configure HA )
  6. Preparing for the HDPCA (HDP Certified Administrator) Exam
  7. CCA 131 – Perform OS-level configuration for Hadoop installation
  8. How to configure Capacity Scheduler Queues Using YARN Queue Manager
  9. CCA 131 – Configure HDFS ACLs
  10. HDPCA Exam Objective – Restart an HDP service

You May Also Like

Primary Sidebar

Recent Posts

  • “su: Authentication failure” – in Docker
  • How to Pause and Resume Docker Containers
  • How to find docker storage device and its size (device mapper storage driver)
  • Understanding “docker stats” Command Output
  • ‘docker images’ command error – “Permission Denied”
  • Archives
  • Contact Us
  • Copyright

© 2019 · The Geek Diary