Posts Tagged ‘SyncIQ’

Get your hands on EMC Isilon OneFS 7.1 at EMC World 2014

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein


EMC World 2014 is around the corner. If you plan to be in Las Vegas, Nevada on May 5-8 for this event, you have the opportunity to try out the EMC® Isilon® OneFS operating system in person.

There will be three labs hosted by EMC Isilon that are available throughout the conference, where you can test drive new features and functionality in OneFS using real data.

  • Isilon Cluster Setup, Configuration, and Management (HOL 29)
    An introductory lab that demonstrates how to create a storage cluster, join the cluster to an Active Directory domain, navigate the OneFS web administration interface, and create and manage directories or shares.
  • Isilon OneFS 7.1 Enhancements (HOL 30)
    An intermediate lab that explores the enterprise-ready enhancements built into OneFS 7.1.
  • Deploying Hadoop with EMC Isilon and VMware (HOL 28)
    An advanced lab that walks you through the process of deploying and using your first Hadoop cluster. Learn how to use VMware Big Data Extensions to deploy a small Hadoop cluster with an EMC Isilon NAS storage cluster.

Anyone can sign up for the labs and attend at any time. All labs are self-paced and Isilon representatives will be available to answer any questions you might have. For lab hours and information about how to register, visit the EMC World vPass website.

Take a test drive with OneFS 7.1

This blog has covered several of the enhancements and features included in OneFS 7.1. If you’re curious about OneFS 7.1 and want to take it for a test drive, visit the OneFS 7.1 Enhancements (HOL 30) lab. Here’s a closer look at the following features will be covered in this lab session:

  • Role based access control
  • EMC Isilon SmartDedupe™
  • EMC Isilon SyncIQ™
  • Audting

Role Based Access Control

Role based access control (RBAC) in OneFS 7.1 enables you to control configuration-level access of your Isilon cluster through roles and privileges. OneFS 7.1 comes with built-in administrator roles: SecurityAdmin, SystemAdmin, AuditAdmin, and VMwareAdmin. You can also create custom roles with assigned privileges and add users and groups to those roles.

In this lab, you will learn how to:

  • View built-in roles
  • Create a custom role
  • Add privileges to a role
  • Add a user to a role

If you are unable to attend EMC World, but would like an RBAC demonstration, watch the following video, “Technical Demo: Role Based Access Control.”

EMC Isilon SmartDedupe™

When you want to save space on your EMC Isilon cluster, use EMC Isilon SmartDedupe™ to remove, or deduplicate, redundant data. SmartDedupe deduplicates data by scanning an Isilon cluster for identical data blocks. When it finds redundant data blocks, it moves one data block to a shadow store. It then deletes the duplicate block from the original file and replaces it with a pointer to the shadow store. For more information, watch the video, “Enterprise Features of EMC Isilon OneFS 7.1: SmartDedupe.”

dedupe assessment report

Figure 1: A DedupeAssessment report. Space that can be recovered after deduplication is circled in red.

The deduplication process is performed through jobs that are managed in the same way you manage other cluster maintenance jobs. It is recommended that you run deduplication jobs when clients are not modifying data on the cluster. This maximizes the amount of space you can save. It is also recommended that you run a deduplication job every ten days.

To begin the deduplication process, first determine how much space you can save on specified directories by running a DedupeAssessment job and viewing a DedupeAssessment report (Figure 1). You can then run a Dedupe job on those directories to then remove redundant data and place it in the shadow store.

In the OneFS 7.1 Enhancements (HOL 30) lab, you will learn how to:

  1. Start a DedupeAssessment job
  2. View active jobs
  3. View the deduplication assessment report
  4. Activate the SmartDedupe license
  5. Start a Dedupe job
  6. View the deduplication report

EMC Isilon SyncIQ™

For data protection and disaster recovery, EMC Isilon SyncIQ™ replicates data from one Isilon cluster to another. In the event of disaster scenario where your original cluster goes down, you can retrieve replicated data stored on your backup cluster.


Figure 2: A new option (circled in red) for SyncIQ policies, which is available in OneFS 7.1

To replicate data using SyncIQ, first create a SyncIQ policy in OneFS. The policy specifies the source directory and backup/target cluster, and when to run the replication job. In OneFS 7.1, there is a new policy option available that enables OneFS to replicate data whenever the source directory is modified (Figure 2). This enhancement ensures that data is replicated as soon as a change occurs, independent of the replication job schedule.

In the OneFS 7.1 Enhancements (HOL 30) lab, you will learn how to:

  1. Activate a SyncIQ license
  2. Configure a SyncIQ policy
  3. Verify that the SyncIQ policy successfully synchronized between a source and target cluster


OneFS 7.1 can audit system configuration and SMB protocol access events on your Isilon cluster. To start collecting auditing information, simply enable configuration change auditing or SMB protocol access auditing in either the OneFS web administration interface or the OneFS command-line interface (Figure 3). System configuration changes and changes performed on files and folders through the SMB protocol are recorded in an auditing log. Protocol auditing logs can be exported to Varonis DatAdvantage® or other third-party vendors that support the EMC Common Event Enabler (CEE) framework. For more information, watch the video, “Enterprise Features of EMC Isilon OneFS 7.1: Auditing”.

Figure 3: How to enable auditing (circled in red) in OneFS 7.1 web administration interface.

Figure 3: How to enable auditing (circled in red) in OneFS 7.1 web administration interface.

In the OneFS 7.1 Enhancements (HOL 30) lab, you will learn how to:

  1. Enable auditing
  2. Make an access zone into an audited zone
  3. Add an audit event, which will modify the audited zone to audit different events
  4. Generate an event
  5. View and locate audit logs
  6. View event forwarding
  7. View the AuditAdmin role
  8. Open DatAdvantage and view user statistics and event details

For more information

For more details about these features, refer to OneFS 7.1 release notes, OneFS 7.1 Web Administration Guide, and the OneFS 7.1 CLI Administration Guide.

For more information about Isilon sessions and labs at EMC World, visit the EMC World 2014 vPass website to browse the EMC World Session Catalog for more information.

Data Protection and Disaster Recovery with EMC Isilon SyncIQ

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

To prepare for disaster scenarios, such as an unplanned outage that can potentially compromise your data, you need a solution that creates and safely stores copies of your data.

EMC Isilon SyncIQ is Isilon’s data replication software and a key element of a robust data protection and disaster recovery solution. SyncIQ works with the underlying snapshot technology of EMC Isilon SnapshotIQ software to copy data blocks that change between replications. The replication process is completed quickly and with minimal disruption.

In this video, Principal Solutions Architect Amol Choukekar, answers frequently asked questions about SyncIQ. Watch this video to gain a basic understanding of the technical concepts and functionality of SyncIQ. For more information, contact your EMC Isilon account representative.

Video Transcript

Hello. This is Amol Choukekar, Principal Solutions Architect with EMC Isilon storage division.

Today, I’m going to talk about EMC Isilon SyncIQ and how it helps in implementing a disaster recovery and data protection strategy.

In this video, we’ll talk about EMC Isilon SyncIQ’s design features, basic functionality, and the operations associated with it.

SyncIQ is EMC Isilon’s data replication feature.

It is a licensed feature of OneFS and it replicates data from one cluster to another cluster, asynchronously, over a standard LAN or WAN connection.

SyncIQ allows creating user-defined policies that can be scheduled to replicate data to meet data recovery point objectives.

SyncIQ maintains the integrity of data by copying the data as well as the metadata, like permissions associated with files and directories.

SyncIQ uses underlying snapshot technology that performs block-based delta copies between replications.

This results in tremendous WAN bandwidth savings and shrinks the time needed to keep the data in sync between two clusters.

SyncIQ is typically set up to replicate data from a single source cluster to a single target cluster in a one-to-one relationship.

However, SyncIQ is capable of replicating from a single source cluster to multiple target clusters in a one-to-many relationship.

As we can see in this example here, we have a dataset, D1, replicating to both cluster 2 and cluster 3 in a one-to-many relationship.

At the same time, we can see that we have cluster 1 and cluster 3 with independent datasets participating in a SyncIQ relationship in a bi-directional fashion.

Thus, we can say that SyncIQ can perform one-to-one, one-to-many, and bi-directional replication with independent datasets.

Starting with EMC Isilon OneFS 7.0, SyncIQ functionality has been enhanced for ease of failover and failback.

Now, let’s take a look at the operations associated with SyncIQ.

As we can see in the example on the whiteboard here, we have a production side and we have a disaster recovery side. We have data on the production side in read-write mode and we have data on the disaster recovery side as read-only. This is marked read-only to maintain the integrity of the data.

Now, let’s talk about failover. Failover can be temporary or failover can be permanent in case of a disaster.

Now, let’s talk about a temporary failover. For example, a DR testing scenario.

What is failover? Failover is nothing but marking the target directory on the disaster recovery side as read-write.

Now, let’s say in case this was temporary, and we are done with the disaster recovery test, we wrote some data, D2, as in this example, and we want to continue the normal operation as it was before.

What would need to happen is a process called as a “failover revert”.

What is failover revert? Failover revert is nothing but discarding the changes that were written while we were in a read-write state and marking the target side back as read-only so that normal processing can continue.

Now, what happens in case of an actual disaster?

You would have your production side inaccessible.

You’ll initiate a failover process which marks the target side as read-write and you would point your clients to the target side or the disaster recovery side, and you continue writing new data to it, D2, D3, in this case.

Let’s say after a period of time, the production side comes back up and we want to go back to the original production, there’s a couple of processes that need to happen.

While we were on the disaster recovery side, we wrote some new data, which is significant data now.

That needs to get copied back to the production side and that is done through what is called as a “failback” process.

So, what is a failback process? Failback process is reversing the direction of the SyncIQ policy and copying all the changes from the disaster recovery side to the production side.

So you would have your D2 and your D3 copied to the production side.

Once that is done, a normal failover can be initiated, where we can mark the production side as read-write and we can continue your normal operations in the same direction from production to disaster recovery side and mark disaster recovery side back as read-only and continue replicating data to it.

As we saw in this video, SyncIQ provides powerful functionality for disaster recovery and data protection.

If you have any further questions about SyncIQ and would like to implement SyncIQ in your environment, please feel free to contact your EMC account team or EMC Business Partner.

Thank you for watching.