Posts Tagged ‘OneFS’

EMC Isilon OneFS 7.2.1 is available!

Risa Galant

Risa Galant

Principal Technical Writer at EMC Isilon Storage Division
Risa Galant

Latest posts by Risa Galant (see all)

EMC Isilon OneFS 7.2.1 release has some great new and updated features that provide benefits on both the hardware and software side, including:

  • Security Technical Implementation Guide (STIG) configuration support
  • FIPS OpenSSL support
  • CAC/PIV authentication
  • Enhanced IPv6 support
  • Enhanced Swift support
  • Global namespace acceleration and L3 cache interaction
  • New node and SSD class compatibility support

In addition, the upgrade requirements for OneFS 7.2.1 differ from previous releases. This post highlights some of the new capabilities and upgrade requirements.

For more technical information about all of the new OneFS 7.2.1 features and enhancements, refer to the following documents:

New features

The following new features are included in OneFS 7.2.1.

Hardened profiles: Security Technical Implementation Guide (STIG)

If your site requires compliance with the Defense Information Systems Agency (DISA) STIG configuration standards, you’re in luck! OneFS 7.2.1 introduces a license-based security hardening feature through which you can apply and revert a hardening policy on the EMC Isilon cluster to meet DISA STIG configuration standards.

Networking:  enhanced IPv6 support

You can configure your cluster to accept client connections through both IPv4 and IPv6. OneFS adds dual-stack support to enable your cluster to support IPv4 and IPv6 client connections concurrently. And, OneFS 7.2.1 also supports IPv6-only environments.

Note that HDFS, InsightIQ 3.1 and earlier, MMC, NIS, and Swift are not supported over IPv6.

OneFS API: enhanced Swift support

Isilon Swift is now supported with the HTTP and secure HTTP (HTTPS) protocols over IPv4.

Isilon Swift supports the HTTP protocol with IPv6, but does not support HTTPS with IPv6. Isilon Swift also supports the HTTP protocol with IPv4 if STIG hardening is disabled.

File system: Global namespace acceleration (GNA) and L3 cache interaction

OneFS 7.2.1 includes some changes to how storage space calculations work when GNA and L3 cache are both enabled in the same cluster.

In OneFS, you can use solid-state drives (SSDs) for strategies such as GNA mirroring or for L3 cache. GNA mirroring enables data on node pools that do not have SSDs to have additional metadata mirrors on SSDs elsewhere in the cluster. The additional SSD metadata mirroring can improve file system performance by accelerating metadata read operations.

In OneFS 7.2.1, GNA requires that at least 20 percent of the nodes in the cluster contain at least one SSD, and that at least 1.5 percent of the total cluster storage is SSD-based. Any SSDs that are used for L3 cache are not counted against the GNA requirements: with GNA enabled and with L3 cache configured for a pool, the nodes in the pool with L3 cache configured become invisible to the GNA calculations. This change helps to ensure equitable and fair calculations when L3 cache and GNA are enabled in the same cluster.  For more information, see the OneFS 7.2.1 Release Notes and the OneFS 7.2.1 CLI Administration Guide.

Hardware: Node class compatibility

You can deploy a newer-generation node to a cluster that contains nodes from an earlier generation of the same class. For example, if your cluster already has a node pool that consists of Isilon X200 nodes, you can define a compatibility that enables you to add an X210 node to the same node pool. OneFS 7.2.1 supports compatibilities for S200/S210, X200/X210, X400/X410, and NL400/NL410 nodes. Compatible node generations must have identical HDD and SSD layouts and must have a compatible memory configuration. See the OneFS 7.2.1 Release Notes for details.

SSD compatibility

SSD compatibility enables you to add nodes with different capacity SSDs to the same node pool. For example, if your cluster has a node pool that consists of Isilon S200 nodes with 100 GB SSDs and you purchase new S200 nodes with 200 GB SSDs, you can create an SSD compatibility so that the new S200 nodes can be provisioned into the existing S200 node pool. For nodes of different generations—for example, S200 and S210 nodes – you might have to create a node class compatibility and an SSD compatibility to enable the S210 nodes to be provisioned into an S200 node pool.

Support for new platforms

OneFS 7.2.1 provides support for two new platforms: the X210 and the NL410. These nodes support node class compatibility. X210 nodes can be added to existing X200 node pools, and NL410 nodes can be added to existing NL400 node pools.

How to upgrade to OneFS 7.2.1

You can upgrade directly to OneFS 7.2.1 only from OneFS 7.1.1.4 or later, or from OneFS 7.2.0.2 or later. For more information, see Upgrade Paths to OneFS 7.2.1.0.

If you want to upgrade to this new release, explore your upgrade options by reviewing the Isilon Supportability and Compatibility GuideThen, prepare for the upgrade process by reviewing the following documents:

When you’re ready to upgrade, download the OneFS 7.2.1.0 installation file from the Download section of the EMC Online Support site.

All about improving EMC Isilon OneFS release notes

Deb Kuykendall

Deb Kuykendall

Principal Technical Writer at EMC Isilon Storage Division
Deb Kuykendall

Latest posts by Deb Kuykendall (see all)

Back in February, I wrote about EMC Isilon OneFS release notes and hinted that we’d be making changes to the format to improve their usability. I’m happy to announce that these changes are now in place and that you can see them in the OneFS 7.1.1 release notes.

What’s Changed

We’ve merged all of the release notes pertaining to a release branch (for example, 7.1.1) into a single document. This means that the 7.1.1 release notes contain all of the information about this OneFS branch from OneFS 7.1.1.0 (released in August 2014) through 7.1.1.5 (released in June 2015).

The new document includes:

  • All the new features that were introduced in OneFS 7.1.1.0 through OneFS 7.1.1.5
  • All the issues that have been addressed in in OneFS 7.1.1.0 through OneFS 7.1.1.5
  • All the functionality changes that were introduced in in OneFS 7.1.1.0 through OneFS 7.1.1.5

What’s New

To improve the document’s usability, we defined a list of functional areas. And, to help ensure that the functional areas are well understood, we included the full list of functional areas and their definitions at the end of the release notes. For example, the functional area of SMB encompasses new features, changes, and issues that affect SMB environments.

The content in the release notes is organized first by release number (for example, OneFS  7.1.1.2)  and then by functional area. This means that if you want to know if there are any new features, resolved issues, or changes in functionality that affect a particular area, such as SMB, in a specific OneFS release, such as 7.1.1.5, you can use the bookmarks pane or the table of contents to easily find that information.

Here’s an example of what you’ll find in the new table of contents (TOC):

OneFS 7.1.1-7.1.1.5 release notes

And here’s an example of what you’ll find in the Adobe Acrobat or Adobe Reader bookmarks pane:

OneFS 7.1.1-7.1.1.5 Bookmarks

We’ve also added an introductory section for each chapter, describing what you can expect to find there.

The new document also highlights the Target Code release. This change helps you understand how the Target Code release relates to other releases in the branch.

What did we gain?

Before making these changes, if you wanted the full picture of a OneFS release or maintenance release, you’d have to download two or three documents and piece them together. Each document contained some unique information, such as new features, and some overlapping information, such as known issues. The differences weren’t always obvious.

Now all of the information is in a single document that clearly identifies the release in which a fix, a change, or a feature was introduced.

In addition, the release notes previously contained multiple, lengthy tables that were sorted by a cryptic ID number. If you wanted to find issues related to a specific area of operation, you’d have to do a keyword search and collect bits and pieces of information scattered throughout the document.

Now the information is categorized first by the release in which the feature, fix, or change was introduced, and then categorized into tables according to the functional area that the feature, fix, or change affects. The new tables are small and easily scanned, and the information they contain is tightly focused.

How we did it

Developing the new release note format was a team effort involving writers, an information architect, and members of our user experience team.

We conducted user testing and issued a survey about the new format to confirm that the changes we planned to implement were in fact improvements that would benefit our readers. The feedback we received from user testing influenced the development of the document.

For example, one of our concerns early on was that the document was too long. However, user testing indicated that our users don’t read the document from beginning to end. Their chief concern is finding specific pieces of information easily, and they tend to jump from one place to another using keywords, the table of contents, or the bookmarks pane. So document length is not an issue.

Also, we had initially planned to separate new features from changes in functionality. User testing showed that our readers expected to find all of the new and changed features and functionality in the same chapter.

The most striking piece of feedback? Categorizing the information by functional area scored as a significant improvement for all of our testers.

Here are some of the usability testers’ comments:

  • “This is so great! Seriously. This is so much more legible and issues are so much easier to find.
  • “For me the redesign is a massive improvement over the current format. I hope this new format can be the new standard.”
  • “Known issues clearly separated by topic is a huge gain in usability. A consolidated listing of known and resolved issues for the major + each MR in one location is a time saver. If I have to attempt several keyword searches to find what I need, it takes me only 50 percent the time to do this in a combined doc.”

What’s next

As of today, the new release note format has been implemented in the OneFS 7.1.1.0 – OneFS 7.1.1.5 release notes. By the end of July, the new format will be implemented in release notes for the OneFS 7.2.0 branch as new versions of OneFS are released, the new release note format will be used to document those releases.

A new project to evaluate whether the new format can be applied to the release notes for other EMC products will be underway soon.

We’d like to hear from you about the changes and how they affect your ability to use the OneFS 7.1.1 release notes.  You can provide feedback by taking the short survey located here:

http://bit.ly/isi-docfeedback

Or send an email to docfeedback@isilon.com.

These links are also available in the OneFS Release Resources section of the OneFS 7.1.1 Release Notes.

[display_rating_result]

Top 3 operational differences in EMC Isilon OneFS 7.1.1

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

As EMC Isilon OneFS 6.5 and OneFS 7.0 reach their end-of-service life (EOSL) this year, many EMC Isilon customers will be upgrading to OneFS 7.1.1. If you plan to upgrade to OneFS 7.1.1, there are several new features, enhancements, and operational changes that may affect your day-to-day administration tasks. We want you to be aware of some the differences that impact upgrade planning, because they may require pre-upgrade tasks. You can find detailed information in the OneFS 7.1.1 Behavioral and Operational Differences and New Features document on the Isilon Community and OneFS 7.1.1 release notes on the EMC Online Support site.

Meanwhile, here are the top three changes for you to prepare for:

  • Access zones: directory configuration and NFS access
  • SmartPools®: node pool configuration
  • Role-based access controls

Access zones

In OneFS 6.5, access to cluster resources was controlled by authentication providers such as SMB, NFS, and SSH. Beginning in OneFS 7.0, user access to the cluster is controlled through access zones. With access zones, you can partition the cluster configuration into self-contained units, and configure a subset of parameters as a virtual cluster with its own set of authentication providers, user mapping rules, and SMB shares. The built-in access zone is the System zone, which, by default provides the same behavior as OneFS 6.5. You can connect to access zones using all available authentication providers, NFS exports, and SMB shares.

In OneFS 7.1.1, however, you cannot configure NFS exports in multiple access zones. NFS access is restricted to the System zone only. (In OneFS 7.2, NFS is zone-aware for access to multiple access zones.)

Also, access zones require a unique top-level root directory in OneFS 7.1.1. The root directories, or base paths, for multiple access zones in OneFS 7.1.1 cannot overlap with each other.

An important note!

If you currently use multiple access zones in your OneFS 7.0 or OneFS 7.1 cluster, you must check your access zone configuration for overlapping directories. If base paths overlap before you upgrade to OneFS 7.1.1, all previously created access zones will be assigned a base path of /ifs. Refer to OneFS 7.1.1 and Later: Best Practices for Upgrading Clusters Configured with Access Zones before upgrading to prevent a scenario where directories are assigned a new base path to accommodate access zones in OneFS 7.1.1.

SmartPools

In OneFS 6.5, a group of nodes is called a disk pool. Different types of drives could be assigned to a disk pool. There are several changes in SmartPools since 7.0. Beginning in OneFS 7.0, a group of nodes is called a node pool, and a group of disks in a node pool is called a disk pool. Also beginning in OneFS 7.0, nodes are automatically assigned to node pools in the cluster based on the node type. This is called autoprovisioning. Node pools can only include drives of the same equivalence class (review the equivalence class of nodes in the Isilon Supportability & Compatibility Guide). However, you can include multiple node pools into a higher level grouping called tiers. Finally, in the web administration interface of OneFS 7.1.1, SmartPools is located as a tab within Storage Pools.

Disk pools can no longer be viewed or targeted directly through the OneFS 7.1.1 web administration interface or the command-line interface. Instead, the smallest unit of storage that can be administered in OneFS 7.0 is a node pool. Disk pools are managed exclusively by the system through autoprovisioning.

An important note!

If you are running OneFS 6.5 or OneFS 6.5.5 and have node pools of mixed node types, you must configure disk pools into supported OneFS 7.0 and later node pool configurations well in advance of upgrading to OneFS 7.1.1. Supported node pool configurations must contain nodes of the same type, according to their node equivalence class.

Role-based access control (RBAC)

In OneFS 6.5, you can grant web and SSH login and configuration access to non-root users by adding them to the administrator group. In OneFS 7.0 and later, the admin group is replaced with the administrator role using role-based access control (RBAC). RBAC enables you to create and configure additional roles. A role is a collection of OneFS privileges that are granted to members of that role as they log in to the cluster. Only root and admin user accounts can perform administrative tasks and add members to roles. OneFS comes pre-loaded with built-in roles for security, auditing, and system administration, and you can create custom roles with their own sets of privileges.

For information about role-based access, including a description of roles and privileges, see Isilon OneFS 7.0: Role-Based Access Control.

An important note!

For OneFS 6.5 and OneFS 6.5.5 users upgrading to OneFS 7.1.1, make sure you add existing administrators to an administrator role.

For more information about OneFS 7.1.1

Visit these links for more information about:

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, or comments about the video specifically, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

EMC Isilon sessions and labs at EMC World 2015

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

EMC World 2015 is just two weeks away! If you plan on attending this event in Las Vegas, Nevada on May 4-7, you’ll have several opportunities for getting in-depth Isilon information through virtual labs and technology sessions.

Virtual labs

The virtual lab (vLab) experience at EMC World offers two types of labs: self-paced and instructor-led. Anyone can sign up for the self-paced labs, which are available Monday through Thursday, on a first-come, first-served basis. To attend an instructor-led lab, register onsite by visiting the EMC vLab registration desk in The Village at EMC World.

There will be three labs featuring Isilon products.

  • Deploying Hadoop on Isilon (instructor-led; register onsite)
    Deploying Hadoop on Isilon will provide you with hands-on experience with deploying and testing a Hadoop cluster using Isilon. This is a quick walkthrough of key parts of the Hadoop Starter Kit for Isilon.
  • Isilon Overview with InsightIQ (self-paced; first-come, first-served)
    Isilon Overview with InsightIQ will show you the simplicity of setup, scaleout storage, and the ease of management, availability, and even SmartLock mode (WORM) storage. Enhanced with an overview of InsightIQ, our powerful monitoring and reporting software that maximizes your time by minimizing storage management.
  • The Isilon Data Lake with Sparks and & HBase (self-paced; first-come, first-served)
    The Isilon Data Lake will demonstrate some of the key features of Isilon in a data lake environment, including multiprotocol access, access control lists, and access zones. You’ll see these features in action as you walk through a complete analytics use-case that integrates Apache Spark, Apache HBase, and simple Python scripts.

photo_vlabs_2

Technology Breakout Sessions

Breakout sessions occur throughout the conference. There are six technology breakout sessions dedicated to Isilon products, and several more that show how Isilon can be an integral part of emerging technology solutions. These sessions range in technical level of information from introductory to advanced. Visit the session catalog for scheduling options.

Find our booth

If you missed the technology session you wanted to attend or couldn’t get on the schedule for a vLab, stop by booth 813. You’ll find Isilon representatives at product kiosks who can walk you through short, 10-minute presentations and product demonstrations. We look forward to seeing you there!

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, or comments about the video specifically, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

Quick Start Lab Guide for adding capacity or performance in the EMC Isilon OneFS Simulator

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

The EMC Isilon OneFS Simulator is a great resource for trying out OneFS on a virtual infrastructure. The OneFS Simulator is a free version of OneFS 7.2 that you can download for non-production purposes. In this simulated OneFS environment, you can get an idea of what it’s like to administer a full Isilon cluster installation.

After downloading and setting up the OneFS Simulator, take a look at our recently published Quick Start Lab Guide. This lab guide walks you through exercises for using the OneFS Simulator. The featured exercise in this guide helps you add capacity, CPU, and memory to your virtual EMC Isilon cluster by adding another node.

Leave feedback about this lab guide

This is the first lab guide for the OneFS Simulator that we’ve published. Please let us know what you think. If you like this guide, have feedback about the format, or suggestions for other quick start guides, please leave a comment or send an email to isicontent@emc.com.

Get help with OneFS Simulator set up

If you need help with the initial set up of OneFS Simulator on your virtual environment, watch this video:

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, or comments about the video specifically, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

Cluster capacity advice from an EMC Isilon expert

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

Avoiding scenarios where your cluster reaches maximum capacity is crucial for making sure it runs properly. Our Best Practices for Maintaining Enough Free Space on Isilon Clusters and Pools guide contains information to help Isilon customers keep their clusters running smoothly.

However, there are common misperceptions about cluster capacity, such as the notion that it’s easy to delete data from a cluster that is 100 percent full. Another misunderstanding: using Virtual Hot Spare (VHS) to reserve space for smartfailing a drive is not always necessary.

To clarify these issues and other concerns about cluster capacity, I interviewed one of Isilon’s top experts on this topic, Bernie Case. Bernie is a Technical Support Engineer V in Global Services at Isilon, with many years of experience working with customers who experience maximum cluster capacity scenarios. He is also a contributing author to the Best Practices for Maintaining Enough Free Space on Isilon Clusters and Pools guide. In this blog post, Bernie answers questions about cluster capacity and provides advice and solutions.

Q: What are common scenarios in the field that lead to a cluster reaching capacity?

A: The typical scenarios are when there’s an increased data ingest, which can come from either a normal or an unexpected workflow. If you’re adding a new node or replacing nodes to add capacity, and it takes longer than expected, a normal workflow will continue to write data into the cluster—possibly causing the cluster to reach capacity. Or there is a drive or node failure on an already fairly full cluster, which necessitates a FlexProtect (or FlexProtectLin) job from the Job Engine to run to re-protect data, therefore interrupting normal SnapshotDelete jobs. [See EMC Isilon Job Engine to learn more about these jobs.] Finally, I’ve seen snapshot policies that create a volume of snapshots that takes a long time to delete even after snapshot expiration. [See Best Practices for Working with Snapshots for snapshot schedule tips.]

Q: What are common misperceptions about cluster capacity?

A: Some common misconceptions include:

  • 95 percent of a 1 PiB cluster still leaves about 50TiB of space. That’s plenty for our workflow. We won’t fill that up.
  • Filling up one tier and relying on spillover to another tier won’t affect performance.
  • The SnapshotDelete job should be able to keep up with our snapshot creation rate.
  • Virtual Hot Spare (VHS) is not necessary in our workflow; we need that space for our workflow.
  • It’s still very easy to delete data when the cluster is 100 percent full.

Q: What are the ramifications of a full cluster?

A: When a cluster reaches full capacity, you’re dealing primarily with data unavailable situations—where data might be able to be read, but not written. For example, a customer can experience the inability to run SyncIQ policies, because those policies write data into the root file system (/ifs). There’s also the inability to make cluster configuration changes because those configurations are stored within /ifs.

Finally, a remove (rm) command for deleting files may not function when a cluster is completely full, requiring support intervention.

Q: What should a customer do immediately if their cluster is approaching 90-95 percent capacity?

A: Do whatever you can to slow down the ingesting or retention of data, including moving data to other storage tiers or other clusters, or adjusting snapshot policies. To gain a little bit of temporary space, make sure that VHS is not disabled.

Call your EMC account team to prepare for more storage capacity. You should do this at around 80-85 percent capacity.  It does take time to get those nodes on-site, and you don’t want any downtime.

VHS in SmartPools settings should always be enabled. The default drive to protect is 1 drive, and reserved space should be set to zero. For more information, see KB 88964.

VHS options should always be selected to set aside space for a drive failure. You should have at least 1 virtual drive (default value) set to 0% of total storage. For more information on these default values, see KB 88964 on the EMC Online Support site.

Q: What are the most effective short-term solutions for managing or monitoring cluster capacity?

A: Quotas are an effective way to see real-time storage usage within a directory, particularly if you put directories in specific storage tiers or node pools. Leverage quotas wherever you can.

The TreeDelete job [in the Job Engine] can quickly delete data, but make sure that the data you’re deleting isn’t just going into a snapshot!

Q: What are the most effective long-term solutions to implement from the best practices guide?

A: Make sure you have an event notifications properly configured, so that when jobs fail, or drives fail, you’ll know it and can take immediate action. In addition to notifications and alerts, you can use Simple Network Management Protocol (SNMP) to monitor cluster space, for an additional layer of protection.

InsightIQ and the FSAnalyze job [which the system runs to create data for InsightIQ’s file system analytics tools] can give great views into storage usage and change rate, over time, particularly in terms of daily, monthly, or weekly data ingest.

Q: Is there anything you would like to add?

A: Cluster-full situations where the rm command doesn’t work are sometimes alarming. In a file system such as OneFS, a file deletion often requires a read-modify-write cycle for metadata structures, in addition to the usual unlinking and garbage collection that occurs within the file system. Getting out of that situation can be challenging and sometimes time-consuming. Resolving it requires a support call—and a remote session, which can be a big problem for private clusters.

Sometimes accidents happen or a node can fail, which can push a cluster to the limit of capacity thresholds. Incidents such as these can occasionally lead to data unavailability situations that can halt a customer’s workflow. Being ready to add capacity at 80-85 percent can prevent just this sort of situation.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, or comments about the video specifically, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

The EMC Isilon Uptime Bulletin, reinvented

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

When we launched the EMC® Isilon® Uptime Bulletin in 2013, each issue was published in a PDF format that could be downloaded from the EMC Online Support site. Because the Uptime Bulletin contains timely information, such as OneFS target code, tips, and the latest firmware releases, we wanted to deliver this information to our customers in a more direct way.

Beginning this year, new Uptime Bulletin content is published to the Uptime Information Hub on the Isilon online community. You can now locate useful information about best practices, OneFS patches, and the latest OneFS and firmware releases, at a glance. The Uptime Information Hub is continuously updated with new information. So be sure to bookmark this page and check it regularly.

New uptime OneFS topic articles

Every quarter, we develop Uptime Bulletin articles that offer tips and best practice information about using OneFS. Here is a summary of new articles that you can now read on the Uptime Information Hub.

  • OneFS MRs and How We Drive Continuous Improvements
    ToddDillon

    Todd Dillon

    Todd Dillon, Senior Director of Software Engineering, explains how Isilon Storage Division uses the EMC Total Customer Experience process to triage every customer-impacting event in OneFS that happens worldwide. Learn how this three-phase process helps to drive continuous improvements with quality assurance (QA) and how maintenance releases (MRs) are determined.

  • Planning OneFS Upgrades with Global Namespace Acceleration (GNA) Nodes
    GNA is a OneFS feature that helps you increase performance by using solid state drives (SSDs) to store metadata for read-only purposes. If you use the GNA feature and are planning to upgrade to OneFS 7.0 and later, there are important considerations you need to make. Learn how to verify that your cluster meets minimum requirements for GNA before you upgrade.
  • Performance Monitoring and Planning
    uptime performance article
    Basic performance measurement knowledge of your current Isilon cluster can help you in understanding how adding new volumes or workloads will impact performance. This article walks you through how to perform a workload analysis, and provides best practice information about when to perform this type of analysis.

If you have article feedback or comments, please leave a comment on the Isilon community.  You can also review the PDF versions of past issues of the Uptime Bulletin by visiting the EMC Online Support site.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

New EMC Isilon videos for a new year!

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

Happy New Year! I hope you had a wonderful holiday season!

December was a busy month. I recently shared a survey about which EMC® Isilon® OneFS® topics you would like to learn more about. I’ll announce the survey results and the new Hacker How-To series topic next week.

We also published two videos in December that you can view now.

Technical Demo: EMC Isilon OneFS Simulator

You can now spin up your own virtual OneFS 7.2 cluster. This technical demo video shows you how to download and extract the OneFS Simulator file from the EMC Isilon OneFS Operating System Simulator Download website. It then provides steps for setting up a VMware® player, gathering configuration details, and creating a three-node virtual cluster.

Technical Demo: EMC Isilon SnapshotIQ

This demo video walks you through common configuration tasks using the OneFS web administration and command-line interfaces, such as creating, viewing, reverting, and deleting snapshots.

Stayed tuned to our Isilon Support playlist and the EMC Isilon online community for upcoming videos.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

Multitenancy for Hadoop data on an EMC Isilon cluster

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

The process of analyzing big data within big organizations can be complicated. There can be many data sets to analyze, some which are stored in silos or contain secure information. And there can be many different Hadoop users accessing these data sets, each with different permissions and credentials. So how can organizations effectively manage multiple data sets and Hadoop users?

In EMC® Isilon® OneFS®, you can take advantage of multitenancy to tackle this issue. Multitenancy creates secure, separate namespaces on a shared infrastructure so that different Hadoop users (or tenants) can connect to an Isilon cluster, run Hadoop jobs concurrently, and consolidate their Hadoop workflows onto a single cluster. OneFS 7.2 supports several Hadoop distributions and HDFS 2.2, 2.3, and 2.4. The OneFS HDFS implementation also works with Ambari for management and monitoring, Kerberos authentication, and Kerberos impersonation.

The white paper, “EMC Isilon Multitenancy for Hadoop Big Data Analytics,” highlights how to set up access zones for multitenancy and manage Hadoop data in an Isilon cluster.

How Hadoop works in Isilon

The Apache Hadoop analytics platform comprises the Hadoop Distributed File System, or HDFS, a storage system for vast amount of data, and MapReduce, a processing paradigm for data-intensive computation analysis.

EMC Isilon serves as the file system for Hadoop clients. This enables Hadoop clients to directly access their datasets on the Isilon storage system and run data analysis jobs on their compute clients. OneFS implements server-side operations of the HDFS protocol on each node in the Isilon cluster to handle calls to the NameNode and to manage read/write requests to DataNodes.

EMC Isilon Hadoop Deployment

To configure an Isilon cluster for Hadoop, you first need to activate a HDFS license in OneFS. Contact your account team for more information. Then visit our EMC Hadoop Starter Kits to learn how to deploy multiple Hadoop distributions, such as Pivotal, Cloudera, or HortonWorks, on your Isilon cluster.

Access zones for multitenancy

Access zones lay the foundation for multitenancy in OneFS. Access zones provide a virtual security context that segregates tenants and creates a virtual region that isolates data sets. Each access zone encapsulates a namespace, HDFS directory, directory services, authentication, and auditing. An access zone also isolates system connections for further security.

The following procedures for managing and securing data sets are covered in “EMC Isilon Multitenancy for Hadoop Big Data Analytics.”

  • Provide multiprotocol support – Learn how you can store data by using existing workflows on your Isilon cluster and access it through SMB, NFS, OpenStack Swift, and HDFS protocols, instead of running HDFS copy operations to move data to Hadoop clients.
  • Manage different data sets – Learn how you can use SmartPools for managing different data sets based on customized policies.
  • Associate network resources with access zones – Understand how virtual racking works in Isilon and how you can configure SmartConnect in OneFS to manage connections to data on your Isilon cluster.
  • Secure access zones – Review how role-based access control and directory services with access zones in OneFS are used to authenticate users assigned to each zone.

Hadoop information hubs

You can find a rich array of information about Isilon and Hadoop. Visit our online Isilon Community on the EMC Community Network for InfoHubs, which serves as a single location for all of our Hadoop-related content. The Hadoop InfoHub contains links to general information about Isilon and Hadoop. The Cloudera with Isilon InfoHub contains links to information about deploying the Cloudera distribution for Isilon.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

Object storage in EMC Isilon Swift

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

Next-generation applications for cloud, analytics, social media and mobile devices  rely on object storage to store and access data. Object storage is an efficient way to store large amounts data: it flattens data hierarchy and enables automated API access between storage and applications. You can integrate object storage into your EMC® Isilon® cluster by using the open source OpenStack™ Swift API. OneFS® 7.2 exposes the OpenStack Object Storage API as a set of Representational State Transfer (REST) web services over HTTP. This way, you can direct applications that use the Swift API to store content and metadata as objects on your Isilon cluster.

What are the specific benefits of using Isilon Swift? First, the containers and objects that you save on an Isilon cluster can also be simultaneously accessed as directories and files by using other supported protocols such as NFS, SMB, HTTP, FTP, and HDFS. This interoperability between protocols can eliminate islands of storage and simplify management. Second, you can take advantage of Isilon authentication to secure the content saved through the Swift API.

How Isilon Swift works

The Swift API requests that you submit can store and manage containers, objects, and metadata in the OneFS file system. An instance of the Swift protocol driver runs on each node in the cluster and handles API requests.

The Swift API presents the home directories as accounts, directories as containers, and files as objects. Each home directory in the OneFS file system maps to a Swift account. The directories and subdirectories in a home directory map to containers and subcontainers. Files appear as objects. All objects have metadata.

How OneFS interoperates between object and file. See the OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS white paper for more information.

How OneFS interoperates between object and file. See the OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS white paper for more information.

Authentication in OneFS

When a Swift client connects to an Isilon cluster, the connection must be authenticated. Authentication takes places in an OneFS access zone. Access zones are virtual contexts that you can set up to control access to an Isilon cluster through an incoming IP address. When a Swift user submits an authentication request to the cluster, OneFS creates an access token for the user. This token contains the user’s full identity and security credentials for the access zone that the user is assigned to. For more information about how authentication works in OneFS, see the following white papers: OneFS Multiprotocol Security Untangled and OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS.

Client libraries and HTTP requests

Isilon Swift supports two client libraries: the Python-Swift client library and Apache Libcloud. The following HTTP requests are supported by Isilon Swift to work with these libraries: GET, PUT, DELETE, POST, HEAD, and COPY requests. Isilon Swift does not support certain object store features, such as using the HTTPS protocol and accessing conditional GET and PUT calls based on ETag matching. For more information, see the Isilon Swift Tech Note (login to the EMC Online Support site is required).

For more information

If you want to learn more about Isilon Swift, read OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS. If you have OneFS 7.2 and need commands and procedures for using Isilon Swift, refer to the Isilon Swift Tech Note on the EMC Online Support site.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]