Archive for November, 2014

Object storage in EMC Isilon Swift

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

Next-generation applications for cloud, analytics, social media and mobile devices  rely on object storage to store and access data. Object storage is an efficient way to store large amounts data: it flattens data hierarchy and enables automated API access between storage and applications. You can integrate object storage into your EMC® Isilon® cluster by using the open source OpenStack™ Swift API. OneFS® 7.2 exposes the OpenStack Object Storage API as a set of Representational State Transfer (REST) web services over HTTP. This way, you can direct applications that use the Swift API to store content and metadata as objects on your Isilon cluster.

What are the specific benefits of using Isilon Swift? First, the containers and objects that you save on an Isilon cluster can also be simultaneously accessed as directories and files by using other supported protocols such as NFS, SMB, HTTP, FTP, and HDFS. This interoperability between protocols can eliminate islands of storage and simplify management. Second, you can take advantage of Isilon authentication to secure the content saved through the Swift API.

How Isilon Swift works

The Swift API requests that you submit can store and manage containers, objects, and metadata in the OneFS file system. An instance of the Swift protocol driver runs on each node in the cluster and handles API requests.

The Swift API presents the home directories as accounts, directories as containers, and files as objects. Each home directory in the OneFS file system maps to a Swift account. The directories and subdirectories in a home directory map to containers and subcontainers. Files appear as objects. All objects have metadata.

How OneFS interoperates between object and file. See the OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS white paper for more information.

How OneFS interoperates between object and file. See the OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS white paper for more information.

Authentication in OneFS

When a Swift client connects to an Isilon cluster, the connection must be authenticated. Authentication takes places in an OneFS access zone. Access zones are virtual contexts that you can set up to control access to an Isilon cluster through an incoming IP address. When a Swift user submits an authentication request to the cluster, OneFS creates an access token for the user. This token contains the user’s full identity and security credentials for the access zone that the user is assigned to. For more information about how authentication works in OneFS, see the following white papers: OneFS Multiprotocol Security Untangled and OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS.

Client libraries and HTTP requests

Isilon Swift supports two client libraries: the Python-Swift client library and Apache Libcloud. The following HTTP requests are supported by Isilon Swift to work with these libraries: GET, PUT, DELETE, POST, HEAD, and COPY requests. Isilon Swift does not support certain object store features, such as using the HTTPS protocol and accessing conditional GET and PUT calls based on ETag matching. For more information, see the Isilon Swift Tech Note (login to the EMC Online Support site is required).

For more information

If you want to learn more about Isilon Swift, read OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS. If you have OneFS 7.2 and need commands and procedures for using Isilon Swift, refer to the Isilon Swift Tech Note on the EMC Online Support site.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

Top EMC Isilon support documents for October 2014

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

Each month, you can can the top 20 most viewed EMC® Isilon® support documents and discover recently recently published content, from videos to white papers.

Most viewed knowledgebase (KB) articles

Check out October’s top 10 most viewed KB articles.

  1. How to download OneFS 7.1.1.1 (172492)
  2. OpenSSL Heartbeat Vulnerability (Heartbleed) in EMC products (185965)
  3. OpenSSL Multiple Vulnerabilities in EMC products (188456)
  4. How to upload files to Isilon Technical Support (16759)
  5. Best practices for NFS client settings (90041)
  6. OneFS 7.1.0.3 SMB and Authentication Rollup Patch (174372)
  7. OneFS 6.5 and later: How to safely shut down an Isilon cluster prior to a scheduled power outage (16529)
  8. How to reset the CELOG database and clear all historical events (16586)
  9. OneFS 7.0: Active Directory clients cannot connect to the cluster after the machine account password is changed (169843)
  10. How to reset a node to factory defaults (16696)

Most viewed product documentation

We’re working on our analytic reports. Check back next month.

New Isilon support content

Check out these links to new support content published in October (login to the EMC Online Support site is required for all content except videos). For example, download release notes for the latest maintenance releases (MRs) and InsightIQ 3.1, and learn about SMB share provisioning and how to enable SMB logging and auditing in OneFS.

Content Type

Title and link

Video Technical Demo: SMB Share Provisioning and Administration in EMC Isilon OneFS 7.1.1
Document Quick Reference Guide for EMC Isilon Customers
Release Notes InsightIQ 3.1 Release Notes
Release Notes OneFS 7.1.1 MR Release Notes
Release Notes Isilon OneFS 7.1.0 MR Release Notes
Release Notes Isilon OneFS 6.5.5.29 MR Release Notes
Release Notes Isilon OneFS 6.5.5.30 MR Release Notes
Release Notes Isilon OneFS 7.0.2 MR Release Notes
Release Notes Isilon Drive Support Package 1.2 Release Notes
Release Notes Isilon Drive Firmware Package 1.8 Release Notes
KB Article How to enable and configure Virtual Hot Spare (VHS) (88964)
KB Article OneFS 7.1.1: MMC cannot be browsed while creating a new share (188294)
KB Article Impact of Daylight Saving Time changes in Russia on OneFS (193211)
KB Article Impact of Daylight Saving Time changes in Russia on Isilon InsightIQ (193285)
KB Article OneFS 7.1.1.0 – 7.1.1.1: Node panics and reboots during firmware update of L3 cache SSDs (193353)
KB Article How to enable SMB logging and auditing in OneFS 7.0 (166365)
KB Article OneFS 7.1.1: File pool policy “greater than” and “less than” file matching date criteria operators may lead to confusion around the relative date usage (193512)
KB Article OneFS 7.1: Error when copying files using the isi_vol_copy_vnx utility (187008)
KB Article How to edit crontab (16480)
KB Article OneFS 6.5 and earlier: How to restrict SSH and OneFS web administration interface access to an Isilon cluster (16602)
KB Article How to add custom hosts to a cluster (16625)
KB Article How to enable SMB or SMB2 logging and auditing in OneFS 6.5 (16545)
KB Article OneFS: Configuring sysctls and making sysctl changes persist through node and cluster reboots and upgrades (89232)
KB Article OneFS: How to configure remote logging from a cluster to a remote server (16661)
KB Article How to configure LACP between a Cisco switch and an Isilon cluster running OneFS 6.5 or later (16599)
KB Article How to configure Fast EtherChannel (FEC) or Gigabit EtherChannel (GEC) between a Cisco switch and an Isilon cluster running OneFS 6.5 or later (192782)
KB Article OneFS 6.0 and later: How to disable SSLv2 support and increase encryption requirements in the Isilon web administration interface (16946)
KB Article OneFS 7.0 and later: How to disable HTTP TRACE method for the OneFS web administration interface and Apache web server (187348)
KB Article OneFS 7.0: How to configure the timeout duration for the OneFS web administration interface (91904)
KB Article InsightIQ does not maintain active connection to the cluster if the OneFS Web administration interface authorization timeout is too restrictive (187563)
KB Article How to provide limited access with sudo in OneFS 6.5 and later (89654)
KB Article OneFS 7.0: A node becomes unavailable or reboots with “Error:ib_mad: Method 0 already in use” error (190328)
KB Article InsightIQ datastore must be manually repaired if InsightIQ 3.1 upgrade process is interrupted (193818)

 

Tell us what you want to know! Contact us with questions or feedback about this blog at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

 

[display_rating_result]

New features in EMC Isilon OneFS 7.2

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

EMC® Isilon® OneFS 7.2 has a number of new and updated features, from node compatibility support and Hadoop updates to the new object storage application based on OpenStack™ Swift. Some of these new capabilities, which offer benefits on both the hardware and software-side, are summarized below. For more technical information about all of the new OneFS 7.2 features and enhancements, refer to the OneFS 7.2 Release Notes, OneFS 7.2 CLI Administration Guide, and OneFS 7.2 Web Administration Guide.

Protection Updates

New protection policy for large capacity nodes
To ensure that node pools made up of large capacity nodes can maintain a data protection level that meets EMC Isilon guidelines for meantime to data loss (MTTDL), OneFS offers a new requested protection option, +3d:1n1d.

Suggested Protection (new clusters only)
If you have a new cluster running OneFS 7.2, congratulations! In addition to your new hardware, you can also take advantage of the OneFS suggested protection feature, which calculates a recommended protection level based on the current configuration of your cluster. It continually evaluates your cluster and alerts you if your cluster falls below the suggested protection level. This feature is available for new clusters only. Clusters that have been upgraded to OneFS 7.2 do not have this capability.

Hadoop enhancements

OneFS 7.2 supports HDFS 2.3 and 2.4, and more Hadoop distributions, including Cloudera CDH5, Hortonworks Data Platform 2.1, and Apache Hadoop 2.4. For more information about how Isilon works with these distributions, see the Hadoop InfoHub or the Cloudera for Isilon InfoHub on the Isilon Community.

Protocols updates

HDFS
In OneFS 7.2, users connecting to the EMC Isilon cluster through a WebHDFS interface can be authenticated with Kerberos. For Cloudera users, HDFS supports secure impersonation through proxy users who impersonate other users with Kerberos credentials to perform Hadoop jobs on HDFS data. See the Cloudera for Isilon InfoHub on the Isilon Community for more information.

NFS
OneFS 7.2 includes many NFS service improvements, such audit and multi-tenant capabilities. Refer to the OneFS 7.2 Release Notes for more details.

Node compatibility

Using the SmartPools® software module, you can specify compatibilities between different generations of nodes that meet certain criteria. For example, you can create compatibilities between Isilon S200 and similarly configured Isilon S210 nodes, and between X400 and similarly configured X410 nodes. This means that if you purchase a new single S210 node, for example, OneFS 7.2 enables you to add this node to an existing node pool of S200 nodes. After you add three or more S210 nodes to your cluster, you can delete the compatibility so that OneFS can autoprovision the new S210 nodes into their own node pools.

In OneFS 7.2, you can create compatibilities between S210 node and S200 nodes, and then add unprovisioned nodes into node pools.

In OneFS 7.2, you can specify compatibilities between an S210 node and S200 node, which will enable the unprovisioned newer generation node to be joined to the existing node pool of older generation nodes.

Isilon Swift

OneFS 7.2 introduces Isilon Swift, an object storage application for Isilon clusters based on the object storage API provided by OpenStack Swift. The Swift RESTful API, an HTTP-based protocol, allows Swift clients to execute Swift API commands directly with the Isilon cluster to execute object storage requests. For more information, see the OneFS 7.2 Isilon Swift Tech Note.

Firmware updates

OneFS 7.2 provides automatic firmware updates through drive support packages. Make sure to install the latest drive support packages to take full advantage of this feature. Log in to the EMC Online Support site to find the latest drive support packages.

How to upgrade to OneFS 7.2

If you want to upgrade to this new release, explore your upgrade options by reviewing the Isilon Supportability and Compatibility GuideThen, prepare for the upgrade process by reviewing the following documents:

When you’re ready to upgrade, download the OneFS 7.2 installation file from the Download section of the EMC Online Support site.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]