Posts Tagged ‘7.2’

Manage your data with the new EMC Isilon SDK

Gwen Zierdt

Gwen Zierdt

Principal Technical Content Developer at EMC
Award-winning technical writer for the IT Pro and web service developer.
Gwen Zierdt

Latest posts by Gwen Zierdt (see all)

The Isilon SDK is now available! The Isilon SDK includes documentation and code samples to help you to develop a customized interface to your Isilon OneFS cluster. The OneFS API is a REST-based HTTP interface that allows automation, orchestration, and provisioning of an Isilon cluster. Using the OneFS API, third-party applications can leverage the capabilities of the OneFS operating system to simplify management, data protection, and provisioning.

Code samples are available through the Isilon community on EMC {code} and from the Isilon GitHub repository. Immediately available for download is the Python Language Bindings for the OneFS API and the Statistics Browser tool.  The Isilon SDK Info Hub connects you to a central source of information and provides additional links to resources and documentation.

To use the Isilon SDK, you need either a physical Isilon cluster, or a OneFS simulator. See the video Technical Demo: EMC Isilon OneFS Simulator on the EMC YouTube channel to learn how to install the OneFS Simulator.

The Isilon SDK is Open Source and available free under the MIT license.

Sign up on the Slack EMC {Code} CodeCommunity and join the #isilon channel. Be part of the conversation about the Isilon SDK and receive news of future updates.

Let us know!

Let us know what you think. If you have feedback for us about this or any other Isilon technical content, email us at mailto:isicontent@emc.com. And thank you!

Decode the EMC Isilon HD400 Node

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

If you’re looking to archive several petabytes of data, you might want to consider the new EMC Isilon HD400 node. It’s the biggest of the current Isilon nodes in terms of size—you can store up to 354 TB of data on 59 hard drives using a 4U rack space.

To learn more about the external and internal components of the HD400 node, watch the video, Decode the Node: EMC Isilon HD400.

HD400 and OneFS 7.2

The HD400 node was released with the Isilon OneFS operating system 7.2. The OneFS 7.2 release provides support for the following items required for the HD400:

  • New protection levels: New requested protection levels are available in OneFS 7.2 to account for the increased capacity of HD400 nodes. For example, the default protection level for node pools on the HD400 node is “3d:1n1d,” which means that data is protected in case 3 drives fail or if 1 node and 1 drive fail.
  • L3 cache: The HD400 node includes 800 GB of solid-state drive (SSD) storage, which is primarily used for L3 cache. This helps to reduce cache cycling times to improve system performance. For more information, see the L3 Cache Overview topic in the OneFS 7.2 Web Administration Guide or OneFS 7.2 CLI Administration Guide.
  • New drive layout: Disks in the HD400 are arranged in a grid orientation because the drives are inserted top-down into the node chassis. To view the new grid orientation in the OneFS 7.2 web administration interface, go to Dashboard > Cluster Status and click on the ID number. This will take you to the Node Status view, where you can scroll down to view the grid orientation.

    HD400 grid in the OneFS 7.2 web administration  interface.

    HD400 grid in the OneFS 7.2 web administration interface.

 

 

 

 

 

 

 

 

If you have questions about the HD400 node, join the Ask the Expert session on HD400 and OneFS 7.2 that continues through March 8, 2015 in the Isilon Community. Look through the discussion thread for useful information. Or post a question, and you’ll get answers from Isilon hardware and software experts, partners, and customers.

HD400 documentation

If you’re looking for an HD400 specification sheet, a hardware installation guide, or a HD400 field replacement unit (FRU) video, visit the HD400 Info Hub in the Isilon Community. This information hub is a curation destination for links to the latest and most relevant documentation for installing, maintaining, and servicing HD400 nodes.

The HD400 Info Hub on the Isilon Community

The HD400 Info Hub on the Isilon Community.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, or comments about the video specifically, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

New EMC Isilon videos for a new year!

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

Happy New Year! I hope you had a wonderful holiday season!

December was a busy month. I recently shared a survey about which EMC® Isilon® OneFS® topics you would like to learn more about. I’ll announce the survey results and the new Hacker How-To series topic next week.

We also published two videos in December that you can view now.

Technical Demo: EMC Isilon OneFS Simulator

You can now spin up your own virtual OneFS 7.2 cluster. This technical demo video shows you how to download and extract the OneFS Simulator file from the EMC Isilon OneFS Operating System Simulator Download website. It then provides steps for setting up a VMware® player, gathering configuration details, and creating a three-node virtual cluster.

Technical Demo: EMC Isilon SnapshotIQ

This demo video walks you through common configuration tasks using the OneFS web administration and command-line interfaces, such as creating, viewing, reverting, and deleting snapshots.

Stayed tuned to our Isilon Support playlist and the EMC Isilon online community for upcoming videos.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

Object storage in EMC Isilon Swift

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

Next-generation applications for cloud, analytics, social media and mobile devices  rely on object storage to store and access data. Object storage is an efficient way to store large amounts data: it flattens data hierarchy and enables automated API access between storage and applications. You can integrate object storage into your EMC® Isilon® cluster by using the open source OpenStack™ Swift API. OneFS® 7.2 exposes the OpenStack Object Storage API as a set of Representational State Transfer (REST) web services over HTTP. This way, you can direct applications that use the Swift API to store content and metadata as objects on your Isilon cluster.

What are the specific benefits of using Isilon Swift? First, the containers and objects that you save on an Isilon cluster can also be simultaneously accessed as directories and files by using other supported protocols such as NFS, SMB, HTTP, FTP, and HDFS. This interoperability between protocols can eliminate islands of storage and simplify management. Second, you can take advantage of Isilon authentication to secure the content saved through the Swift API.

How Isilon Swift works

The Swift API requests that you submit can store and manage containers, objects, and metadata in the OneFS file system. An instance of the Swift protocol driver runs on each node in the cluster and handles API requests.

The Swift API presents the home directories as accounts, directories as containers, and files as objects. Each home directory in the OneFS file system maps to a Swift account. The directories and subdirectories in a home directory map to containers and subcontainers. Files appear as objects. All objects have metadata.

How OneFS interoperates between object and file. See the OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS white paper for more information.

How OneFS interoperates between object and file. See the OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS white paper for more information.

Authentication in OneFS

When a Swift client connects to an Isilon cluster, the connection must be authenticated. Authentication takes places in an OneFS access zone. Access zones are virtual contexts that you can set up to control access to an Isilon cluster through an incoming IP address. When a Swift user submits an authentication request to the cluster, OneFS creates an access token for the user. This token contains the user’s full identity and security credentials for the access zone that the user is assigned to. For more information about how authentication works in OneFS, see the following white papers: OneFS Multiprotocol Security Untangled and OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS.

Client libraries and HTTP requests

Isilon Swift supports two client libraries: the Python-Swift client library and Apache Libcloud. The following HTTP requests are supported by Isilon Swift to work with these libraries: GET, PUT, DELETE, POST, HEAD, and COPY requests. Isilon Swift does not support certain object store features, such as using the HTTPS protocol and accessing conditional GET and PUT calls based on ETag matching. For more information, see the Isilon Swift Tech Note (login to the EMC Online Support site is required).

For more information

If you want to learn more about Isilon Swift, read OpenStack Swift Object Storage on EMC Isilon Scale-Out NAS. If you have OneFS 7.2 and need commands and procedures for using Isilon Swift, refer to the Isilon Swift Tech Note on the EMC Online Support site.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

New features in EMC Isilon OneFS 7.2

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

EMC® Isilon® OneFS 7.2 has a number of new and updated features, from node compatibility support and Hadoop updates to the new object storage application based on OpenStack™ Swift. Some of these new capabilities, which offer benefits on both the hardware and software-side, are summarized below. For more technical information about all of the new OneFS 7.2 features and enhancements, refer to the OneFS 7.2 Release Notes, OneFS 7.2 CLI Administration Guide, and OneFS 7.2 Web Administration Guide.

Protection Updates

New protection policy for large capacity nodes
To ensure that node pools made up of large capacity nodes can maintain a data protection level that meets EMC Isilon guidelines for meantime to data loss (MTTDL), OneFS offers a new requested protection option, +3d:1n1d.

Suggested Protection (new clusters only)
If you have a new cluster running OneFS 7.2, congratulations! In addition to your new hardware, you can also take advantage of the OneFS suggested protection feature, which calculates a recommended protection level based on the current configuration of your cluster. It continually evaluates your cluster and alerts you if your cluster falls below the suggested protection level. This feature is available for new clusters only. Clusters that have been upgraded to OneFS 7.2 do not have this capability.

Hadoop enhancements

OneFS 7.2 supports HDFS 2.3 and 2.4, and more Hadoop distributions, including Cloudera CDH5, Hortonworks Data Platform 2.1, and Apache Hadoop 2.4. For more information about how Isilon works with these distributions, see the Hadoop InfoHub or the Cloudera for Isilon InfoHub on the Isilon Community.

Protocols updates

HDFS
In OneFS 7.2, users connecting to the EMC Isilon cluster through a WebHDFS interface can be authenticated with Kerberos. For Cloudera users, HDFS supports secure impersonation through proxy users who impersonate other users with Kerberos credentials to perform Hadoop jobs on HDFS data. See the Cloudera for Isilon InfoHub on the Isilon Community for more information.

NFS
OneFS 7.2 includes many NFS service improvements, such audit and multi-tenant capabilities. Refer to the OneFS 7.2 Release Notes for more details.

Node compatibility

Using the SmartPools® software module, you can specify compatibilities between different generations of nodes that meet certain criteria. For example, you can create compatibilities between Isilon S200 and similarly configured Isilon S210 nodes, and between X400 and similarly configured X410 nodes. This means that if you purchase a new single S210 node, for example, OneFS 7.2 enables you to add this node to an existing node pool of S200 nodes. After you add three or more S210 nodes to your cluster, you can delete the compatibility so that OneFS can autoprovision the new S210 nodes into their own node pools.

In OneFS 7.2, you can create compatibilities between S210 node and S200 nodes, and then add unprovisioned nodes into node pools.

In OneFS 7.2, you can specify compatibilities between an S210 node and S200 node, which will enable the unprovisioned newer generation node to be joined to the existing node pool of older generation nodes.

Isilon Swift

OneFS 7.2 introduces Isilon Swift, an object storage application for Isilon clusters based on the object storage API provided by OpenStack Swift. The Swift RESTful API, an HTTP-based protocol, allows Swift clients to execute Swift API commands directly with the Isilon cluster to execute object storage requests. For more information, see the OneFS 7.2 Isilon Swift Tech Note.

Firmware updates

OneFS 7.2 provides automatic firmware updates through drive support packages. Make sure to install the latest drive support packages to take full advantage of this feature. Log in to the EMC Online Support site to find the latest drive support packages.

How to upgrade to OneFS 7.2

If you want to upgrade to this new release, explore your upgrade options by reviewing the Isilon Supportability and Compatibility GuideThen, prepare for the upgrade process by reviewing the following documents:

When you’re ready to upgrade, download the OneFS 7.2 installation file from the Download section of the EMC Online Support site.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]