Posts Tagged ‘InsightIQ’

InsightIQ 3.2.1: Cool new stuff

Patrick Kreuch

Patrick Kreuch

Sr. Technical Writer at EMC Isilon Storage Division
Patrick Kreuch

Latest posts by Patrick Kreuch (see all)

[Editor’s note: We updated the title from InsightIQ 3.2 to InsightIQ 3.2.1, changed mentions of 3.2 to 3.2.1, and removed the original photo on 8/5/2015. InsightIQ 3.2 is replaced by InsightIQ 3.2.1. All the cool new features mentioned in this blog are available in InsightIQ 3.2.1, including a fix for an upgrade issue. For more information, refer to InsightIQ 3.2.1 release notes. And while we originally featured the “Deal with It” meme photo because it showcased the ultimate symbol of cool (wearing sunglasses indoors), we no longer considered it a good fit for this blog post. Call it a case of revenge of the meme. For questions or concerns about this blog post, please send an email to isi.knowledge@emc.com.]

Being cool isn’t just about expensive clothes and wearing sunglasses indoors. Being cool is about attitude, speed, and efficiency. Slow is never cool. InsightIQ 3.2.1 is easily the coolest release of InsightIQ yet. If you want to know why, keep reading.

New, faster, lighter PostgreSQL database

InsightIQ 3.2.1 has a sweet new PostgreSQL database instead of the old SQLite database. PostgreSQL offers the monitoring experience you’ve been waiting for. With the new PostgreSQL datastore, InsightIQ runs faster and requires less space to store the same amount of information. It’s the best of both worlds, and nothing is better than the best of both worlds, except maybe the best of three or four worlds. But really, how many worlds do you need?

Configurable stat collection

While earlier versions of InsightIQ were obsessed with collecting every single cluster statistic, InsightIQ 3.2.1 is a little more laid back. InsightIQ 3.2.1 enables you to specify which statistics you want to collect, so you have more room on your hard drive for videogames. If you just don’t care about CPU usage, InsightIQ is right there with you.

Datastore export

In previous versions of InsightIQ, if you wanted to transfer cluster data from one InsightIQ instance to another, you had to connect the two instances and keep them connected while the data was migrated. Those were the rules; that’s just the way things were. But InsightIQ 3.2.1 doesn’t play by the rules. It’s a lone wolf that stays up past midnight and drinks milk from the carton. InsightIQ 3.2.1 lets you export your datastore to a .tar file that you can later import to any number of other InsightIQ instances, and it lets you do it on your own time.

SmartPools support

InsightIQ 3.2.1 also enables you to break out performance data by node pools and tiers, which is more useful than cool, but does everything have to be cool? The answer is yes… and no. Because there are no definitive answers in life, only questions. And thinking like that makes you really cool.

Learn more

At this point, you probably can’t wait to start working with InsightIQ’s new database, move some datastores around, and apply a few node-pool breakouts. And the great thing is: you don’t have to! Follow the link below to start right now. The 1,000,000th user to click wins a free skateboard!*

https://community.emc.com/docs/DOC-42096

*I lied. There is no skateboard.

[display_rating_result]

EMC Isilon InsightIQ 3.1.1 enhancements

Patrick Kreuch

Patrick Kreuch

Sr. Technical Writer at EMC Isilon Storage Division
Patrick Kreuch

Latest posts by Patrick Kreuch (see all)

No tool is so perfect that it cannot be improved. There’s no knife that couldn’t be sharper, no couch that couldn’t be comfier, no paperweight that couldn’t be heavier. EMC Isilon InsightIQ is a powerful tool, but it can always be made more powerful. That’s why we recently released InsightIQ  3.1.1: to make InsightIQ run faster and more reliably than ever before.

Enhancements

SPOILER ALERT: The following text describes some of the awesome new enhancements of InsightIQ 3.1.1. DO NOT READ if you just want to be pleasantly surprised when you download it.

Speed

Have you ever hiked up a mountain only to discover that your backpack was full of rocks? If so, you’re a really bad camper (or possibly just a geologist), but either way, you could have made that hike a lot faster without the rocks.

Image by akunamatata on Flickr

Image by akunamatata on Flickr

You may notice while running the new version of InsightIQ that it’s a lot faster than before. We’ve removed the rocks by tweaking InsightIQ to run more efficiently, including making improvements to debugging behavior. We’ve removed a lot of unnecessary debugging effort, which frees InsightIQ resources to work on more important things.

We’ve also improved InisghtIQ’s datastore technology. In previous versions, InsightIQ would let disk-space usage data take up more than its fair share of space in the InsightIQ datastore. InsightIQ 3.1.1 makes sure that free space is divided up equally for all.

Stability

InsightIQ 3.1.1 includes improvements to monitoring stability, especially for large clusters. Earlier instances of InsightIQ would request a lot of data from large clusters all at once, which could cause the clusters to become confused and passive aggressive. InsightIQ 3.1.1 has learned to be more patient and build a healthier relationship between it and the monitored clusters.

We’ve also improved stability by correcting an error in InsightIQ’s timeout behavior. Have you ever noticed InsightIQ’s connection timing out more than usual? This was likely due to InsightIQ interpreting a timeout value of 0 as actually meaning 0 (instead of infinity). We’ve reconfigured InsightIQ to fix this issue and stop taking things so literally.

Finally, we’ve made some adjustments to reduce “data retrieval delayed” errors. When previous versions of InsightIQ would lose a connection to the cluster, InsightIQ would sometimes report a data retrieval delayed error indefinitely, rather than report that the connection had been severed. This led to some difficulty diagnosing the issue.

Learn more

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, or comments about the video specifically, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

EMC Isilon InsightIQ 3.1 is now available!

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

The latest release of EMC® Isilon® InsightIQ includes new and enhanced reports that help you become a rock star at managing space on your cluster.

New file system reports

The following new reports are available to help you manage cluster capacity, deduplication, and quotas in OneFS. For useful tips about these reports, refer to the InsightIQ 3.1 User Guide.

Usable capacity reporting
Do you often wonder how much free space is on your cluster when accounting for the space that is being used to protect your data? The usable capacity report is an excellent resource that helps you prevent your cluster from reaching capacity. The report anticipates how much protection overhead you might need in addition to capacity that is already reserved for snapshots and virtual hot spares. Essentially, the report breaks down an estimate of how much capacity can be used for storing data and how much capacity can be reserved for protecting your data. Keep in mind that this report only provides estimates.

Usable capacity report in InsightIQ 3.1

Deduplication reporting

Running a deduplication job in OneFS by using SmartDedupe® software module creates free space on your cluster. In OneFS, you can assess the amount of disk space you’ll save before you start a deduplication job. You can also do this in InsightIQ 3.1. However, InsightIQ also lets you view historical and current information about how much space is saved by deduplication over a specific range of time.

Two sections from the deduplication report in InsightIQ 3.1. Historical deduplication job information is not cumulative.

Two sections from the deduplication report in InsightIQ 3.1. Deduplication job information is not cumulative.

Quota reporting
The quota report enables you to simplify quota management in OneFS. This report displays information about quotas created through the SmartQuotas® software module. You can view quotas that are assigned to specific directories, the limits defined by those quotas, and the amount of data stored in the directories that those quotas are applied to. This information can help you compare the data usage of a directory to the quota limits over time, and predict when a directory is likely to reach its quota limit.

A section from the quota report in InsightIQ 3.1. Historical data is generated by quota reports in OneFS.

Two sections from the quota report in InsightIQ 3.1. Click on a directory to view quota limit usage over time. Historical data is generated by quota reports in OneFS.

Enhanced reporting

InsightIQ 3.1 includes enhancements to cache reporting and exporting capabilities on file system analytics reports. For example, you can now view information about L3 cache usage in performance reports and download the data from file system analytic reports to CSV files.

Upgrading or installing InsightIQ 3.1

If you want to install this release, review the InsightIQ 3.1 Installation Guide for requirements and procedures. If you want to upgrade to this release, first explore your upgrade options covered in the Isilon Supportability and Compatibility Guide, and then perform the procedure provided in the InsightIQ 3.1 Installation Guide.

For more information about all the features, fixes, and changes in functionality in this release, refer to the InsightIQ 3.1 Release Notes. For information about using InsightIQ to monitor your cluster, refer to the InsightIQ 3.1 User Guide.

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

How EMC Isilon InsightIQ helps keep your cluster running smoothly

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

We highlighted a crucial cluster maintenance task in a recent blog post: monitoring cluster performance and storage capacity. Now, we’d like to take a closer look at InsightIQ™—a remarkably useful tool for monitoring your EMC® Isilon® cluster. As a licensed software module for the OneFS® operating system, InsightIQ makes it possible for you to monitor one or more clusters.

InsightIQ provides charts, graphs, and customized reports to help you understand how your cluster is performing. To learn how InsightIQ 3.0 works, watch the EMC Isilon InsightIQ Overview video, where Corporate Systems Engineer Jason Sturgeon describes the architecture of InsightIQ and shows you how to use InsightIQ reports.

How reports can help with monitoring

InsightIQ enables you to create customized reports to display data about clusters over specific periods of time. There are two general types of reports: performance reports and file system reports.

Performance reports

By monitoring cluster performance and data usage, you can help to ensure that your cluster runs smoothly. In the InsightIQ overview video, learn how to create a performance report to check cluster activity and a file system report to visualize data usage over time.

For example, if your cluster is running slowly, you can run a performance report and review the external network throughput rate. In the following figure, the performance report shows that one node is handling more network traffic than other nodes. With this information, you can redirect network traffic to other nodes and improve cluster performance.

A performance report that shows which node is handling the majority of network traffic.

A performance report in InsightIQ 3.0 that shows which node is handling the majority of network traffic.

 

 

 

 

 

 

 

 

 

File system report

InsightIQ reports can also help you to monitor cluster data usage by generating a file system report. The video describes a use case where you can explore data growth in a directory over time. For example, after running a file system report you might notice that a directory is storing a large amount of data (see the following figure). If this data hasn’t been accessed for a long time, you can approach the directory owner to determine whether this data can be deleted to increase storage capacity.

A file system report that shows a directory storing a large amount of data.

A file system report in InsightIQ 3.0 that shows a directory storing a large amount of data.

 

 

 

 

 

 

 

For more information about reporting capabilities in InsightIQ, refer to the InsightIQ documentation on the EMC Online Support site (login required).

Start a conversation about Isilon content

Have a question or feedback about Isilon content? Visit the online EMC Isilon Community to start a discussion. If you have questions or feedback about this blog, contact us at isi.knowledge@emc.com. To provide documentation feedback or request new content, contact isicontent@emc.com.

[display_rating_result]

Top 20 EMC Isilon support documents in April 2014

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

One of the goals of this blog is to share the most useful EMC® Isilon® support-related content that we have to offer. In this post, we’re highlighting 20 of the most viewed knowledgebase (KB) articles and product documents from the month of April.

We hope these documents will help you to quickly find an answer to a common question or resolve an issue.

Top 10 KB articles

To access these KB articles, log in to the EMC Online Support site. Articles in bold are new to the top 10 list this month.

  1. OpenSSL Heartbeat Vulnerability (Heartbleed) in EMC products (185965)
  2. How to upgrade firmware on Intel (QLogic) 12300 and 12800 InfiniBand switches (170524)
  3. OneFS 7.1 SMB and Authentication Rollup Patch (174372)
  4. OneFS 7.0.2 SMB Rollup Patch (172623)
  5. Impact of OpenSSL “heartbleed” vulnerability in InsightIQ virtual machines (186055)
  6. Impact of CVE-2014-0160 OpenSSL “heartbleed” vulnerability on Isilon clusters (185961)
  7. Best practices for NFS client settings (90041)
  8. Patches available for EMC Isilon OneFS (88358)
  9. Troubleshooting performance issues (88844)
  10. How to create SPN accounts to allow Kerberos authentication using SmartConnect DNS entries (16528)

 

Top 10 product documents

To access these PDF documents, log in to the EMC Online Support site. Documents in bold are new to the top 10 list this month.

  1. OneFS 7.1 CLI Administration Guide
  2. Current Isilon Software Releases
  3. Isilon Supportability and Compatibility Guide
  4. OneFS 7.1 Web Administration Guide
  5. OneFS 7.1.0 MR Release Notes
  6. OneFS 7.0.1 Administration Guide
  7. OneFS 7.0.2 Administration Guide
  8. Current Patches for Isilon OneFS 7.0
  9. OneFS 7.0.2 Command Reference
  10. Current Patches for Isilon OneFS 7.1

 

If you have questions or feedback about this blog, send an email to isi.knowledge@emc.com. To provide documentation feedback or request new content, send an email to isicontent@emc.com.

[display_rating_result]

The impact of the OpenSSL Heartbleed vulnerability on EMC Isilon products

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

The Heartbleed vulnerability (CVE-2014-0160) affects the popular OpenSSL cryptographic software library used to secure internet communication. We have done a review of EMC® Isilon® OneFS, Isilon InsightIQ™, Isilon SRA 2.0, and Isilon for vCenter to assess any potential impact of this vulnerability and published knowledgebase (KB) articles on our customer support website.

See the following KB articles for details about these products.

Product name

Related KB articles

All EMC products OpenSSL Heartbeat Vulnerability (Heartbleed) in EMC products, 185965
Isilon OneFS Impact of CVE-2014-0160 OpenSSL “heartbleed” vulnerability on Isilon clusters, 185961
Isilon InsightIQ Impact of OpenSSL “heartbleed” vulnerability in InsightIQ virtual machines, 186055
Isilon for vCenter Impact of OpenSSL “heartbleed” vulnerability in Isilon for vCenter, 186112
Isilon SRA 2.0 Impact of OpenSSL “heatbleed” vulnerability in Isilon SRA for VMware SRM 2.0, 186113

Have questions or concerns?

Contact your account representative or EMC Technical Support. To learn more about the about the Heartbleed bug, see OpenSSL Security Advisory [07 Apr 2014] and visit Codenomicon’s Heartbleed FAQ website: http://heartbleed.com/.

How to keep your EMC Isilon cluster from reaching capacity

Kirsten Gantenbein

Kirsten Gantenbein

Principal Content Strategist at EMC Isilon Storage Division
Kirsten Gantenbein
Kirsten Gantenbein

It’s important to maintain enough free space on your EMC® Isilon® cluster to ensure that data is protected and workflows are not disrupted. At a minimum, you should have at least one node’s worth of free space available in case you need to protect data on a failing drive.

When your Isilon cluster fills up to more than 90% capacity, cluster performance is affected. Several issues can occur when your cluster fills up to 98% capacity, such as substantially slower performance, failed file operations, the inability to write or delete data, and the potential for data loss. It might take several days to resolve these issues. If you have a full cluster, nearly full cluster, or need assistance with maintaining enough free space, contact EMC Isilon Technical Support.

Fortunately, there are several best practices you can follow to help prevent your Isilon cluster from becoming too full. These are detailed in the “Best Practices Guide for Maintaining Enough Free Space on Isilon Clusters and Pools” (requires login to the EMC Online Support site). Some of these best practices are summarized in this blog post.

Monitoring cluster capacity

To prevent your cluster from becoming too full, monitor your cluster capacity. There are several ways to do this. For example, you can configure email event notification rules in the EMC Isilon OneFS® operating system to notify you when your cluster is reaching capacity. Watch the video “How to Set Up Email Notifications in OneFS When a Cluster Reaches Capacity” for a demonstration of this procedure.

Another way to monitor cluster capacity is to use EMC Isilon InsightIQ™ software. If you have InsightIQ licensed on your cluster, you can run FSAnalyze jobs in OneFS to create data for InsightIQ’s file system analytics tools. You can then use InsightIQ’s Dashboard and Performance Reporting to monitor cluster capacity. For example, Performance Reports enable you to view information about the activity of the nodes, networks, clients, disks, and more. The Storage Capacity section of a performance report displays the used and total storage capacity for the monitored cluster over time (Figure 1).

Figure 1: The Storage Capacity section of a Performance Report in InsightIQ 3.0.

Figure 1: The Storage Capacity section of a Performance Report in InsightIQ 3.0.

For more information about InsightIQ Performance Reports, see the InsightIQ User Guides, which can be found on the EMC Online Support site.

To learn about additional ways to monitor cluster capacity, such as using SmartQuotas, read “Best Practices Guide for Maintaining Enough Free Space on Isilon Clusters and Pools.”

More best practices

Follow these additional tips to maintain enough free space on your cluster:

  • Manage your data
    Regularly delete data that is rarely accessed or used.
  • Manage Snapshots
    Snapshots, which are used for data protection in OneFS, can take up space if they are no longer needed. Read the best practices guide for several best practices about managing snapshots, or read the blog post “EMC Isilon SnapshotIQ: An overview and best practices.”
  • Make sure all nodes in a node pool or disk pool are compatible
    If you have a node pool that contains a mix of different node capacities, you can receive “cluster full” errors even if only the smallest node in your node pool reaches capacity. To avoid this scenario, ensure that nodes in each node pool or disk pool are of compatible types. Read the best practices guide for information about node compatibility and for a procedure to verify that all nodes in each node pool are compatible.
  • Enable Virtual Hot Spare
    Virtual Hot Spare (VHS) keeps space in reserve in case you need to move data off of a failing drive (smartfail). VHS is enabled by default. For more information about VHS, read the knowledgebase article, “OneFS: How to enable and configure Virtual Hot Spare (VHS) (88964)” (requires login to the EMC Online Support site).
  • Enable Spillover
    Spillover allows data that is being sent to a full pool to be diverted to an alternate pool. If you have licensed EMC Isilon SmartPools™ software, you can designate a spillover location. For more information about SmartPools, read the OneFS Web Administration Guide.
  • Add nodes
    If you want to scale-out your storage to add more free space, contact your sales representative.

If you have questions or feedback about this blog or video described in it, send an email to isi.knowledge@emc.com. To provide documentation feedback or request new content, send an email to isicontent@emc.com.