Hadoop bulks up for enterprise

If you need clusters to process big data then Hadoop is the leading platform for consideration.

And why not? The open source framework for processing large datasets is available for free to try and through a number of distributions with paid support and added features. You have a choice of versions from Intel, Cloudera, Hortonworks and Pivotal among others.

As an analysis on of the recent Hadoop Summit points out, even Microsoft is jumping on the bandwagon. The software giant, along with SAP and others, have contributed to the Stinger Initiative to bring full SQL interactive query capabilities to hadoop via a new and improved Hive.

The other thing author John Furrier notes is that distributions are increasingly offering improved Hadoop security as an attempt to differentiate themselves from one another. For example, last week Cloudera announced it had bought Gazzang for end to end data encryption and key management. In May Hortonworks bought XA Secure, which provides centralized capabilities around data security, authorization, auditing and overall governance.

This is a good thing, because as recently as last October a KPMG Canada security analyst criticized Apache Hadoop security as being not up to enterprise standards. Apache Hadoop, of course, is the framework that most distributions build their platforms on which include capabilities like end to end security.

Version 2.4 of Apache Hadoop was released in April, which includes support in the HDFS file system for Access Control Lists, full HTTPS support, native support for Rolling Upgrades, support for automatic failover of the YARN resource manager  and other capabilities.  These are being added to the independent distributions.

As Hadoop distributions mature, it becomes increasingly difficult for enterprises not to consider at least testing one of the versions. Soon it may be as ubiquitous as Windows.



Howard Solomon
Howard Solomon
Currently a freelance writer, I'm the former editor of and Computing Canada. An IT journalist since 1997, I've written for several of ITWC's sister publications including and Computer Dealer News. Before that I was a staff reporter at the Calgary Herald and the Brampton (Ont.) Daily Times. I can be reached at hsolomon [@]

Would you recommend this article?


Thanks for taking the time to let us know what you think of this article!
We'd love to hear your opinion about this or any other story you read in our publication.

Jim Love, Chief Content Officer, IT World Canada

Featured Download

ITW in your inbox

Our experienced team of journalists and bloggers bring you engaging in-depth interviews, videos and content targeted to IT professionals and line-of-business executives.

More Best of The Web