Survey Shows Hadoop is Rocketing Ahead in Enterprises

According to a new best practices survey from TDWI there is a big increase in how many enterprises plan to have Hadoop clusters in production. By Q1 of next year, 60% of survey respondents said they will be in production, up from 16% when the report was published earlier in 2015.

In addition, only 6% of organizations have ruled out Hadoop, down from 27% in 2012, which points to a future for Hadoop as a common enterprise tool.

Along with its summary of the Hadoop for the Enterprise report, TDWI provides a list of 10 priorities and recommendations that can help organizations new to Hadoop get the most benefit from it.

According to the report:

"Hadoop for the enterprise is driven by several rising needs. On a technology level, many organizations need data platforms to scale up to handle exploding data volumes. They also need a scalable extension for existing IT systems in warehousing, archiving, and content management. Others need to finally get BI value out of non-structured data. Hadoop fits the bill for all these needs.

On a business level, everyone wants to get business value and other organizational advantages out of big data instead of merely managing it as a cost center. Analytics has arisen as the primary path to business value from big data, and that’s why the two come together in the term “big data analytics.” Hadoop is not just a storage platform for big data; it’s also a computational platform for business analytics. This makes Hadoop ideal for firms that wish to compete on analytics, as well as retain customers, grow accounts, and improve operational excellence via analytics.

For these and other reasons, Hadoop adoption is accelerating. TDWI survey results show that Hadoop clusters in production are up 60% in two years. Almost half of respondents have new Hadoop clusters in development, and these will come online within 12 months. At this rate, 60% of users surveyed will have Hadoop in production by 2016, a giant step forward.

Adoption is accelerating because most users (89%) consider Hadoop an opportunity for innovation According to this report’s survey, Hadoop’s leading benefits include improvements to analytics, data warehousing, data scalability, and the handling of exotic data types, in that order."

Also according to the report, leading barriers to Hadoop implementation are inadequate technical skills, weak business support, security issues, and weak open source tools. All these barriers (and others) are being corrected by user best practices and advancements from both open source and vendor communities, the report's authors note.

You can download the full report here.