Hadoop: A Groundbreaking Technology on its 10th Year of Success

Hadoop, the most promising and equally successful open source framework for unstructured analytics and data has completed 10 glorious years this January. There have been several milestones, major players, and some interesting events to mark the growth of this technology. The technology has encouraged a large number of professionals to opt for Hadoop Administration Training.  

Let’s see the major milestones in the path of technology’s growth.

Cloudera – The Key Players

Cloudera is one company that provided the primary commercial distributions to the open source framework, Hadoop.

Established in 2008 by 3 engineers from Google, Facebook, and Yahoo, along with other Oracle executives, the company released its first ever Hadoop distribution only in 2009. Doug Cutting, one of the many creators of Hadoop, serves as the chief architect at Palo Alto, a California-based company.

Cloudera’s funding came from several Silicon Valley regulars, but a lion’s share of stake was taken by the chip giant, Intel, in March 2014.

MapR – The Giant Distributor

MapR is the one of the three big Hadoop distribution companies, based in San Jose, California. It was founded by John Schroeder, CEO, and M. C. Srivas, CTO, in 2009. The company has already received USD170 million in funding till date from investors like Google Capital. Schroeder said in many interviews that this company is now considering a public offering in the future. Recently, MapR has hired Oracle veteran Matt Mills as the president and COO. Technology partners are EMC, Talend, and Google. The company’s Hadoop distribution was made available through the AWS marketplace in 2015.

Hortonworks – Distributors

 Hortonworks has been another supportive Hadoop distributor. After it was established as an independent company in 2011, post Yahoo spun out, it went on to become a big distributor in the market. Benchmark Capital and Yahoo seeded this company with USD23 million in total ventures funding during spinoff. Later, Eric Baldeschweiler, ex YP of Hadoop development at Yahoo, went on to serve as the founding CEO of the company, though he made a quick exit in 2013.

This Santa Clara, California-based company has already forged partnerships over several years with Microsoft on the Azure cloud platform and SAP.

Hortonworks, in December 2014, raised USD100 million in its initial public offering.

Other Distributors involved with Hadoop

According to the Forrester Wave report, there are two other major Hadoop distributors – EMC Pivotal HD and Biglnsights. Both these companies serve many other large companies in the market beyond the big data. It was identified in the Forrester report that IBM and the other big three companies are strong performers.

Apache Hadoop Version 1.0

While all other distributors released their own distributions of Hadoop, Apache Software Foundation took some time to come up with its release of version 1.0 of this technology. It was released only in January 2012. It was announced in a blog spot that the latest release of this project marks a major milestone 6 years in making, and it has achieved a certain level of enterprise-readiness and stability to earn 1.0 designation.

Hadoop World Conference

In 2012, the first Strata and Hadoop World Conference took place with a series of events worldwide. People interested in data science could learn all about the latest developments, case studies, products launches and other presentations by the user organization. The conference began with three distinct events in Silicon Valley, New York, and annual events took place in Europe. It has further expanded to Singapore in 2015 and included Beijing in 2016.

Spark – The Work of a Catalyst

While Hadoop became a popular tool and there was a lot of excitement initially, it wasn’t very easy to use. As such, many people required Hadoop Administration training.

In came Spark – a technology that was designed solely to enhance the overall Hadoop stack. It allowed developers to write applications in Python, R, Scala, or Java. It could also run programs up to 100 times faster than the Hadoop MapReduce in memory and 10 times faster on the disk. It is considered one of the most active open source projects in big data, with over 600 contributors in the past 12 months.