Search This Blog

Friday, July 23, 2010

big data innovators – betting against the open source community

As you will realize (preconditioned on becoming regular followers of this post) I like BOLD…to be bold automatically sets expectations for fiery exchanges, passionate interactions and cocksure personalities…perfect recipe for a fantastic afternoon

I met one such BOLD company yesterday who proclaimed that the open source community will not invest in improving Hadoop fundamentals with added features critical for large scale enterprise deployment…as it is not of interest to the community

I have to give them credit that they made this BOLD statement based on some assumptions that seem to be ‘well researched’:

1. Hadoop MR/HDFS today has some gaps (around fault tolerance, resiliency, HW optimization, other…for details please contact
MapR)

2. Based on what was said at the yahoo
hadoop summit (very smart guys at yahoo doing this, but they do not care less if Hadoop did not go much beyond their offices…can’t accuse them of not being focused) said at the Hadoop Summit last month, yahoo (still by far the biggest committer to the open source Hadoop project), is not interested in plugging those gaps

3. The Community will only work on things that excite them, not problems that need fixing for Hadoop to build a Linux like cult with enterprises

4. Large companies will experience challenges in implementing Hadoop unless features that are ‘must haves’ for any enterprise deployment are built

and as you may have guessed by now, MapR is building those very features.

having tried to build from scratch one of the largest Hadoop clusters in the world, this pitch surely caught my attention. not to mention the company’s CEO and CTO have a history of building successful startups..and have hired some smart guys (tomar is a star)…

the company is still very new (1 year anniv this month) and plans to have a beta out end of the year..with a GA in Q1…and claim to have a bevy of ‘customers’ (i don’t get it…in my book a customer is one who pays and uses your product…everyone else is a prospect)

so while I am not quite ready to drink their koolaid…I am not willing to bet against them either…

as a wise man once told me…the line between BOLD and stupid is a thin one!

ps – shout-out to my friend
arif j at lightspeed for introducing me to these guys

No comments:

Post a Comment