Most system integrator organizations and product company IT departments now have a big data practice or at least a competency where they are busy ramping up engineers and data scientists who would be geared to respond to the next generation of data analytics challenges. Most buzz words like Hadoop, Flume, Scoop, Open Source are in the air but when it comes to applying these wonderful big data technologies to an application scenario most of these highly intelligent people draw a blank. Most do not have a clue of how to make a new relevant big data business use case for the industries they serve.
The intersection of big data technology and statistical principles are things which can be learnt directly. Business domain knowledge can typically be acquired by having worked or consulted in the industry. But are these three enough to convince a business leader to take the plunge into investing a huge amount of money, people and time into Big data? Not quite.
In many instances system integrators and IT departments resort to selling big data as a fantastic technical breakthrough as opposed to showcasing how it can solve business problems better and help an organization realize its long term vision. As a result of their insular nature system integrators and IT departments they are sometimes unable to relate to the challenges posed by the market dynamics on their customers. As a result of the above flawed approach many big data competencies are unable to gain a lot of mind share with the business leaders of their customer's organizations and face a lot of difficulty in selling any real big data transformations always tending to remain in technology proof of concept mode.
Business leaders are only interested in learning how their big data investment would relate back to real needs of the businesses they run .They want to know, in what way would big data help in reducing operational cost, gather market intelligence, provide for predictive analysis, make their customers come back for repeat business all related to the specific business organizations they lead. Also they would almost always challenge the need to migrate to big data technologies and methodologies if the needs of the business can be fulfilled with their current analytics investments.