It used to be that integrating data across different applications required an unnatural act involving complicated pieces of middleware. In recent times, accomplishing that act has become easier thanks to lighter-weight middleware based on standard Web services and RESTful APIs. But even still, accomplishing that task still requires the skills of a developer. In contrast, the next revolution in data integration is going to be characterized by business users integrating data across applications on their own at will.
While there’s generally a lot of excitement these days for all things Hadoop the simple fact is that there’s not a whole lot of expertise out there in terms of IT people that know how to build, roll out and then manage an instance of Hadoop. That creates a frustrating conundrum for developers looking to build Big Data applications on top of Hadoop at a time when interest in those applications is staring to reach a frenzy in the enterprise.