Google's BigQuery API facilitates the querying of large data sets. Using Google's significant processing power, BigQuery uses SQL-like commands to query and manage data in append-only tables. Use this SDK to interface with the API using Java. See the project page for information on installing the Java client, access to the JavaDoc for BigQuery, and a sample API engine. Google's Java SDK is supported in the following environments: Java 5 or higher, Android 1.5, and Google App Engine.
Amazon has announced the general availability of AWS Lake Formation. Lake Formation is a managed service that eases developers' ability to build, secure, and manage data lakes. Amazon achieves its goal through automation of functions such as collecting, cleaning, cataloging and securing data.
While there’s generally a lot of excitement these days for all things Hadoop the simple fact is that there’s not a whole lot of expertise out there in terms of IT people that know how to build, roll out and then manage an instance of Hadoop. That creates a frustrating conundrum for developers looking to build Big Data applications on top of Hadoop at a time when interest in those applications is staring to reach a frenzy in the enterprise.