Marrying Internet of Things with big data analytics

By
Saurabh Saxena

In the coming years, enormous volumes of machine-generated data from the Internet of Things (IoT) will emerge. If exploited properly, this data - often dubbed machine or sensor data, and often seen as the next evolution in Big Data - can fuel a wide range of data-driven business process improvements across numerous industries.



There is no doubt that IoT is a huge opportunity, and organizations that put IoT to work can increase revenues, cut costs, and improve efficiencies and customer satisfaction. But it's not enough to just collect massive amounts of data. To capitalize on IoT and implement data-driven business models, organizations need a platform that helps them generate connected intelligence by collecting, managing and analyzing huge volumes of sensor data in a cost-effective and scalable manner.
The first step in this process, data collection and integration, remains a challenge because there is currently a lack of common (vendor and platform-agnostic) connectivity standards in the industry. In fact, we view this as a factor inhibiting wider IoT adoption.

For these reasons, it is critically important to utilize a big data platform that can consume or read many diverse data sources, streamlining and accelerating data integration. This will enable the delivery of connected intelligence from big data for both the business and its IT operations. In addition, IoT data must be able to be loaded and queried simultaneously to avoid missing out on real-time, immediately actionable insights. By the time the data is loaded into a database and analyzed, an organization may have missed a critical chance to respond or act upon a small window of opportunity with a connected product.

The cloud represents a bright spot and opportunity for IoT initiatives in terms of ease of adoption and the journey for businesses to transform technology into a service broker model in today's hybrid IT environments. Cloud-based analytic capabilities bring IoT to the masses for all businesses, enabling them to get up and running more quickly, easily and cost-effectively. The cloud as a deployment model makes years of intellectual property immediately available to anyone that seeks to incorporate IoT into their big data strategy.

Beyond these advantages, today's cloud-based analytics platforms offer critical capabilities for structured IoT data, including columnar storage (means the analytic engine reads and retrieves only the needed columns, yielding faster results against larger data sets); aggressive data compression (which supports very fast parallel load and query times); scalable, multimode infrastructure (which eliminates single points of failure) and integration with the market's leading open source software for statistical computing. As a final note, the cloud enables companies to tie all its data resources together - structured and unstructured - to generate connected intelligence from all types of data, including Internet of Things data in greater context.