“Anything that can be connected, will be connected.” — The first law of IoT
You might have come across this popular adage. The Internet of Things (IoT) has revolutionized the way in which we collect and process the information by optimizing our businesses and reducing the costs. The analyst firm Gartner says that by 2020 there will be over 26 billion connected devices. These devices are capable of collecting data from sensors and stream it to the cloud to store. These sensor-based data sets could range from anywhere related to energy, healthcare, weather, transportation to jet engines and various other sectors. In this article, we are showing how you can pull your data from one of such cloud storage services onto the Data Intelligence Hub for analytical purposes.
We specifically demonstrate how to pull your data from the Azure Blob storage. The following items are addressed using bike sharing sensor data as an example:
- We show a dummy blob storage structure
- How the files are structured close to the real-world sensor data
- How to generate the access links
- How you can use the shared access links to connect to your blob storage
- How you can put a time limit on your data access from the blob
- How you could read single blob (file) OR
- How you could read multiple blobs (files) into one big dataset OR
- How could you download your blob dataset onto the Data Intelligence Hub environment
- We also demonstrate a basic code on getting started with your data
Source Code:
Find the whole tutorial on our Data Intelligence Hub Tutorials GitHub Repository.
Following some teaser images:
