Data is streaming from sources such as instruments, mobile devices or the world of the Internet of Things. Data also streams from cloud internal systems such as logs or pools of lambda functions.
We have several blob posts that address different approaches to data stream analytics.
- A Quick Dive into Cloud Data Streaming Technology
- Observations About Streaming Data Analytics for Science
- The State of the Cloud: Evolving to Support Deep Learning and Streaming Data Analytics and Some Research Challenges
There are some excellent tools available on Amazon’s cloud. Kinesis is a complete streaming solution that is extremely flexible and has a excellent SQL based analytics engine