Amazon Kinesis is a real-time, fully managed, and scalable platform for streaming data on Amazon Web Services.It has multiple functionality, allowing one to perform various tasks – such as ingesting and processing real-time data, and developing custom streaming applications for specific requirements.
It provides key capabilities in the form of:
- Kinesis Firehose – to easily load streaming data into AWS;
- Kinesis Analytics – to easily process and analyze streaming data with standard SQL;
- Kinesis Streams – to build custom applications that process and analyze data.
Amazon Kinesis has attracted use from many well-known corporations. Netflix, for instance, monitors all communications between its applications using Kinesis, enabling it to detect and quickly solve any technical issues.
Amazon Kinesis' components
Let’s take a closer look at the key components that make it useful and attractive.
Firehose is used to load streaming data into Amazon Web Services . Using this function, streaming data is transformed and loaded into Kinesis Analytics, Amazon Elasticsearch Service, Amazon Redshift, and Amazon S3.
Doing this allows the use of real-time analytics of streaming data with your favorite, pre-existing business intelligence tools. Additionally, using the Kinesis Firehose requires no continuous administration; it is fully managed and scales automatically to your data throughput.
Kinesis Analytics is an easy way to analyze and process real-time streaming data with standard SQL. Using this, you can read data from Kinesis Firehose and Kinesis Streams. It also enables you to build applications or stream processing queries using SQL to aggregate data as it continuously arrives. Analytics can recognize standard data formats and automatically parses the data, whilst recommending a schema, one which is editable using an interactive schema editor.
Analytics further provides an interactive SQL editor to build queries using streaming data operations. A familiarity with SQL is all you need to use Kinesis Analytics, as it uses standard ANSI SQL. Further features provided by Kinesis Analytics are: pre-built stream processing templates – where you can select suitable templates for your respective analytics task; and advanced stream processing functions – which enables easy use of advanced analytics such as top-k analysis of streaming data.
Image source: https://aws.amazon.com/es/kinesis/?nc1=h_ls
Streams provides a platform for real-time and continuous data processing. It can collect log event data from servers, desktops, and mobiles, etc. Streams allows you to encrypt sensitive data using server-side encryption and AWS KMS master keys.
Using the Kinesis Producer Library (KPL), you can create a Kinesis stream within seconds. It has a low cost at $0.015 p/hour, with no upfront charge, and provides strong reliability – synchronously replicating streaming data across three facilities, and preserving data for up to a week.
If you want to read more information about Kinesis and Amazon Web Services , you can find an in-depth summary in the next link: Amazon Kinesis.