Amazon Kinesis Data Streams features
Why Kinesis Data Streams?
Amazon Kinesis Data Streams is a massively scalable, durable, and low cost streaming data service. Kinesis Data Streams can continuously capture gigabytes of data per second from hundreds of thousands of sources, such as website clickstreams, database event streams, financial transactions, social media feeds, IT logs, and location tracking events. The collected data is available in milliseconds to allow real time analytics use cases, such as real time dashboards, real time anomaly detection, and dynamic pricing.
Key Capabilities
Fully serverless
There are no servers to manage with Amazon Kinesis Data Streams. On demand modes automatically scale capacity when workload traffic increases, with no manual shard management required. Get started with a few clicks from the AWS Management Console.
Highly available and durable
Streaming data is synchronously replicated across three Availability Zones in an AWS Region, with retention up to 365 days to provide multiple layers of data loss protection.
Low latency delivery
Make your streaming data available to multiple real time analytics applications, to Amazon Managed Service for Apache Flink, or to AWS Lambda within 70 milliseconds of being collected.
Flexible fan-out
Attach up to 20 consumers to your Kinesis data stream, each with its own dedicated read throughput for independent parallel processing.
Cost optimized capacity modes
On Demand Advantage mode offers discounted pricing, unlimited enhanced fan out, and warm throughput when you commit to a 25 MB/s baseline across all on demand streams in a region.
Built-in security
Encrypt sensitive data at rest using server side encryption and AWS Key Management Service (KMS) keys. Securely access your data via Amazon Virtual Private Cloud (VPC) to meet regulatory and compliance requirements.
Broad AWS integrations
Connect with Amazon DynamoDB, Amazon Aurora, AWS Database Migration Service, Amazon CloudWatch, AWS Lambda, Amazon Managed Service for Apache Flink, and Amazon Kinesis Data Firehose to build complete applications quickly.
Data Delivery
Delivery to streaming tables in Iceberg format
Continuously materialize streaming data as queryable Apache Iceberg tables on Amazon S3 Tables with no ETL pipeline required.
Delivery to streaming tables continuously materializes stream records as Apache Iceberg tables on Amazon S3 Tables. Built in intelligent inline compaction eliminates small file proliferation and keeps query performance predictable without sacrificing data freshness. Query or transform data with any engine, including Apache Spark, Trino, Apache Flink, or Amazon Athena, for real time analytics directly on your streaming data.
Delivery to Amazon S3
Deliver streaming data in source format to S3 buckets for backup, archival, and downstream data processing.
Deliver streaming records directly to general purpose Amazon S3 buckets in the original source format. Use this capability for long term data retention, compliance archival, replay and reprocessing workflows, or as a staging layer for downstream batch processing pipelines. Combined with delivery to streaming tables, you can build a complete lakehouse architecture with real time queryable tables for analytics alongside full fidelity raw backup in S3.
Capacity Modes
On Demand Standard
Zero capacity planning. Stream data at any scale with pay per use pricing.
On Demand Standard removes the need to provision or manage throughput. Capacity scales automatically as workload traffic increases, with no manual shard management required. Data is synchronously replicated across three Availability Zones and available to consumers within 70 milliseconds. Ideal for unpredictable or spiky workloads where you want to pay only for the data you ingest and retrieve.
On Demand Advantage
Commit to a small baseline throughput for discounted pricing, unlimited fan out, and warm throughput across all streams.
On Demand Advantage provides automated capacity management with cost optimized pricing when you commit to a 25 MB/s data throughput baseline across all on demand streams in a region. Unlock unlimited enhanced fan out consumers, warm throughput for burst ready performance, and simplified billing based on total data throughput. If you ingest over 10 MB/s across all streams, fan out to more than two consumers, or use more than 50 streams, On Demand Advantage delivers the most cost effective experience.