I published another episode of AWS Bites podcast, the weekly show where we address interesting questions about AWS:

https://www.youtube.com/watch?v=u_nR6up4Kvs

Eoin and Luciano are back with some more AWS messaging services material! This time we talk about Kinesis Data Streams and everything there’s to know about them! In this episode of AWS Bites, we cover the difference between data streaming and queue or message buses. How Kinesis can let you process large batches of messages in near real time. Why you might use Kinesis as a queue or pub/sub bus in some cases. A few different ways to use Kinesis with the focus on avoiding too much complexity. We also provide some insights based on our experience with Kinesis Data Streams including real use cases, monitoring tips and some gotchas to be aware of.

00:00 Intro
01:06 What is data streaming?
03:24 Use cases for Kinesis Data Streams
07:00 Main features of Kinesis Data Streams
09:25 Limits with Kinesis Data Streams
13:10 How to scale Kinesis Data Streams
18:10 Enhanced fan out mode
20:10 Pricing
22:12 Observability and metrics
25:10 How to produce and consume messages
31:40 Processing Kinesis Data Streams with Lambda
36:10 How Kinesis integrates with other AWS services
39:35 Deep dive material
41:02 Outro

In this episode, we mentioned the following resources:
- Our introductory episode about what services you should use for events: https://www.youtube.com/watch?v=CG7uh...
- Amazon Kinesis Producer Library (KPL): https://docs.aws.amazon.com/streams/l...
- Amazon Kinesis Consumer Library (KCL): https://docs.aws.amazon.com/streams/l...
- Kinesis Library wrapper for Node.js: https://github.com/awslabs/amazon-kin...
- Kinesis Library wrapper for Python: https://github.com/awslabs/amazon-kin...
- Kinesis Data Stream with captures from DynamoDB (for CDC): https://docs.aws.amazon.com/amazondyn...
- Kinesis Data Stream with captures from Aurora: https://docs.aws.amazon.com/AmazonRDS...
- Kinesis Data Analytics: https://aws.amazon.com/kinesis/data-a...
- Kinesis Firehose: https://aws.amazon.com/kinesis/data-f...
- Must-read on Kinesis: Anahit Pogosova’s two-part blog series: https://dev.solita.fi/2020/05/28/kine... & https://dev.solita.fi/2020/12/21/kine...
- Cloudonaut Kinesis vs MSK: https://cloudonaut.io/versus/messagin...
- Deep Dive on Lambda Consumers for Kinesis / Heeki Park - re:invent 2020 https://www.youtube.com/watch?v=tCYwc...

You can listen to AWS Bites wherever you get your podcasts:
- Apple Podcasts: https://podcasts.apple.com/us/podcast...
- Spotify: https://open.spotify.com/show/3Lh7Pzq...
- Google: https://podcasts.google.com/feed/aHR0...
- Breaker: https://www.breaker.audio/aws-bites
- RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss

Do you have any AWS questions you would like us to address?
Leave a comment here or connect with us on Twitter:
- https://twitter.com/eoins
- https://twitter.com/loige