Creating a Serverless Apache Kafka(MSK) publisher using AWS Lambda

Publié le: 13 janvier 2023
sur la chaîne: Knowledge Amplifier
14,819
168

Kafka is a top-notch industry platform for streaming data processing at scale. No surprise that first-class citizens of Kafka world are 24/7-running producer/consumer applications (e.g. classical servers, k8s-pods, etc.).
But what about the rapidly rising world of AWS Serverless ecosystem?

In this video ,let’s explore how to publish messages in MSK Kafka Topic from Serverless computing platform, AWS Lambda.

Prerequisites:
----------------------
Learn AWS VPC , Subnet , Route Table, Internet Gateway with Hands-on Demo
   • Learn AWS VPC , Subnet , Route Table, Inte...  
VPC with Public and Private Subnets in-depth intuition with Hands On
   • VPC with Public and Private Subnets in-dep...  
AWS VPC NAT Gateway In-depth intuition
   • AWS VPC NAT Gateway In-depth intuition  
AWS VPC ENDPOINT in depth intuition & hands on
   • AWS VPC ENDPOINT in depth intuition & hand...  
Using Amazon VPC Endpoints to Access DynamoDB in-depth
   • Using Amazon VPC Endpoints to Access Dynam...  
Getting Started with AWS Managed Streaming for Kafka with in-depth service setup
   • Getting Started with AWS Managed Streaming...  

Steps for the Lab:
-------------------------------
https://github.com/SatadruMukherjee/D...

You can download the Lambda Layer zip from here :
------------------------------------------------------------------------------------------------
https://github.com/SatadruMukherjee/D...

Check this playlist for more Data Engineering related videos:
   • Demystifying Data Engineering with Cloud C...  

Apache Kafka form scratch
   • Apache Kafka for Python Developers  

Snowflake Complete Course from scratch with End-to-End Project with in-depth explanation--
https://doc.clickup.com/37466271/d/h/...

🙏🙏🙏🙏🙏🙏🙏🙏
YOU JUST NEED TO DO
3 THINGS to support my channel
LIKE
SHARE
&
SUBSCRIBE
TO MY YOUTUBE CHANNEL


Sur cette page du site, vous pouvez voir la vidéo en ligne Creating a Serverless Apache Kafka(MSK) publisher using AWS Lambda durée heure minute seconde en bonne qualité , qui a été Téléchargé par l'utilisateur Knowledge Amplifier 13 janvier 2023, Partagez le lien avec vos amis et connaissances, sur youtube cette vidéo a déjà été regardée 14,819 fois et il a aimé 168 téléspectateurs. Bon visionnage!