How to perform ETL with AWS lambda using Python | AWS | Lambda | Python | Lambda Layers

Published: 10 July 2022
on channel: BI Insights Inc

9,033

134

In this video, we will develop AWS Lambda ETL script using Python. We can use Python scripts in AWS Lambda to run small to medium-sized ETL (extract, transform, and load) workflows. In Lambda environment Python scripts are compatible with Python 2 and 3 and come pre-loaded with libraries such as the Boto3, Numpy, SciPy, pandas, and others. We can also, install other libraries via a zip file.

Link to code, GitHub: https://github.com/hnawaz007/pythonda...

Link to article on the subject, medium: https://blog.devgenius.io/how-to-perf...

AWS Lambda Environment Variables: https://docs.aws.amazon.com/lambda/la...

Subscribe to our channel:
   / haqnawaz

---------------------------------------------
Follow me on social media!

GitHub: https://github.com/hnawaz007
Instagram:   / bi_insights_inc
LinkedIn:   / haq-nawaz

---------------------------------------------

#Python #ETL #awslambda

Topics covered in this video:
0:00 - Introduction AWS Lambda
1:31 - Overview of ETL with Lambda
2:00 - Create Python zip file
3:23 - Create a Layer in AWS with zip file
4:17 - Write Lambda function
5:11 - Import Libraries from Layer
6:11 - Code ETL Script
6:29 - Lambda Environment Variables
8:07 - Execute Lambda function to load data
8:18 - Review Redshift table

On this page of the site you can watch the video online How to perform ETL with AWS lambda using Python | AWS | Lambda | Python | Lambda Layers with a duration of hours minute second in good quality, which was uploaded by the user BI Insights Inc 10 July 2022, share the link with friends and acquaintances, this video has already been watched 9,033 times on youtube and it was liked by 134 viewers. Enjoy your viewing!

181