How to perform ETL with AWS lambda using Python | AWS | Lambda | Python | Lambda Layers
In this video, we will develop AWS Lambda ETL script using Python. We can use Python scripts in AWS Lambda to run small to medium-sized ETL (extract, transform, and load) workflows. In Lambda environment Python scripts are compatible with Python 2 and 3 and come pre-loaded with libraries such as the Boto3, Numpy, SciPy, pandas, and others. We can also, install other libraries via a zip file.
Link to code, GitHub: https://github.com/hnawaz007/pythonda...
Link to article on the subject, medium: https://blog.devgenius.io/how-to-perf...
AWS Lambda Environment Variables: https://docs.aws.amazon.com/lambda/la...
Subscribe to our channel:
/ haqnawaz
---------------------------------------------
Follow me on social media!
GitHub: https://github.com/hnawaz007
Instagram: / bi_insights_inc
LinkedIn: / haq-nawaz
---------------------------------------------
#Python #ETL #awslambda
Topics covered in this video:
0:00 - Introduction AWS Lambda
1:31 - Overview of ETL with Lambda
2:00 - Create Python zip file
3:23 - Create a Layer in AWS with zip file
4:17 - Write Lambda function
5:11 - Import Libraries from Layer
6:11 - Code ETL Script
6:29 - Lambda Environment Variables
8:07 - Execute Lambda function to load data
8:18 - Review Redshift table
In questa pagina del sito puoi guardare il video online How to perform ETL with AWS lambda using Python | AWS | Lambda | Python | Lambda Layers della durata di ore minuti seconda in buona qualità , che l'utente ha caricato BI Insights Inc 10 luglio 2022, condividi il link con amici e conoscenti, su youtube questo video è già stato visto 9,033 volte e gli è piaciuto 134 spettatori. Buona visione!
