Apache Airflow Tutorial: Invoke AWS Lambda function from airflow

Published: 27 April 2021
on channel: smashplus

4,647

In this tutorial we are exploring first What is Apache Airflow. Then will see a quick demo of how to connect to an AWS Lambda function from the Apache Airflow DAG workflow task. This Lamda function is responsible to write some random data to the S3 bucket.

This video tutorial content is
00:00 Apache introduction
Then the demo follows 4 simple steps

2:33 Create an S3 bucket in Aws
3:16 Create lambda function that writes a JSON file to the S3 bucket
6:50 Create DAG File in Apache Airflow that invokes the AWS lambda function
11:40 Execute the apache airflow task

Code
Code is available in github here https://github.com/smashplusinfo/airf...

Please put comments if you have questions

On this page of the site you can watch the video online Apache Airflow Tutorial: Invoke AWS Lambda function from airflow with a duration of hours minute second in good quality, which was uploaded by the user smashplus 27 April 2021, share the link with friends and acquaintances, this video has already been watched 4,647 times on youtube and it was liked by 48 viewers. Enjoy your viewing!

1,970