Airflow Python Operator and XCom: Airflow Tutorial P6

Published: 11 October 2021
on channel: coder2j
29,124
435

Airflow Python Operator and XCom: Airflow Tutorial P6

#Airflow #AirflowTutorial #Coder2j

========== VIDEO CONTENT 📚 ==========
Today I am going to show you how to use Airflow PythonOperator and XComs. By watching this video, you will know:
👉 How to run a python function as a task using the python operator
👉 How to pass parameters to the python function
👉 How to share values between different tasks using Xcoms

Video Request: https://forms.gle/UMp4GA3krcSMMWzy9

You don't have a running Airflow in your local setup? Check out the Apache Airflow 2.0 Installation Tutorials.
Run Airflow locally 👉    • Airflow introduction and installation: Air...  
Run Airflow in Docker 👉    • Airflow Docker: run Airflow 2.0 in docker ...  

========== L I N K S 🔗 ==========
GitHub Repo 👉 https://bit.ly/3HD5oTX
Airflow Documentation 👉 https://bit.ly/3wbTqv4

========== T I M E S T A M P ⏰ ==========
00:00 - Introduction and launch airflow using docker
00:50 - Create a new DAG file
02:40 - Using the python operator to run a python function
03:50 - Pass parameters using op_kwargs
05:10 - How XCom works
07:10 - Push and pull values using XCom
09:18 - Push multiple values using key and value
12:42 - Only share small values via XCom

========== Connect with me 👏 ==========
Twitter 👉   / coder2j  
Website 👉 https://coder2j.com
GitHub 👉 https://github.com/coder2j


On this page of the site you can watch the video online Airflow Python Operator and XCom: Airflow Tutorial P6 with a duration of hours minute second in good quality, which was uploaded by the user coder2j 11 October 2021, share the link with friends and acquaintances, this video has already been watched 29,124 times on youtube and it was liked by 435 viewers. Enjoy your viewing!