Effortless Airflow Installation: Docker Setup with Python Dependencies
In this video, the goal is under 5 minutes to install Airflow using Docker, then to customize its image to encompass some python requirements.
#DataEngineering #DataPlatform #BusinessIntelligence #DataDrivenFuture #DataPipelines #DataArchitecture
---
CHAPTERS
00:00 Intro
00:08 Instruction to install Docker
00:29 Running Airflow in Docker
02:09 Customize Airflow Dockerfile
04:11 Data Platform project
---
📖 REFERENCES
GitHub Repo (w/ commit): https://github.com/dataengexplors/dat...
Implementing a Data Platform (part 1): • Video
Install Docker Desktop: https://docs.docker.com/engine/install/
Running Airflow in Docker: https://airflow.apache.org/docs/apach...
Building a new image with Docker: https://docs.docker.com/engine/refere...
Dockerfile created: https://github.com/dataengexplors/dat...
Docker Image uploaded: https://hub.docker.com/repository/doc...
---
🔗 LINKS
Follow me on Twitter: / dataengexplors
Follow me on GitHub: https://github.com/dataengexplors
---
ABOUT ME
I have dedicated my career to all aspects of data, encompassing algorithm development for enhanced recommendations, diverse data visualization creation, processing unstructured data, and designing efficient solutions across AWS, Azure, Google Cloud, and on-premises environments. Currently serving as a Data Engineer in a private company, I possess hands-on experience in solving technical challenges while also leading teams in building optimal data structures. My passion for data engineering motivates me to stay updated with the latest industry trends, so I can use my expertise to unlock the full potential of data and deliver impactful outcomes.
For business inquiries: dataengineeringexplorers@gmail.com
Auf dieser Seite können Sie das Online-Video Effortless Airflow Installation: Docker Setup with Python Dependencies mit der Dauer stunde minuten sekunde in guter Qualität ansehen, das der Benutzer enabledata: Data Engineering and DataOps 15 August 2023 hochgeladen hat, den Link mit Freunden und Bekannten teilen, dieses Video wurde auf Youtube bereits 108 Mal angesehen und es wurde von 2 den Zuschauern gefallen. Viel Spaß beim Betrachtenden Zuschauern gefallen!
