Apache Airflow Installation on Ubuntu w/ Cloud Panel

1
18Кб

Main Resource:

https://s3.amazonaws.com/recipes.dezyre.com/use-emailoperator-airflow-dag/materials/Apache_Airflow_Installation_on_Ubuntu.pdf

https://docs.vultr.com/how-to-deploy-apache-airflow-on-ubuntu-20-04

 

First Issue:

Getting requirements to build wheel did not run successfully. apache-airflow mysql

Soltuion:

apt-get install pkg-config build-essential libmysqlclient-dev

Resource: https://stackoverflow.com/questions/76875507/can-not-install-apache-airflow-providers-mysql-pkg-config-error

 

At step 8 in the main resource unable to find the "airflow.cfg" file and so follow this to generate the cfg: https://airflow.apache.org/docs/apache-airflow/stable/howto/set-config.html#setting-configuration-options

 

Unable to find the folder, then lookup:

find / -name airflow -type d


Installting Supervisor:

To schedule the "scheduler" & "webserver"

Install: https://gcore.com/learning/how-to-set-up-supervisor-on-ubuntu/
Conf: https://gist.github.com/criccomini/1d50130d32db0a61905ec4e65b55c32d

Run both scheduler and webserver:

airflow scheduler &
airflow webserver &

https://stackoverflow.com/questions/73513328/how-to-run-airflow-scheduler-and-webserver-simultaneously

More Resources:

https://airflow.apache.org/docs/apache-airflow/stable/start.html

Поиск
Категории
Больше
Игры
Dragonbone City – Honkai: Star Rail 3.2 Guide
Exploring the newly added region in Honkai: Star Rail’s version 3.2 reveals the expansive...
От Xtameem Xtameem 2025-10-31 02:22:49 0 828
Игры
Unlock US Netflix in the UK: VPN Guide & Tips
Guide to Unlock US Netflix in the UK Unlocking American Netflix in the UK: Your Complete Guide...
От Xtameem Xtameem 2025-12-13 02:42:38 0 127
Crafts
Hengfeng as a Dewatering Of Sludge Innovator of Purpose and Vision
The story of transformation often begins in silence. Beneath the surface of industry, where water...
От polyacrylamide factory 2025-11-07 06:43:24 0 1Кб
Игры
Monopoly GO Sticker Hell? MMOWOW to the Rescue
The Sticker Struggle: Every Collector’s Nightmare In the vibrant world of Monopoly Go,...
От Lin Xiao 2025-09-08 07:07:08 0 2Кб
Игры
Call of Duty Mobile Sliding Guide – Tips & Controls
In Call of Duty: Mobile, players may find that certain controls are less intuitive, especially...
От Xtameem Xtameem 2025-12-17 02:47:00 0 22