🔗 原文链接:https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html
1. core
| Parameter |
Common Setting |
| dags_folder |
~/bigdata/airflow/dags |
| hostname_callable |
socket.getfqdn |
| default_timezone |
Asia/Shanghai |
| executor |
LocalExecutor |
| sql_alchemy_conn |
mysql://airflow:airflow@localhost:3306/airflow?unix_socket=/var/run/mysqld/mysqld.sock&charset=utf8 |
| sql_engine_encoding |
utf-8 |
| sql_engine_collation_for_ids |
utf8mb4 |
| sql_alchemy_pool_enabled |
True |
| sql_alchemy_pool_size |
0 |
| sql_alchemy_max_overflow |
-1 |
| sql_alchemy_pool_recycle |
1800 |
| sql_alchemy_pool_pre_ping |
True |
| sql_alchemy_schema |
‘’ |
| sql_alchemy_connect_args |
{"convert_unicode": True} |
| parallelism |
32 |
| dag_concurrency |
32 |
| dags_are_paused_at_creation |
True |
| max_active_runs_per_dag |
2 |
| load_examples |
False |
| load_default_connection |
False |
| plugins_folder |
~/bigdata/airflow/plugins |
| execute_tasks_new_python_interpreter |
False |
| fernet_key |
|
| donot_pickle |
True |
| dagbag_import_timeout |
30.0 |
| dagbag_import_error_tracebacks |
True |
| dagbag_import_error_traceback_depth |
2 |
| dag_file_processor_timeout |
50 |
| task_runner |
StandardTaskRunner |
| default_impersonation |
|
| security |
|
| unit_test_mode |
False |
| enable_xcom_pickling |
False |
| enable_xcom_pickling |
False |
| killed_task_cleanup_time |
60 |
| dag_run_conf_overrides_params |
True |
| dag_discovery_safe_mode |
True |
| default_task_retries |
5 |
| min_serialized_dag_update_interval |
30 |
| min_serialized_dag_fetch_interval |
10 |
| store_dag_code |
True |
| max_num_rendered_ti_fields_per_task |
30 |
| check_slas |
True |
| xcom_backend |
airflow.models.xcom.BaseXCom |
| lazy_load_plugins |
True |
| lazy_discover_providers |
True |
| max_db_retries |
3 |
| hide_sensitive_var_conn_fields |
True |
| sensitive_var_conn_names |
1.1 dags_folder
The folder where your airflow pipelines live, most likely a subfolder in a code repository. This path must be absolute.
| Type |
Deafult |
Environment Variable |
| string |
{AIRFLOW_HOME}/dags |
AIRFLOW__CORE__DAGS_FOLDER |
2. logging
| Parameter |
Common Setting |
| base_log_folder |
~/bigdata/airflow/plugins |
| remote_logging |
False |
| remote_log_conn_id |
|
| google_key_path |
|
| remote_base_log_folder |
|
| encrypt_s3_logs |
|
| logging_level |
INFO |
| fab_logging_level |
WARN |
| logging_config_class |
|
| colored_console_log |
True |
| colored_log_format |
|
| colored_formatter_class |
airflow.utils.log.colored_log.CustomTTYColoredFormatter |
| log_format |
[%%(asctime)s] {{%%(filename)s:%%(lineno)d}} %%(levelname)s - %%(message)s |
| simple_log_format |
%%(asctime)s %%(levelname)s - %%(message)s |
| task_log_prefix_template |
{{ti.dag_id}}-{{ti.task_id}}-{{execution_date}}-{{try_number}} |
| log_filename_template |
{{{{ ti.dag_id }}}}/{{{{ ti.task_id }}}}/{{{{ ts }}}}/{{{{ try_number }}}}.log |
| log_processor_filename_template |
{{{{ filename }}}}.log |
| dag_processor_manager_log_location |
~/bigdata/airflow/logs/dag_processor_manager/dag_processor_manager.log |
| task_log_reader |
task |
| extra_loggers |
3. metrics
4. secrets
5. cli
6. debug
7. api
8. lineage
9. atlas
10. operators
11. hive
12. webserver
| Parameter |
Common Setting |
| base_url |
|
| default_ui_timezone |
Asia/Shanghai |
| web_server_host |
0.0.0.0 |
| web_server_port |
9000 |
| web_server_ssl_cert |
|
| web_server_ssl_key |
|
| web_server_master_timeout |
120 |
|
13. smtp
14. sentry
15. celery_kubernetes_executor
16. celery
17. celert_broker_transport_options
18. dask
19. scheduler
20. keberos
21. github_enterprise
22. elasticsearch
23. kubernetes
24. smart_senor