How to pass parameter to PythonOperator in Airflow
PythonOperator have a named parameter op_kwargs
and accepts dict
object.
have
t5_send_notification = PythonOperator(
task_id='t5_send_notification',
provide_context=True,
python_callable=SendEmail,
op_kwargs={"my_param":'value1'},
dag=dag,
)
def SendEmail(my_param,**kwargs):
print(my_param) #'value_1'
msg = MIMEText("The pipeline for client1 is completed, please check.")
msg['Subject'] = "xxxx"
msg['From'] = "xxxx"
......
s = smtplib.SMTP('localhost')
s.send_me
- Pass a dict object to op_kwargs
Use the keys to access their value from kwargs dict in your python callable
def SendEmail(**kwargs): print(kwargs['key1']) print(kwargs['key2']) msg = MIMEText("The pipeline for client1 is completed, please check.") msg['Subject'] = "xxxx" msg['From'] = "xxxx" ...... s = smtplib.SMTP('localhost') s.send_message(msg) s.quit() t5_send_notification = PythonOperator( task_id='t5_send_notification', provide_context=True, python_callable=SendEmail, op_kwargs={'key1': 'value1', 'key2': 'value2'}, dag=dag, )