markupsafe constraint conflicts with airflow v2.6.2+

[rajukrishnamurthy]

The markupsafe constraint requires a version that is 1.5 years old which conflicts with airflow v2.6.2+ constraints.

I searched the soda codebase and there does not seem to be any direct usage of markupsafe. I might have missed something, because I only did a quick scan of the other install_requires, but the recent versions either have no dependency on markupsafe of work with v2.1.3+.

[tools-soda]

SAS-3728

[rajukrishnamurthy]

Further investigation: it looks like opentelemetry-api is a few version behind too. would it be possible to work with 1.24 (or greater)

[bramamoorthy]

facing the same problem with airflow 2.8.1 @rajukrishnamurthy did you take a different route.

I am using MWAA and mwaa-local-runner from https://github.com/aws/aws-mwaa-local-runner/tree/v2.8.1/docker .

Any insights would be greatly appreciated.

@tools-soda @tools-soda

[swathigottumukkala]

we are running into the same issue and blocking us from running soda checks in airflow

apache-airflow 2.6.3 depends on markupsafe>=1.1.1
apache-airflow[sentry] 2.6.3 depends on markupsafe>=1.1.1
apache-airflow[statsd] 2.6.3 depends on markupsafe>=1.1.1
soda-core 3.4.3 depends on markupsafe<=2.1.2 and >=2.0.1

[rajukrishnamurthy]

facing the same problem with airflow 2.8.1 @rajukrishnamurthy did you take a different route.

I am using MWAA and mwaa-local-runner from https://github.com/aws/aws-mwaa-local-runner/tree/v2.8.1/docker .

Any insights would be greatly appreciated.

@tools-soda @tools-soda

@bramamoorthy I apologize for missing your question. Yes, I think our solution is similar, we just use KubernetesPodOperator or CeleryExecutor so our dag & task code can use different set of isolated requirements.