WS-2799 HTC 23 upgrade
This upgrades our workflow service container and local HTC containers to use HTC 23 (the version after HTC 10).
A start for the upgrade and testing documentation (open to suggestions of where it should live): https://open-confluence.nrao.edu/display/SDT/HTCondor+Upgrade
I hit a snag in testing that showed environment variables now need to be explicitly passed through the DAG file in workflows that use a DAG (see references below). After inspecting our templates, pexes, and service code, I only found CAPO_PROFILE
to be an expected environment variable that needs passed through the DAG. std_calibration_and_imaging
works with the DAG fix in place and I'll be testing the others.
Refereneces on DAG issue:
(1) How getenv = True
allows all environment variables through.
(2) Why others think this is a bad idea and how condor_dagman
doesn't allow it anymore.
(3) How to pass envvars in the DAG.