WS-528: Fix HTCondor environment for `ingest`
ingest_cal submit file:
-
Added environment variables that link external libraries for MySQL and Oracle -
Added 1GB memory request to avoid an out-of-memory error I was getting
ingest PEX:
-
Rebuilt ingestPEX on RHEL 7 machine and pushed it up to the devsbinarea -
Temporarily changed hard-coded ingestion manifest file name fromChanged back and redeployed.ingestion-manifest.json->ingestion_manifest.json(will change back after a manifest generator fix uses the former naming scheme; it currently uses the latter naming scheme)
ingest-request.sh:
-
Changed capocall to usepycapo -
Added apt install curlto workflow container Dockerfiles (ingest-request.shuses it)
ingest_cal workflow testing:
-
Ran an ingest workflow on dev and got past the MySQL/Oracle library issues -
Ran a fully successful ingest_calworkflow
Miscellaneous:
-
Removed dependency on dbcontainer forschema-devdocker-composeservice -
Added a few gripes
Completes ticket WS-571
Edited by Nathan Hertz