Ingest obs run on lustre

Daniel Nemergutrequested to merge
ingest_obs_on_lustre into main

Another case of this, running this workflow on lustre directly without transferring files. It's been manually updated on dev and test, this is for prod.

Merge request reports