Skip to content
Snippets Groups Projects

Disable NGAS ingest via a capo setting

Merged Daniel Nemergut requested to merge disable_ngas_ingest into main

This sets ngas_ingest in the ingestion-manifest.json to the capo property archive-ingestion.ingestNGAS.

With this parameter set to false in the manifest, NGAS ingestion will be skipped by this line in manifestpersist.py:

    if ngas_ingest and len(ngas_files_to_ingest) > 0:
        ngas_archive(ngas_files_to_ingest, ingestion_path, fileset)

Example manifest when the capo setting archive-ingestion.ingestNGAS is true:

{
    "parameters": {
        "telescope": "VLBA",
        "reingest": "false",
        "ngas_ingest": "true",
        "ingestion_path": "/lustre/aoc/cluster/pipeline/docker/workspaces/staging/UG004M.ug004m"
    },
    "output_group": {
        "science_products": [
            ...
        ],
        "ancillary_products": [
            ...
        ]
    }
}

Example manifest when the capo setting archive-ingestion.ingestNGAS is false:

{
    "parameters": {
        "telescope": "VLBA",
        "reingest": "false",
        "ngas_ingest": "false",
        "ingestion_path": "/lustre/aoc/cluster/pipeline/docker/workspaces/staging/UG004M.ug004m"
    },
    "output_group": {
        "science_products": [
            ...
        ],
        "ancillary_products": [
            ...
        ]
    }
}
Edited by Daniel Nemergut

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
Please register or sign in to reply
Loading