Skip to content
Snippets Groups Projects
Select Git revision
  • WS-3249-ingest-envoy-evla-eb-updates
  • release/2.8.7.1 protected
  • development default protected
  • no-story-wf-monitor-tests
  • no-story-ingest-envoy-one-off-support
  • main protected
  • no-story-code-cleanliness
  • sam-testing-WS-2740-pipeline
  • WS-2767-research-sqla-20-upgrade
  • no-story-wf-monitor-improvements
  • 2.8.6-DEVELOPMENT protected
  • 2.8.5.1-DEVELOPMENT protected
  • fix-restore-delivery-bug
  • 2.8.5-DEVELOPMENT protected
  • ws2792-alma_fallback_ppr
  • replace-capability-service-polling-2
  • replace-capability-service-polling
  • fix-alma-delivery-permission-checks
  • some-refactors
  • WS-1388-weblog-only-downloads
  • 2.8.7.1-rc1 protected
  • 2.8.7 protected
  • alfalfa-ingest-envoy
  • chiles-ingest-envoy
  • 2.8.7-rc5 protected
  • 2.8.7-rc4 protected
  • 2.8.7-rc3 protected
  • 2.8.7-rc2 protected
  • 2.8.7-rc1 protected
  • 2.8.6-rc3 protected
  • 2.8.6-rc2 protected
  • 2.8.6-rc1 protected
  • end-of-sprint-100 protected
  • 2.8.5.1 protected
  • 2.8.5.1-rc1 protected
  • 2.8.5 protected
  • 2.8.5-rc5 protected
  • 2.8.5-rc4 protected
  • 2.8.5-rc3 protected
  • 2.8.5-rc2 protected
40 results
Compare
jgoldste's avatar
master: reorganized datafetcher "SDM-only" functionality removed. All tests...
Janet Goldstein authored 
master: reorganized datafetcher "SDM-only" functionality removed. All tests pass, including those that launch DF from a process to simulate command-line execution. TODO: actual command line, as below, should work but doesn't yet:

datafetcher --profile local --output-dir ~/Downloads --product-locator uid://evla/execblock/93e1c0cd-76de-4e65-a3f2-d5fe55f386d8 --verbose

Pylint also finds some errors, the consequence of fixing which puts red ink in the IJ editor and causes the above-mentioned command-line tests to fail.
66959865
History
jgoldste's avatar 66959865
History
Name Last commit Last update
apps
datafetcher
deployment
schema
services/archive
shared
support/conda
.gitignore
LICENSE.txt
README.md
__init__.py
deploy.sh
environment.yml
requirements.txt
README.md

NRAO Archive and Pipeline Processing Interface

Detailed documentation is available on our Confluence page.

Overview

The NRAO archive system allows people to download raw data and advanced SRDP radio astronomical observation data products made using NRAO-affiliated instruments: The Very Large Array (VLA), the Very Long Baseline Array (VLBA), the Atacama Large Millimeter Array (ALMA) as well as the the Green Bank Telescope (GBT).

Components

This system has several subsystems which have their own subsystems. The two primary systems are:

  • The archive which stores data products
  • The workspace system which allows users to retrieve data products and transform them into other products

The pieces are broken down into applications (both web-based and command-line), RESTful services and shared libraries.

More details can be had by looking at our Confluence documentation.