Skip to content
Snippets Groups Projects
Daniel Lyons's avatar
Daniel Lyons authored
* commit '547a77f1': (217 commits)
  Initial docker work
  CapabilityQueue: added threaded queue manager, fixed bugs that were in the way of things working smoothly
  CapabilityService: Added check for no-op workflow event in update_execution
  Refactored threaded channel/connection to be more elegant
  adding missing argument parameter
  Connections can now be threaded with no errors
  Refactor to make Capability use workflow REST API
  Added test for creating and submitting workflow requests
  Add execute method and flush out implementation on prepare-and-run Widen create_workflow_request API Move tests around Fix some APIs to use interfaces instead of implementations
  I realized this argument is definitely missing, but probably other arguments are missing as well
  Add execute to step, and step class types
  fixing status persistence with magic. Not sure why this worked but... it did...
  Added a failure test case to vulture
  Added some untracked files that were annoying me
  Corrected -1 exit code message; added default exit code message
  Added threaded argument to appropriate docstrings
  misc. clean up
  Added persistence tests
  WorkflowInfo/CapabilityInfo: added methods to test persistence
  Replace workflow event monitor internal call with executable. Fix another execution_id lookup. Change workflow event listening to a thread.
  ...
9c0db1f1
History

NRAO Archive and Pipeline Processing Interface

Detailed documentation is available on our Confluence page.

Overview

The NRAO archive system allows people to download raw data and advanced SRDP radio astronomical observation data products made using NRAO-affiliated instruments: The Very Large Array (VLA), the Very Long Baseline Array (VLBA), the Atacama Large Millimeter Array (ALMA) as well as the the Green Bank Telescope (GBT).

Components

This system has several subsystems which have their own subsystems. The two primary systems are:

  • The archive which stores data products
  • The workspace system which allows users to retrieve data products and transform them into other products

The pieces are broken down into applications (both web-based and command-line), RESTful services and shared libraries.

More details can be had by looking at our Confluence documentation.