Janet Goldstein authored 3 years ago and Nathan Hertz committed 3 years ago

WS-254, WS-253, WS-251: Catch ingest-complete event, parse it, and create request based on given info

- Local cluster can now run download workflows
- wf_monitor's timeout functionality now works the way we expect it to

- aat_wrest: utility for pulling metadata for calibration templates
- wf_framework: contains script for setting up CASA processing directory structure

changing default spl to smaller image spl

Daniel Lyons authored 4 years ago and Nathan Hertz committed 4 years ago

- Datafetcher runs in container and retrieves data
- Delivery can deliver data to a directory within the container

Charlotte Hausman authored 4 years ago and Nathan Hertz committed 4 years ago

Messaging system is now running on a more robust foundation:
- `kombu` package for AMQP networking
- New Messenger and Router objects
- New message format
- Easy-to-use callback subscribing
- Can now get messages anywhere in the system easily and send replies back easily

All enabled tests are now true unit tests with no external dependencies; new `requirements.txt` file in `test/` that installs testing requirements (`pytest`, `pytest-mock`, etc.); and `run-tests.sh` now has an extra step that installs these

All enabled tests now pass. TODO: Refactor integration tests into unit tests; add more test coverage

SSA-6803: removed obsolete/possibly-not-needed scripts. Updated project root (data => workspaces) and now tests that passed before still pass.

system since I figure that's on its way out the door)

updated WorkflowEvent shape

SSA-6324: proof of concept -- running tests in Docker container. These tests all pass at the pytest command line -AND- inside a  container. scode project updater code removed -- doesn't work, and will be merged in from archive eventually.

wf_monitor to use new amqp_helpers setup; updated wf_monitor tests;
updated WorkflowEventSchema to accept a string in the timestamp field
instead of a datetime (we could probably change this, but this is how
it's set up for now)

originally going to use a singleton pattern but ran into issues with
that)