Skip to content
Snippets Groups Projects

make workflow setup account for case where previous condor files and logs exist in processing directory

Merged Charlotte Hausman requested to merge tinker_with_old_files into main
1 unresolved thread
  • make workflow setup account for case where previous condor files and logs exist in processing directory
  • catch up with 2.5.2 email change
Edited by Charlotte Hausman

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
556 561 file.chmod(file.stat().st_mode | stat.S_IEXEC)
557 562
563 @staticmethod
564 def _check_for_old_condor_files(dir_path: Path):
565 """
566 It is possible that a follow-on workflow will use an existing, previously used, directory, and this directory
567 might contain previously used condor submit files and their associated output. Move these aside so they don't
568 interfere with the new workflow execution
569 Example: VLASS Image Caching post SECI or Quicklook
570
571 :param dir_path: path of the directory that will be submitted to condor
572 :return:
573 """
574 extensions = ["*.condor", ".dag", ".log"]
575
576 old_files = itertools.chain.from_iterable(dir_path.glob(pattern) for pattern in extensions)
  • Daniel Lyons approved this merge request

    approved this merge request

  • Charlotte Hausman changed title from make workflow setup account for case where previous condor files and logs exit in processing directory to make workflow setup account for case where previous condor files and logs exist in processing directory

    changed title from make workflow setup account for case where previous condor files and logs exit in processing directory to make workflow setup account for case where previous condor files and logs exist in processing directory

  • Please register or sign in to reply
    Loading