Workflow Configuration

Configuration and utilities for workflow orchestration.

• Workflow Builder
• STEP_TYPE_API_FNS
• build_workflow_from_config()
• Workflow Configuration
• REQUIRED_WORKFLOW_FIELDS
• DEFAULT_BACKUP_FREQ_SECONDS
• ResourceConfig
  • ResourceConfig.memory_gb
  • ResourceConfig.project
  • ResourceConfig.queue
  • ResourceConfig.runtime
  • ResourceConfig.cores
  • ResourceConfig.hardware
  • ResourceConfig.requires_archive_node
  • ResourceConfig.from_dict()
  • ResourceConfig.to_dict()
  • ResourceConfig.to_native_specification()
• ParsedStep
  • ParsedStep.step_type
  • ParsedStep.name
  • ParsedStep.api_kwargs
• WorkflowConfig
  • WorkflowConfig.name
  • WorkflowConfig.project
  • WorkflowConfig.queue
  • WorkflowConfig.output_directory
  • WorkflowConfig.default_environment
  • WorkflowConfig.steps
  • WorkflowConfig.max_attempts
  • WorkflowConfig.parse_yaml_file()
• Workflow Config Interface
• get_step_resources()
• get_bash_step_tasks()
• get_simulation_step_tasks()
• get_pytest_step_tasks()
• get_python_step_tasks()
• get_notebook_step_tasks()
• Workflow Step Parsing
• resolve_step_type()
• parse_bash_step_from_yaml()
• parse_simulation_step_from_yaml()
• parse_pytest_step_from_yaml()
• parse_python_step_from_yaml()
• parse_notebook_step_from_yaml()
• STEP_TYPE_YAML_PARSERS
• parse_step_from_yaml()
• load_workflow_config()
• Workflow Step Serialization
• serialize_bash_step_to_yaml()
• serialize_simulation_step_to_yaml()
• serialize_pytest_step_to_yaml()
• serialize_python_step_to_yaml()
• serialize_notebook_step_to_yaml()
• STEP_TYPE_YAML_SERIALIZERS
• workflow_config_to_dict()
• Workflow Step Validation
• validate_bash_step()
• validate_simulation_step()
• validate_pytest_step()
• validate_python_step()
• validate_notebook_step()