dagger CLI

Command line interface for dagger.

dagger

A command line utility for running multi-step Jobmon workflows.

Workflows are defined by a YAML configuration file that lists each step’s command, compute resources, and conda environment. Use the run sub-command to launch a fresh workflow, or restart to resume a previously started workflow from its output directory.

Usage

dagger [OPTIONS] COMMAND [ARGS]...

restart

Restart a previously started workflow.

RESULTS_DIRECTORY is the output directory of a previous dagger run. Reloads the saved configuration and persisted Jobmon workflow and resumes it, skipping tasks that already completed. --project, --queue, and --max-attempts override the saved configuration.

Usage

dagger restart [OPTIONS] RESULTS_DIRECTORY

Options

-P, --project <project>

Override project from the saved configuration.

-q, --queue <queue>

Override queue from the saved configuration.

-m, --max-attempts <max_attempts>

Override maximum Jobmon task attempts from the saved configuration.

--slack-channel <slack_channel>

Slack channel name (e.g. ‘my-channel’) to post the completion notification to instead of direct-messaging the launching user. The Slack bot must already be a member of the channel to post there.

--slack-tag <slack_tag>

Username to @-mention in the channel notification on success. Requires –slack-channel; ignored on failure, which always direct-messages the launching user.

--no-slack

Suppress the Slack completion notification entirely.

--pdb

Drop into python debugger if an error occurs.

-v

Configure logging verbosity of main runner for a parallel simulation.

Arguments

RESULTS_DIRECTORY

Required argument

run

Run a multi-step Jobmon workflow.

The workflow is defined in a workflow configuration YAML file specified via the -c/–config option. The config file specifies all workflow steps, compute resources, and execution order.

Every top-level configuration value other than steps can be overridden from the command line via the corresponding flag.

Usage

dagger run [OPTIONS]

Options

-c, --config <config_path>

Required Path to the workflow configuration YAML file.

-n, --name <name>

Override workflow name from config file.

-P, --project <project>

Override project from config file.

-q, --queue <queue>

Override queue from config file.

-o, --output-directory <output_directory>

Override output directory from config file.

-e, --default-environment <default_environment>

Override default_environment from config file.

-m, --max-attempts <max_attempts>

Override maximum Jobmon task attempts from config file.

--slack-channel <slack_channel>

Slack channel name (e.g. ‘my-channel’) to post the completion notification to instead of direct-messaging the launching user. The Slack bot must already be a member of the channel to post there.

--slack-tag <slack_tag>

Username to @-mention in the channel notification on success. Requires –slack-channel; ignored on failure, which always direct-messages the launching user.

--no-slack

Suppress the Slack completion notification entirely.

--pdb

Drop into python debugger if an error occurs.

-v

Configure logging verbosity of main runner for a parallel simulation.