Runners

Runners are nothing but Traceable CLI installed on your server as a service. Runners are used to process the scans. Each runner can process one scan at a time.

You can download and install a runner using either of the following methods:

  • Through the Traceable platform

  • As a service using the install.sh script

  • Using Helm chart

  • On AWS ECS using CloudFormation or Terraform

Traceable also allows you to set up custom certificates for runners according to your requirements. For more information, see Set up custom certificates for runners.

The following table compares Traceable CLI and runner on various parameters along with their use case and recommendations:

Parameters

Traceable CLI

Traceable Runner

Integration

It is designed to integrate with CI systems when the job needs to be triggered and run on a CI runner. It is a quick way to run scans from local or remote hosts.

It is designed to integrate with job schedulers and CI/CD systems when the CI pipeline needs to trigger the scan and delegate actual running to the Traceable runner.

Execution

It executes synchronously, running tests immediately as they are invoked.

It executes asynchronously, consuming the job queue.

Configuration

It is usually a part of the script setup.

It requires a runner pool, which is usually done using Helm charts or similar deployment tools.

Use Case

It is ideal for pre-commit hooks, pre-deploy checks, and other stages in the development pipeline where immediate feedback is required.

It is ideal for scheduling regular security scans, batch jobs, or handling multiple requests asynchronously.

Recommendation

It is recommended for use in small to medium projects requiring immediate results on simple security tests.

It is recommended for use in either of the following scenarios:

  • When working with large projects requiring complex security testing, most attack coverage and tests run for longer durations.

  • When you want to run periodic exhaustive tests as daily/weekly scheduled jobs.


Before you begin

Make a note of the following before proceeding with setting up Runner:

  • A runner needs at least 2 CPUs and 4 GB of memory. This number may increase with an increase in the number of tests. Contact Traceable support for exact sizing by sending an email to support@traceable.ai.

  • Ensure that the machine where you are installing the Runner can communicate with the APIs and Traceable Platform.

  • DAST does not need an app to be instrumented, but an environment still needs to be created for DAST scan to create a default service and list APIs under it.

  • Runners are not scoped by the environment. They are available for all environments.

  • Ensure you are assigned the Security admin or Account Owner role to start a runner. For more information about different roles, see Teams and roles - RBAC.


Install a Runner

Option 1 — Download runner from UI

Navigate to Testing → Settings → Runners to start the runner configuration. Provide a name for the runner and the token. The binary CLI command and docker option are displayed. You can use either of the options to configure the runner on your server.

Configure new runner

By default, the binary command runs in the background. The Docker command given in the UI interactively runs in the foreground. If you wish to run the Docker command in the background, use the following command. Replace the runner's name with the name of your runner:

docker run --rm -d -v ~/.traceable_docker:/app/userdata traceableai/traceable-cli:latest runner start --traceable-server api.traceable.ai --runner-name newrunner --token **** 

Following is an explanation of the Docker command:

  • docker run is the command to run a Docker container.

  • --rm removes the container automatically after it exits.

  • -d runs the container in detached mode.

  • -v ~/.traceable_docker:/app/userdata mounts the local directory ~/.traceable_docker to the /app/userdata directory inside the container. This allows the container to access and modify files in the local directory.

  • traceableai/traceable-cli:latest specifies the image to use for the container.

  • runner start runs the start command of the Traceable Runner program within the container.

  • --traceable-server api.traceable.ai specifies the URL of the Traceable Server to connect to.

  • --runner-name newrunner sets the name of the runner to “newrunner”.

  • --token **** sets the authorization token required to connect to the Traceable Server.


Option 2 — Download and install Runner as a service

You can configure the runner as a systemd service. To do so, see the following sections:

Step 1 - Pre-installation

Before configuring Runner as a service, complete the following steps:

  1. Generate a new API token in the Traceable platform. To do this:

    1. Navigate to Testing → Suites and select any suite.

    2. In the page’s top right corner, click Start Scan.

    3. In the Start New Scan window, under Generate Token, click Generate New Token.

    You can also use an existing API token.

    This is required while installing Runner as a service.

  2. Navigate to the terminal in your machine and enter the following command to download the installation script:

    curl -O https://downloads.traceable.ai/cli/release/latest/install.sh

    Note

    The install.sh script is supported on a Linux machine.

Step 2 - Installation

Enter the following command to install Runner as a service:

bash install.sh --service --token <traceable-api-token> --server <traceable-server>


See the table below for the available options you can use in the above command:

Option

Description

Default Value

--prefix <prefix-path>

The installation prefix

/home/ubuntu/.local

--version <version>

The CLI version to install

latest

--runner-name <runner-name>

A custom name for the runner

<hostname>-runner

--file <filepath>

The path to the Traceable distribution zip file

Downloaded from Traceable’s download site

--no-prompt

Does not provide a prompt on confirmation

-

--service

Install the runner as a systemd service.

-

--user <user>

Install the runer as a user. Run as the <user> for the service

ubuntu

--group <group>

Install the runner as a group. Run as the <group> for the service.

ubuntu

--server <traceable-server>

The Traceable server to connect to.

api.traceable.ai:443

--token <traceable-api-token>

The Traceable user token for authentication.

-

--traceable-home <path>

The path to the Traceable home folder.

/home/ubuntu

--logfile <logfile-path>

The path to the file that should store the runner logs. By default, Traceable outputs to stdout.

-

--logdir <logdir-path>

The path to the directory that stores all the logs. By default, Traceable uses the TRACEABLE-HOME directory.

-

--loglevel <log-level>

The level of logs you want for the runner. This can contain the following values:

  • INFO (default)

  • DEBUG

  • TRACE

  • PROGRESS

-

--scan-log-max-retention-count <num>

The maximum number of files that Traceable should retain in the logs folder. When the files reach the limit, the oldest ones are replaced with new ones.

-

--scan-log-max-retention-days <days>

The maximum number of days for which Traceable should retain the log files.

-

--max-log-file-size <size-in-bytes>

The maximum size of a log file (in bytes).

-

--tmp-dir <path-to-directory>

The directory to use during installation and runtime.

System Temp Directory

--help

Show this table for reference in your terminal.

-

Step 3 - Post-Installation

Post-installation of the runner, you must complete the following steps to start the runner:

  1. Enter the following command to restart the service:

    sudo systemctl daemon-reload
  2. Enter the following command to start the service:

    sudo systemctl start traceable-runner
  3. Enter the following command to check the status of the service:

    sudo systemctl status traceable-runner

    The output of the above command should look like this:

    ● traceable-runner.service - Traceable CLI
         Loaded: loaded (/etc/systemd/system/traceable-runner.service; disabled; vendor preset: enabled)
         Active: active (running) since Mon 2025-01-06 07:07:19 UTC; 9s ago
       Main PID: 283083 (traceable)
          Tasks: 15 (limit: 1069)
         Memory: 405.3M
            CPU: 1.850s
         CGroup: /system.slice/traceable-runner.service
                 ├─283083 /home/ubuntu/.local/traceable/bin/traceable runner start --runner-name traceable-runner
                 ├─283085 /tmp/staticx-EJFPfK/traceable_shared runner start --runner-name traceable-runner
                 └─283086 /tmp/staticx-EJFPfK/traceable_shared runner start --runner-name traceable-runner
    
    Jan 06 07:07:19 loyal-tick systemd[1]: Started Traceable CLI.
    Jan 06 07:07:21 loyal-tick traceable[283086]: Traceable CLI 1.10.19 (linux)
    Jan 06 07:07:21 loyal-tick traceable[283086]: [2025-01-06 07:07:21,625]:INFO: Refreshing config
    Jan 06 07:07:21 loyal-tick traceable[283086]: [2025-01-06 07:07:21,626]:INFO: Connecting to `api.traceable.ai` with token `YTU2**********...`
    Jan 06 07:07:23 loyal-tick traceable[283086]: [2025-01-06 07:07:23,999]:INFO: Setting log level to: INFO
    Jan 06 07:07:24 loyal-tick traceable[283086]: [2025-01-06 07:07:24,000]:INFO: Acquired lock on /home/ubuntu/.traceable/runner.pid
    Jan 06 07:07:24 loyal-tick traceable[283086]: [2025-01-06 07:07:24,001]:INFO: Finding hook files in /home/ubuntu/.traceable/hooks
    Jan 06 07:07:24 loyal-tick traceable[283086]: [2025-01-06 07:07:24,015]:INFO: Started runner name: loyal-tick-runner (id: e1f123b7-3815-5e94-b8bd-8eb1234c7814). Listening for scan jobs...

    In the above output, the dot (●) shows the status of a runner. The table below describes the dot colors and their corresponding status descriptions:

    Color

    Status Description

    Green

    The runner is being activated or is currently active.

    Red

    The runner has failed.

    White

    The runner is currently inactive.

  4. Enter the following command to enable the service to start on system boot:

    sudo systemctl enable traceable-runner

You can run more than one runner on the same machine for both option 1 and option 2. For more information on how to run more than one runner on a single machine, contact Traceable support at support@traceable.ai.


Option 3 — Install runner using Helm chart

Complete the following steps to install runner using Helm chart:

  1. Enter the following command to add the repo:

    helm repo add traceableai https://helm.traceable.ai
  2. Enter the following command to update the repo:

    helm repo update
Create values.yml file

Create a values.yml file based on the sample provided below. Make sure to add the correct values for traceableToken and traceableServer in the file.

replicaCount: 1

resources:
  limits:
    cpu: 2.0
    memory: 4Gi
  requests:
    cpu: 2.0
    memory: 4Gi

astRunnerArgs:
  name: traceable-runner-helm   # Name of the runner
  traceableServer: api.traceable.ai   # Traceable Server
  traceableToken: ""   # Replace this with actual token value
  maxRetries: 1   # Number of Request Retries
  idleTimeout: 10   # Idle Timeout before aborting a scan
  requestDelay: 0   # Request delay delay between requests
  threads: 20   # Number of threads to run on
  logfile: stdout   # Log file name
  loglevel: INFO   # Set log level

Enter the following command:

helm install <deployment_name>  traceableai/traceable-runner -f values.yaml

Option 4 — Installation on AWS ECS using CloudFormation

You can configure runners on AWS ECS (Elastic Container Service) using CloudFormation. Download the template file by contacting Traceable support and install the runner in your AWS console. For the steps to do this, see Installation using CloudFormation.


Option 5 — Installation on AWS ECS using Terraform

You can configure runners on AWS ECS (Elastic Container Service) using Terraform. Download the Terraform file by contacting Traceable support and install the runner in your shell. For the steps to do this, see Installation using Terraform.


Set up custom certificates for runners

You can set up custom certificates for runners according to your requirements. These certificates are useful when you need private certificate authority (CA) files or to verify the client’s identity.

Note

All custom certificate files should be in PEM format.

Following are the custom SSL/TLS configurations for the Traceable runner:

Custom internal certificate authority (CA)

The Traceable Runner CLI allows you to configure a custom root CA file if your organization uses a private CA file to sign server certificates. Adding the custom CA file ensures secure communication between the runner and both the Traceable platform and your organization’s servers. This security is achieved using the certificates signed by the private CA file.

To set up a custom CA file, you must set the TRACEABLE_ROOT_CA_FILE environment variable with the path to the CA public certificate file in the instance where the Traceable runner is installed.

Mutual TLS configuration

The Traceable Runner CLI allows you to use environment variables to set the path to the custom certificate files. This is useful for verifying the client’s identity when calling your organization’s servers. You can set the following environment variables:

  • TRACEABLE_CLI_CERT_FILE — Set the path to the client’s certificate file for authenticating the client to the server.

  • TRACEABLE_CLI_KEY_FILE — Set the path to the certificate’s private key.


Runner View

Traceable shows all configured runners on the Runners page. This includes runners configured across environments. The page also shows the following columns:

Runner View

  • Runner — The name you used while configuring the runner. For example, SampleRunner in the above screenshot.

    Note

    Each runner in Traceable processes one scan at a time.

  • Runner ID — A unique identifier for the runner instance.

  • Host — The host (server or URL) that the runner is targeting.

  • Traceable CLI Version — The CLI version associated with the runner.

  • Status — The current status of the runner. For example, Idle or Busy.

  • Last Heartbeat — The time at which the runner was last active. For example, 2024-11-12 01:32:34 PM.

You can also hover over a column and the corresponding row value and click the Copy () icon to copy the value for use in the Traceable CLI.


Uninstall a Runner

You can uninstall a runner from your terminal; however, the steps to do this depend on the option you choose while installing it:

Runner installed using install.sh

Option 1 - As a systemd service

Complete the following steps:

  1. Enter the following command to stop the service if it is currently running:

    systemctl stop traceable-runner.service
  2. Enter the following command to check the status of the service:

    systemctl status traceable-runner.service

    The above command and recent log entries show whether the service is active, inactive, or has failed.

  3. Enter the following command to disable the service:

    systemctl disable traceable-runner.service

    The above command prevents the service from starting automatically at boot time.

  4. Enter the following command to remove the service unit file from your custom location:

    rm /etc/systemd/system/traceable-runner.service

    The above command removes the file from the /etc/systemd/system directory. This directory usually contains the systemd service files created or customized by the system administrator.

  5. Enter the following command to remove the service unit file from the standard location:

    rm /user/lib/systemd/system/traceable-runner.service

    The above command removes the file from the /user/lib/systemd/system/ directory. This directory usually contains systemd service files provided by installation packages.

  6. Enter the following command to reload the systemd manager configuration:

    systemctl daemon-reload

    The above command reloads the manager configuration. You must run this command to ensure that systemd is aware of the above steps.

Option 2 - Not as a service

Complete the following steps:

  1. Enter the following command to stop the runner:

    traceable runner stop <runner_name>
  2. Ensure that the Traceable runner process is currently not running:

    ps -ef | grep traceable
  3. Enter the following command to remove the Traceable CLI installation:

    delete $HOME/.local/traceable directory

Runner installed using a Helm chart

Enter the following command to uninstall the runner:

helm uninstall <deployment_name>

Runner installed on AWS ECS

Complete the following steps:

  1. Open your web browser and log in to the AWS management console.

  2. In the console, navigate to the Amazon Elastic Container service.

  3. Click the cluster where you installed the runner.

  4. Delete the runner service.