Scheduler

Loco simplifies the traditional, often cumbersome crontab system, making it easier and more elegant to schedule cron jobs. The scheduler job can execute either a shell script command or run a registered task.

Setting Up

Scheduler jobs can be configured via a your YAML scheduler setup file or as part of an environment YAML file.

1. Your Dedicated File

Using a dedicated file provides a centralized place to configure all your scheduler jobs, making it easier to manage and maintain. You can start by generating a template file using the Loco generator command:

cargo loco generate scheduler

This command creates a scheduler.yaml file under the config folder. You can then configure your jobs within this file.

2. Environment Configuration File

You can also configure scheduler jobs per environment by adding the scheduler section to your environment's YAML configuration file:

scheduler:
  # Location of shipping the command stdout and stderr.
  output: stdout
  # A list of jobs to be scheduled.
  jobs:
    # The name of the job.
    write_content:
      # by default false meaning executing the the run value as a task. if true execute the run value as shell command
      shell: true
      # command to run
      run: "echo loco >> ./scheduler.txt"
      # The cron expression that defines the job's schedule. 
      schedule: run every 1 second
      output: silent
      tags: ['base', 'infra']

    run_task:
      run: "foo"
      schedule: "at 10:00 am"

    list_if_users:
      run: "user_report"
      shell: true
      schedule: "* 2 * * * *"
      tags: ['base', 'users']

Scheduler Configuration

The scheduler configuration consists of the following elements:

scheduler.output (Optional): Sets the default output location for all jobs.
- stdout: Output to the console (default).
- silent: Suppress all output.
scheduler.jobs: A object of jobs to be scheduled, the object key describe the job name. Each job has:
- schedule: The cron expression that defines the job's schedule. The cron get an english that convert to cron syntax or cron syntax itself.
  
  English to cron
  - Examples:
  - every 15 seconds
  - run every minute
  - fire every day at 4:00 pm
  - at 10:00 am
  - run at midnight on the 1st and 15th of the month
  - On Sunday at 12:00
  - 7pm every Thursday
  - midnight on Tuesdays
  Cron Syntax format:
  
  The cronjob should be UTC based
```
sec   min   hour   day of month   month   day of week   year
*     *     *      *              *       *             *
```
- shell: by default false meaning executing the the run value as a task. if true execute the run value as shell command
- run: Cronjob command to run.
  - Task: The task name (with variables e.x [TASK_NAME] KEY:VAl. follow here to see task arguments ). Note that the shell field should be false.
  - Shell: Run a shell command (e.x "echo loco >> ./scheduler.txt"). Note that the shell field should be true.
- tags (Optional): A list of tags to categorize and manage the job.
- output (Optional): Overrides the global scheduler.output for this job.

Verifying the Configuration

After setting up your jobs, you can verify the configuration to ensure everything is correct.

1. When using a dedicated file:

Run the following command to list the jobs from your scheduler file:

cargo loco scheduler --config config/scheduler.yaml --list

2. When using environment-based configuration:

To list jobs from the environment configuration, run:

LOCO_ENV=production cargo loco scheduler --list

Running the Scheduler

Once the configuration is verified, you can remove the --list flag to start running the scheduler. The scheduler will continuously execute jobs based on their schedule until a shutdown signal is received. When a signal is received, it gracefully terminates all running tasks and shuts down safely.

Important Notes:

When a job is running, Loco spawns it in a new process, and all environment variables will propagate to the new job process.
For tasks, ensure you run the scheduler with a valid environment by using the --environment flag or setting the LOCO_ENV environment variable. This ensures the correct environment and configuration are loaded for the task.
You can pass variables to tasks by using the vars object in the task configuration.

Running a Single Scheduled Job by Name

To run a specific scheduler job by its name, use the --name flag. This will execute a single job with the provided name.

LOCO_ENV=production cargo loco scheduler --name 'JOB_NAME'

This command will locate the job named "Run command" in your scheduler.yaml file and run it.

Running Scheduled Jobs by Tag

You can also run multiple jobs that share the same tag. Tags are useful for grouping related jobs together. For example, you might have several jobs that perform different types of maintenance tasks—such as database cleanup, cache invalidation, and log rotation—that you want to run together. Assigning them the same tag, like maintenance, allows you to execute them all at once.

LOCO_ENV=production cargo loco scheduler --tag 'maintenance'

This command runs all jobs that have been tagged with maintenance, ensuring that all related jobs are executed in one go.