Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

General informations

HTCondor is a powerful yet complex batch system: in this page you'll find basic informations on how to submit and manage jobs, but for a fully fledged user manual you can find all the details on the official HTCondor documentation. 

All the command you will find on the user guide need to be executed on the frontend node, the one you'll land via ssh (htc-fe.rmlab.infn.it)

Submit a job

$ condor_submit example.sub

...


*       Executable      = foo.sh
*       Universe        = vanilla
        Error           = bar/err.$(ClusterId).$(ProcId)
        Output          = bar/out.$(ClusterId).$(ProcId)        
*       Log             = bar/log.$(ClusterId).$(ProcId)
        arguments       = arg1 arg2 $(ProcId)
      request_cpus   = 1
*         request_memory = 1024
      request_disk   = 10240
         should  should_transfer_files = yesno
*       Queue 1
 
*  = required fields

You can also submit many similar jobs with one queue command 

For reference you can have a look at job submission manual or at science job example

Parametri:

Executable

...

=

...

Job

...

to

...

be

...

executed
Universe

...

=

...

choose

...

between

...

vanilla/docker/parallel
Error,

...

Output,

...

Log

...

=

...

where

...

to

...

write

...

log

...

files.

...

Those

...

folders

...

need

...

to

...

exist

...

before

...

submitting

...

the

...

job
Arguments

...

=

...

Strings

...

array

...

to

...

be

...

provided

...

to

...

the

...

job

...

itself.
request_[...]

...

=

...

Job

...

requirements
Queue

...

=

...

This

...

is

...

the

...

submission

...

request,

...

here

...

you

...

can

...

specify

...

the

...

number of job to be executed

Require a specific operative system environment

To provide the highest compatibility with scientific frameworks, the cluster is composed of heterogeneous nodes running Ubuntu 24 and AlmaLinux 9.
Unless explicitly requested, jobs may be executed on any available node — this is useful for jobs that use self-contained environments, such as Python virtual environments or Docker/Singularity containers.

To explicitly request that a job run on a specific operating system, simply add the following line to your job file:

Requirements = (OpSysName == "<OS Name>")

The allowed values for <OS Name> are "AlmaLinux" and "Ubuntu".

Universe

A universe represent on an execution environment for the job: HTCondor supporto support several universes :

* vanilla
grid
java
scheduler
local
* parallel
vm
container
* docker


*  = Supported by rm2lab htc cluster
 

Docker Universe

To run jobs using a docker image you can write a job descriptor as follow :

...

Further details about docker universe applications can be found on the official manual


Parallel Universe

Parallel universe allows you to submit parallel jobs using mpi: the scheduler will wait for all the needed resources to be available before submitting the job.

...

Detailed info about parallel applications can be found here
 

Jobs with GPU

To execute a job that needs a GPU you can specify "request_GPUs = 1" in the job submission file.

Manage a job


$ condor_rm clusterID.procID

...


$ condor_hold clusterID.procID

Put a job on hold, it will not be executed until released


$ condor_release clusterID.procID

Release a previously hold job.
 

Queue check


$ condor_q <parameters>

The condor_q parameters allows you to check a job / queue status


Parameters:

-nobatch            Display a job per line
-global                Shows all the active queues in the cluster
-hold                   Shows information about job on hold (you can also use -analyze or --better-analyze parameters)
-run                     Shows info on running job, to be used with -nobatch

...