Running MUFTE on grid
Interface from AS to grid
Main design: dynamically created job description, run scripts and compilation instructions submitted to a resource that supports compiling MUFTE/UG on demand
Challenges
- certificate management
- users and processes
- application side tools are run by the user
- grid job polling should probably be done in a similar manner. database rights?
Interface within AS from the application side to the grid side
Main design: integration through relational database
Submitting a job
- Application side
- finds out the desired executable and script
- cleans the input/application directory
- packs the directory into a tarball in spool area
- inserts the corresponding info into DB
- Grid side
- detects new job assigments periodically
- writes xrsl, run script and compilation path info appropriate files
- submits the jobs
Information needed to submit a job
- location of MUFTE.tar.gz
- path to the application
- path to the script
- resources (cpus, memory, time?, level of parallelism)
Runtime environment
Name for serial: ENV/PRECOMPILE/MUFTE-x.x (have to think about the naming still)
Name for parallel: ENV/PRECOMPILE/MUFTE-MPI-n-x.x, where n=number of CPUs. Have to think if the n-part is necessary
Features:
- compiles MUFTE on the fly
- unpacks MUFTE.tar.gz that is provided by the job
- makes UG and MUFTE
- leaves running the application to the job script
- works for both parallel and serial now
Problems:
- RE stage 0 is stage SUBMITTING. It seems that arc.conf directive maxjobs does not control this.
Deployment status
Norway
Denmark
Finland
- development version of both serial and parallel REs running in kivi.csc.fi (parallelism supported:8)
CO2 Technical notes and status
