CFX

From CCI User Wiki
Jump to: navigation, search

ANSYS CFX is software for computational fluid dynamics that is available on the Intel Cluster.

Usage Conditions

Currently licensed ANSYS CFX users can apply for access to the ANSYS CFX install at the CCI. Email Emailcws.png to apply for access.

Environment Setup

Before using any CFX applications first load the ANSYS module to setup your environment

 module load proprietary/ansys/[14.5|15.0]

Common Commands

 runwb2  # run workbench
 cfx5    # run cfx launcher

Partition and Solve From A Definition File

The following slurm script will partition the problem defined in the 'StaticMixer.def' file

 /gpfs/sb/software/amd64-rhel5/proprietary/cfd/ansys/14.5/v145/CFX/examples/StaticMixer.def

to the number of processes, $SLURM_NPROCS, you request when submitting the slurm job and then run the solver on that partition using $SLURM_NPROCS processes.

Create a file named runCFX.sh with the following contents

 #!/bin/bash
 srun hostname -s > /tmp//hosts.$SLURM_JOB_ID
 if [ "x$SLURM_NPROCS" = "x" ]; then
   if [ "x$SLURM_NTASKS_PER_NODE" = "x" ];then
     SLURM_NTASKS_PER_NODE=1
   fi
   SLURM_NPROCS=`expr $SLURM_JOB_NUM_NODES \* $SLURM_NTASKS_PER_NODE`
 fi
 # use ssh instead of rsh
 export CFX5RSH=ssh
 # format the host list for cfx
 cfxHosts=`tr '\n' ',' < /tmp//hosts.$SLURM_JOB_ID`
 # run the partitioner and solver
 cfx5solve -par -par-dist "$cfxHosts" -def ../StaticMixer.def -part $SLURM_NPROCS -start-method "Platform MPI Distributed Parallel"
 # cleanup
 rm /tmp/hosts.$SLURM_JOB_ID

Submit the job to use 16 processes across two nodes with a max wall time of 10 minutes

 sbatch -n 16 -N 2 -t 10 ./runCFX.sh

When the job completes the following files should be output

 StaticMixer_001.res   # cfx results file
 StaticMixer_001.out   # cfx partitioning and solve log file
 slurm-<jobid>.out     # slurm log file