nwchem 6.6 tests fails with more than 16 cores

From NWChem

Viewed 780 times, With a total of 4 Posts
Jump to: navigation, search

Just Got Here
Threads 1
Posts 3
Hello there

I'm trying to run the tests inside the 'QA' directory and am facing strange issues.
I can only run the tests (e.g. doafewqmtests.mpi) with 16 or less cores, otherelse it fails with the following error:
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++
_shm_create: shm_unlink: Permission denied
[18] Received an Error in Communication: (-1) _shm_create: shm_unlink
application called MPI_Abort(comm=0x84000000, -1) - process 18
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++

The system in question is the following:
OS: centos 6.5
CC / FC / CXX = intel 16.0.2
MPI = impi 5.1.3
BLAS = mkl 11.3

Here's how I compiled nwchem:
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++
export NWCHEM_TOP=/home/user/nwchem/nwchem-6.6
export NWCHEM_TARGET=LINUX64
export NWCHEM_MODULES="all python"
export NWCHEM_MPIF_WRAP="/opt/intel/impi/5.1.3.181/bin64/mpiifort"
export NWCHEM_MPIC_WRAP="/opt/intel/impi/5.1.3.181/bin64/mpiicc"
export NWCHEM_MPICXX_WRAP="/opt/intel/impi/5.1.3.181/bin64/mpiicpc"
export NWCHEM_LONG_PATHS=Y
export USE_NOFSCHECK=Y
export USE_MPI=y
export USE_MPIF=y
export CFLAGS_FORGA='-O0'
export FFLAGS_FORGA='-O0'
export CXXFLAGS_FORGA='-O0'
export FC=ifort
export CC=icc
export CXX=icpc
export I_MPI_CC=icc
export I_MPI_FC=ifort
export I_MPI_F77=ifort
export I_MPI_F90=ifort
export I_MPI_CXX=icpc
export ARMCI_NETWORK=MPI-PR
export ARMCI_DEFAULT_SHMMAX=1048576
export MSG_COMMS=MPI
export BLAS_SIZE=8
export BLASOPT="-L /opt/intel/compilers_and_libraries_2016.2.181/linux/mkl/lib/intel64 -lmkl_intel_ilp64 -lmkl_sequential -lmkl_core -lpthread"
export BLAS_LIB=$BLAS_LIB
export LAPACK_SIZE=8
export LAPACK_LIB=$BLASOPT
export USE_SCALAPACK=y
export SCALAPACK_SIZE=8
export SCALAPACK="-L /opt/intel/compilers_and_libraries_2016.2.181/linux/mkl/lib/intel64 -lmkl_scalapack_ilp64 -lmkl_blacs_intelmpi_ilp64 $BLASOPT"
export PYTHON_EXE=/usr/bin/python
export PYTHONVERSION=2.6
export USE_PYTHON64=yes
export PYTHONPATH+=:/home/user/nwchem/nwchem-6.6/contrib/python/
export PYTHONHOME=/usr
export PYTHONLIBTYPE=so
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++

$ make -C src/ nwchem_config

$ make -C src/


The *FLAGS_FOR_GA env variables were needed to get to this point

Ulimits are ok, AFAICT.


Any idea what is the cause of the problem?

TIA,
Fabricio

Forum Vet
Threads 9
Posts 1580
What is the output of the command

ls -lH /dev/shm

Just Got Here
Threads 1
Posts 3
Quote:Edoapra Jun 14th 10:38 am
What is the output of the command

ls -lH /dev/shm



[root@node ~]# ls -lH /dev/shm
total 0

Forum Vet
Threads 9
Posts 1580
What about
ls -lrt /run/ | grep shm

Just Got Here
Threads 1
Posts 3
No such directory as '/run' in centos 6.x

'ls -lrt /var/run/ | grep shm' also shows nothing, and nothing in '/tmp' too.


Forum >> NWChem's corner >> Running NWChem



Who's here now Members 0 Guests 1 Bots/Crawler 0


AWC's: 2.5.10 MediaWiki - Stand Alone Forum Extension
Forum theme style by: AWC