About VASP run problem #6
Description
I have a error when I run VASP where i assign the -np 22, i try 21 is OK.
I am sure i allocated enough cpu cores to mckernel, can someone tell me the reason?
hareware: arm server: 128 cores;
software: centos7.6 + openmpi 4.0.5 + mckernel 1.7
Error as follow:
_[root@localhost VASP_bench_pt]# mpirun -np 22 --allow-run-as-root -x OMP_NUM_THREADS=1 /root/sysroot/bin/mcexec -n 22 ../../bin/vasp_std
There are not enough slots available in the system to satisfy the 22
slots that were requested by the application:
/root/sysroot/bin/mcexec
Either request fewer slots for your application, or make more slots
available for use._
The mckernel information:
[root@localhost sysroot]# ./sbin/ihkosctl 0 query cpu
4-110
[root@localhost sysroot]#
[root@localhost sysroot]#
[root@localhost sysroot]# ./sbin/ihkosctl 0 query mem
52428800000@0,52428800000@1,52428800000@2,52428800000@3
[root@localhost sysroot]#
[root@localhost sysroot]# ./sbin/ihkosctl 0 kmsg
[ 0]: boot_param_size: 65536
[ 0]: %: GICv3
[ 0]: setup_arm64 done.
IHK/McKernel started.
[ 0]: ns_per_tsc: 10000
[ 0]: KCommand Line: hidos dump_level=24 time_sharing
[ 0]: Physical memory: 0x2080310000 - 0x2cb5000000, 52425588736 bytes, 799951 pages available @ NUMA: 0
[ 0]: Physical memory: 0x4000000000 - 0x4c35000000, 52428800000 bytes, 800000 pages available @ NUMA: 1
[ 0]: Physical memory: 0x202000000000 - 0x202c35000000, 52428800000 bytes, 800000 pages available @ NUMA: 2
[ 0]: Physical memory: 0x204000000000 - 0x204c35000000, 52428800000 bytes, 800000 pages available @ NUMA: 3
[ 0]: NUMA: 0, Linux NUMA: 0, type: 1, available bytes: 52425588736, pages: 799951
[ 0]: NUMA: 1, Linux NUMA: 1, type: 1, available bytes: 52428800000, pages: 800000
[ 0]: NUMA: 2, Linux NUMA: 2, type: 1, available bytes: 52428800000, pages: 800000
[ 0]: NUMA: 3, Linux NUMA: 3, type: 1, available bytes: 52428800000, pages: 800000
[ 0]: NUMA 0 distances: 0 (10), 1 (16), 2 (32), 3 (33),
[ 0]: NUMA 1 distances: 1 (10), 0 (16), 2 (25), 3 (32),
[ 0]: NUMA 2 distances: 2 (10), 3 (16), 1 (25), 0 (32),
[ 0]: NUMA 3 distances: 3 (10), 2 (16), 1 (32), 0 (33),
[ 0]: Trampoline area: 0x0
[ 0]: # of cpus : 107
[ 0]: locals = ffff802080380000
[ 0]: BSP: 0 (HW ID: 4 @ NUMA 0)
[ 0]: BSP: booted 106 AP CPUs
[ 0]: Master channel init acked.
[ 0]: Using Linux work IRQ for IKC IPI.
[ 0]: Enable Host mapping vDSO.
IHK/McKernel booted.
[ 32]: schedule: WARNING can't schedule() while no preemption, cnt: 1
[ 32]: schedule: WARNING can't schedule() while no preemption, cnt: 1