hi all ...

i have trouble running software Material Studio 6.1 (CASTEP) in parallel  and it keep failed when i try to run the job...i submit my job through windows 7 and linux cluster will run it...  some file was generated  after the job failure in the /dsd/jobs/  directory.. I thing it is related to intel mpi but i truly  no idea about this problem.. the server gateway test succes.. here i paste the error that was generated ...

[wafi@cluster 2tio]\$ cat std.err

forrtl: severe (174): SIGSEGV, segmentation fault occurred

Image                             PC                                     Routine              Line            Source

libibverbs.so.1    0000003169809530  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CE8911D  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CE882B2  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CE70B1D  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CE6F078  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CE70747  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CD48C43  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CE62468  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CE4343F  Unknown               Unknown  Unknown

libmpi.so.4        00002B6A0CE38A0D  Unknown               Unknown  Unknown

libmpigf.so.4      00002B6A0D18E2BF  Unknown               Unknown  Unknown

castepexe.exe      00000000004EBF67  Unknown               Unknown  Unknown

castepexe.exe      000000000041178F  Unknown               Unknown  Unknown

castepexe.exe      00000000004116BC  Unknown               Unknown  Unknown

libc.so.6          000000316881ECDD  Unknown               Unknown  Unknown

castepexe.exe      00000000004115C9  Unknown               Unknown  Unknown

forrtl: severe (174): SIGSEGV, segmentation fault occurred

Image              PC                Routine            Line        Source

libibverbs.so.1    0000003169809530  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6AD3411D  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6AD332B2  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6AD1BB1D  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6AD1A078  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6AD1B747  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6ABF3C43  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6AD0D468  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6ACEE43F  Unknown               Unknown  Unknown

libmpi.so.4        00002B9E6ACE3A0D  Unknown               Unknown  Unknown

libmpigf.so.4      00002B9E6B0392BF  Unknown               Unknown  Unknown

castepexe.exe      00000000004EBF67  Unknown               Unknown  Unknown

castepexe.exe      000000000041178F  Unknown               Unknown  Unknown

castepexe.exe      00000000004116BC  Unknown               Unknown  Unknown

libc.so.6          000000316881ECDD  Unknown               Unknown  Unknown

castepexe.exe      00000000004115C9  Unknown               Unknown  Unknown

and one more error..

[wafi@cluster 2tio]\$ cat std_out.txt

cluster.hpc.org:432b:6b519900: 333 us(333 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432c:d66e900: 336 us(336 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432b:6b519900: 403 us(70 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

cluster.hpc.org:432b:6b519900: 770 us(367 us):  open_hca: device mthca0 not found

compute-0-1.local:10a1:1d7db720: 359 us(359 us):  compute-0-1.local:10a4:f143d720: 364 us(364 us):  open_hca: device  mlx4_0 not found

compute-0-1.local:10a3:cd936720: 366 us(366 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a3:cd936720: 428 us(62 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a4:f143d720: 427 us(63 us):  open_hca: device mlx4_0 not found

open_hca: device mlx4_0 not found

cluster.hpc.org:432b:6b519900: 823 us(53 us):  open_hca: device mthca0 not found

cluster.hpc.org:432b:6b519900: 871 us(48 us):  open_hca: device ipath0 not found

cluster.hpc.org:432b:6b519900: 921 us(50 us):  open_hca: device ipath0 not found

cluster.hpc.org:432b:6b519900: 970 us(49 us):  open_hca: device ehca0 not found

CMA: no RDMA devices found

compute-0-1.local:10a1:1d7db720: 563 us(204 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

CMA: no RDMA devices found

CMA: no RDMA devices found

cluster.hpc.org:432c:d66e900: 405 us(69 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

cluster.hpc.org:432c:d66e900: 805 us(400 us):  open_hca: device mthca0 not found

cluster.hpc.org:432c:d66e900: 857 us(52 us):  open_hca: device mthca0 not found

cluster.hpc.org:432c:d66e900: 904 us(47 us):  open_hca: device ipath0 not found

cluster.hpc.org:432c:d66e900: 985 us(81 us):  open_hca: device ipath0 not found

compute-0-1.local:10a4:f143d720: 823 us(396 us):  open_hca: device mthca0 not found

compute-0-1.local:10a3:cd936720: 838 us(410 us):  open_hca: device mthca0 not found

compute-0-1.local:10a3:cd936720: 885 us(47 us): cluster.hpc.org:432c:d66e900: 1061 us(76 us):  open_hca: device ehca0 not found

CMA: no RDMA devices found

cluster.hpc.org:432b:6b519900: 19 us(19 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432b:6b519900: 41 us(22 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432b:6b519900: 53 us(12 us):  open_hca: device mthca0 not found

cluster.hpc.org:432b:6b519900: 66 us(13 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

cluster.hpc.org:432b:6b519900: 1291 us(321 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e1:c0d34720: 348 us(348 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e1:c0d34720: 519 us(171 us):  compute-0-0.local:13e2:df835720: 279 us(279 us):  open_hca: device  mlx4_0 not found

open_hca: device mlx4_0 not found

compute-0-1.local:10a4:f143d720: 895 us(72 us):  open_hca: device mthca0 not found

open_hca: device mthca0 not found

compute-0-1.local:10a4:f143d720: 938 us(43 us):  open_hca: device ipath0 not found

compute-0-1.local:10a3:cd936720: 955 us(70 us):  open_hca: device ipath0 not found

compute-0-1.local:10a3:cd936720: 998 us(43 us):  compute-0-1.local:10a4:f143d720: 1008 us(70 us):  open_hca: device  ipath0 not found

open_hca: device ipath0 not found

compute-0-1.local:10a4:f143d720: 1053 us(45 us):  open_hca: device ehca0 not found

compute-0-1.local:10a3:cd936720: 1067 us(69 us):  open_hca: device ehca0 not found

CMA: no RDMA devices found

compute-0-0.local:13e0:eaa59720: 349 us(349 us):  compute-0-0.local:13e5:991da720: 290 us(290 us):  open_hca: device  mlx4_0 not found

compute-0-0.local:13e5:991da720: 350 us(60 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432b:6b519900: 1341 us(50 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e2:df835720: 339 us(60 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-1.local:10a1:1d7db720: 1238 us(675 us):  open_hca: device mthca0 not found

compute-0-1.local:10a4:f143d720: 18 us(18 us): compute-0-1.local:10a3:cd936720: 17 us(17 us):  open_hca: device mlx4_0 not found

open_hca: device mlx4_0 not found

cluster.hpc.org:432c:d66e900: 18 us(18 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432c:d66e900: 79 us(61 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432c:d66e900: 92 us(13 us):  open_hca: device mthca0 not found

cluster.hpc.org:432c:d66e900: 106 us(14 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-1.local:10a3:cd936720: 37 us(20 us):  compute-0-1.local:10a1:1d7db720: 1304 us(66 us):  open_hca: device  mthca0 not found

open_hca: device mlx4_0 not found

compute-0-1.local:10a4:f143d720: 61 us(43 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a4:f143d720: 73 us(12 us): compute-0-1.local:10a3:cd936720: 74 us(37 us):  open_hca: device mthca0 not found

open_hca: device mthca0 not found

compute-0-1.local:10a4:f143d720: 98 us(25 us):  open_hca: device mthca0 not found

compute-0-1.local:10a1:1d7db720: 1347 us(43 us):  open_hca: device ipath0 not found

compute-0-1.local:10a3:cd936720: 112 us(38 us): CMA: no RDMA devices found

open_hca: device mthca0 not found

CMA: no RDMA devices found

compute-0-1.local:10a1:1d7db720: 1388 us(41 us):  open_hca: device ipath0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-1.local:10a1:1d7db720: 1437 us(49 us): CMA: no RDMA devices found

compute-0-1.local:10a4:f143d720: 1447 us(394 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432c:d66e900: 1597 us(536 us):  open_hca: device mlx4_0 not found

cluster.hpc.org:432c:d66e900: 1650 us(53 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e0:eaa59720: 535 us(186 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-0.local:13e1:c0d34720: 998 us(479 us):  open_hca: device mthca0 not found

compute-0-0.local:13e1:c0d34720: 1047 us(49 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

compute-0-0.local:13e1:c0d34720: 1091 us(44 us):  open_hca: device ipath0 not found

compute-0-0.local:13e1:c0d34720: 1134 us(43 us):  open_hca: device ipath0 not found

CMA: no RDMA devices found

compute-0-0.local:13e0:eaa59720: 1052 us(517 us):  open_hca: device mthca0 not found

open_hca: device ehca0 not found

CMA: no RDMA devices found

compute-0-1.local:10a3:cd936720: 1489 us(422 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a4:f143d720: 1492 us(45 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a3:cd936720: 1534 us(45 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a1:1d7db720: 18 us(18 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a1:1d7db720: 40 us(22 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a2:9e4fe720: 690 us(690 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e0:eaa59720: 1174 us(122 us):  open_hca: device mthca0 not found

compute-0-0.local:13e0:eaa59720: 1278 us(104 us):  open_hca: device ipath0 not found

compute-0-0.local:13e0:eaa59720: 1383 us(105 us):  compute-0-0.local:13e1:c0d34720: 1180 us(46 us):  open_hca: device ehca0  not found

CMA: no RDMA devices found

compute-0-0.local:13e2:df835720: 1009 us(670 us):  open_hca: device mthca0 not found

compute-0-0.local:13e2:df835720: 1118 us(109 us):  compute-0-0.local:13e1:c0d34720: 19 us(19 us):  open_hca: device mlx4_0  not found

open_hca: device mthca0 not found

compute-0-1.local:10a1:1d7db720: 51 us(11 us):  open_hca: device mthca0 not found

compute-0-1.local:10a1:1d7db720: 63 us(12 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-1.local:10a2:9e4fe720: 766 us(76 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a1:1d7db720: 1791 us(354 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a1:1d7db720: 1837 us(46 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e1:c0d34720: 41 us(22 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e3:bb186720: 328 us(328 us):  compute-0-0.local:13e1:c0d34720: 72 us(31 us):  open_hca: device mthca0  not found

open_hca: device mlx4_0 not found

compute-0-0.local:13e1:c0d34720: 105 us(33 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

compute-0-0.local:13e3:bb186720: 413 us(85 us): CMA: no RDMA devices found

open_hca: device mlx4_0 not found

compute-0-0.local:13e1:c0d34720: 1582 us(402 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e2:df835720: 1388 us(270 us):  open_hca: device ipath0 not found

compute-0-0.local:13e0:eaa59720: 1486 us(103 us):  open_hca: device ehca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-1.local:10a2:9e4fe720: 1153 us(387 us):  open_hca: device mthca0 not found

compute-0-0.local:13e0:eaa59720: 16 us(16 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e1:c0d34720: 1649 us(67 us):  open_hca: device mlx4_0 not found

open_hca: device ipath0 not found

compute-0-0.local:13e2:df835720: 1520 us(132 us):  open_hca: device ipath0 not found

compute-0-1.local:10a2:9e4fe720: 1200 us(47 us):  open_hca: device mthca0 not found

compute-0-1.local:10a2:9e4fe720: 1244 us(44 us):  open_hca: device ipath0 not found

compute-0-1.local:10a2:9e4fe720: 1301 us(57 us):  open_hca: device ipath0 not found

compute-0-0.local:13e2:df835720: 1628 us(108 us): CMA: no RDMA devices found

open_hca: device ehca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-0.local:13e3:bb186720: 911 us(498 us):  open_hca: device mthca0 not found

compute-0-0.local:13e3:bb186720: 979 us(68 us):  open_hca: device mthca0 not found

compute-0-0.local:13e0:eaa59720: 97 us(81 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e0:eaa59720: 168 us(71 us):  open_hca: device mthca0 not found

compute-0-0.local:13e0:eaa59720: 239 us(71 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-1.local:10a2:9e4fe720: 1352 us(51 us):  open_hca: device ehca0 not found

CMA: no RDMA devices found

compute-0-1.local:10a2:9e4fe720: 16 us(16 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a2:9e4fe720: 44 us(28 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a2:9e4fe720: 57 us(13 us):  open_hca: device mthca0 not found

compute-0-1.local:10a2:9e4fe720: 70 us(13 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-0.local:13e0:eaa59720: 2194 us(708 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e3:bb186720: 1042 us(63 us):  open_hca: device ipath0 not found

compute-0-0.local:13e3:bb186720: 1127 us(85 us):  open_hca: device ipath0 not found

compute-0-1.local:10a2:9e4fe720: 1707 us(355 us):  open_hca: device mlx4_0 not found

compute-0-1.local:10a2:9e4fe720: 1755 us(48 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e0:eaa59720: 2300 us(106 us):  open_hca: device mlx4_0 not found

open_hca: device mlx4_0 not found

compute-0-0.local:13e3:bb186720: 1207 us(80 us):  open_hca: device ehca0 not found

compute-0-0.local:13e2:df835720: 51 us(51 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

compute-0-0.local:13e2:df835720: 93 us(42 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e2:df835720: 167 us(74 us):  open_hca: device mthca0 not found

compute-0-0.local:13e2:df835720: 239 us(72 us):  compute-0-0.local:13e3:bb186720: 16 us(16 us):  open_hca: device mthca0  not found

open_hca: device mlx4_0 not found

compute-0-0.local:13e3:bb186720: 74 us(58 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-0.local:13e5:991da720: 2757 us(2407 us):  open_hca: device mthca0 not found

compute-0-0.local:13e5:991da720: 2863 us(106 us):  open_hca: device mthca0 not found

compute-0-0.local:13e3:bb186720: 123 us(49 us):  open_hca: device mthca0 not found

compute-0-0.local:13e3:bb186720: 156 us(33 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-0.local:13e2:df835720: 2606 us(978 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e3:bb186720: 1748 us(541 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e3:bb186720: 1824 us(76 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e5:991da720: 2964 us(101 us):  open_hca: device ipath0 not found

compute-0-0.local:13e5:991da720: 3010 us(46 us):  open_hca: device ipath0 not found

compute-0-0.local:13e2:df835720: 2727 us(121 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e4:5605c720: 271 us(271 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e4:5605c720: 329 us(58 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e5:991da720: 3064 us(54 us):  open_hca: device ehca0 not found

CMA: no RDMA devices found

compute-0-0.local:13e5:991da720: 16 us(16 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e5:991da720: 36 us(20 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-0.local:13e4:5605c720: 663 us(334 us):  open_hca: device mthca0 not found

compute-0-0.local:13e4:5605c720: 726 us(63 us):  open_hca: device mthca0 not found

compute-0-0.local:13e4:5605c720: 770 us(44 us):  open_hca: device ipath0 not found

compute-0-0.local:13e4:5605c720: 815 us(45 us):  open_hca: device ipath0 not found

compute-0-0.local:13e4:5605c720: 859 us(44 us):  open_hca: device ehca0 not found

compute-0-0.local:13e5:991da720: 48 us(12 us):  open_hca: device mthca0 not found

compute-0-0.local:13e5:991da720: 61 us(13 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-0.local:13e5:991da720: 3391 us(327 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e5:991da720: 3437 us(46 us):  open_hca: device mlx4_0 not found

CMA: no RDMA devices found

compute-0-0.local:13e4:5605c720: 16 us(16 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e4:5605c720: 37 us(21 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e4:5605c720: 49 us(12 us):  open_hca: device mthca0 not found

compute-0-0.local:13e4:5605c720: 62 us(13 us):  open_hca: device mthca0 not found

CMA: no RDMA devices found

CMA: no RDMA devices found

compute-0-0.local:13e4:5605c720: 1175 us(316 us):  open_hca: device mlx4_0 not found

compute-0-0.local:13e4:5605c720: 1223 us(48 us):  open_hca: device mlx4_0 not found

APPLICATION TERMINATED WITH THE EXIT STRING: Hangup (signal 1)

hope someone could help me with this problem...

regard

wafi

uitm shah alam

malaysia