Master server BPTESTBPCD Output :-
=====================================
chev1bkp2{root}# bptestbpcd -client cspa1v12 -verbose
1 1 1
194.51.183.81:52825 -> 10.6.74.26:13724
194.51.183.81:52826 -> 10.6.74.26:13724
PEER_NAME = chev1bkp2
HOST_NAME = cspa1v12
CLIENT_NAME = cspa1v12
VERSION = 0x06500000
PLATFORM = hpia64
PATCH_VERSION =
SERVER_PATCH_VERSION =
MASTER_SERVER = chev1bkp2
EMM_SERVER = chev1bkp2
194.51.183.81:52827 -> 10.6.74.26:13724
chev1bkp2{root}# bptestbpcd -client cspa1v12 -debug
08:51:29.137 [27473] <2> bptestbpcd: VERBOSE = 0
08:51:29.164 [27473] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2048: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
08:51:29.164 [27473] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2062: service: bpcd
08:51:29.227 [27473] <2> logconnections: BPCD CONNECT FROM 194.51.183.81.52854 TO 10.6.74.26.13724
08:51:29.229 [27473] <2> vnet_connect_to_vnetd_extra: vnet_vnetd.c.182: msg: VNETD CONNECT FROM 194.51.183.81.52855 TO 10.6.74.26.13724 fd = 5
08:51:29.249 [27473] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.535: VN_REQUEST_CONNECT_FORWARD_SOCKET: 10 0x0000000a
08:51:29.310 [27473] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.552: ipc_string: /tmp/vnet-09604366786303751396000000000-a09604
1 1 1
194.51.183.81:52854 -> 10.6.74.26:13724
194.51.183.81:52855 -> 10.6.74.26:13724
08:51:29.411 [27473] <2> vnet_connect_to_vnetd_extra: vnet_vnetd.c.182: msg: VNETD CONNECT FROM 194.51.183.81.52856 TO 10.6.74.26.13724 fd = 6
08:51:29.429 [27473] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.535: VN_REQUEST_CONNECT_FORWARD_SOCKET: 10 0x0000000a
08:51:29.490 [27473] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.552: ipc_string: /tmp/vnet-09605366786303931418000000000-a09605
194.51.183.81:52856 -> 10.6.74.26:13724
<2>bptestbpcd: EXIT status = 0
08:51:29.521 [27473] <2> bptestbpcd: EXIT status = 0
========================================================================
Media server BPTESTBPCD output:-
=============================================
Master server BPTESTBPCD Output :-
root@csbkpms1 # ./bptestbpcd -client cspa1v12 -verbose
<16>bptestbpcd main: Function ConnectToBPCD(cspa1v12) failed: 23
socket read failed
root@csbkpms1 # ./bptestbpcd -client cspa1v12 -debug
08:57:09.142 [27668] <2> bptestbpcd: VERBOSE = 1
08:57:09.204 [27668] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2048: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
08:57:09.204 [27668] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2062: service: bpdbm
08:57:09.314 [27668] <2> logconnections: BPDBM CONNECT FROM 10.6.74.124.59878 TO 194.51.183.81.13724
08:57:09.633 [27668] <2> db_getCLIENT: db_CLIENTreceive: no entity was found 227
08:57:09.654 [27668] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2048: VN_REQUEST_SERVICE_SOCKET: 6 0x00000006
08:57:09.654 [27668] <2> vnet_vnetd_service_socket: vnet_vnetd.c.2062: service: bpcd
08:57:09.707 [27668] <2> logconnections: BPCD CONNECT FROM 10.6.74.124.59879 TO 10.6.74.26.13724
08:57:09.708 [27668] <2> vnet_connect_to_vnetd_extra: vnet_vnetd.c.182: msg: VNETD CONNECT FROM 10.6.74.124.59880 TO 10.6.74.26.13724 fd = 5
08:57:09.727 [27668] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.535: VN_REQUEST_CONNECT_FORWARD_SOCKET: 10 0x0000000a
08:57:09.789 [27668] <2> vnet_vnetd_connect_forward_socket_begin: vnet_vnetd.c.552: ipc_string: /tmp/vnet-11637366786778076381000000000-a11637
08:57:09.792 [27668] <2> get_short: (2) premature end of file (byte 1)
08:57:09.792 [27668] <2> bpcr_put_vnetd_forward_socket: get_short failed: 5
08:57:09.792 [27668] <2> local_bpcr_connect: bpcr_put_vnetd_forward_socket failed: 23
08:57:09.792 [27668] <2> ConnectToBPCD: bpcd_connect_and_verify(cspa1v12, cspa1v12) failed: 23
<16>bptestbpcd main: Function ConnectToBPCD(cspa1v12) failed: 23
08:57:09.793 [27668] <16> bptestbpcd main: Function ConnectToBPCD(cspa1v12) failed: 23
<2>bptestbpcd: socket read failed
08:57:09.793 [27668] <2> bptestbpcd: socket read failed
<2>bptestbpcd: EXIT status = 23
08:57:09.793 [27668] <2> bptestbpcd: EXIT status = 23
socket read failed
root@csbkpms1 # cat /etc/hosts | grep cspa1v12
10.6.74.26 cspa1v12
==============================================================
BPCD logs on client :-
------------------------------------[root@cspa1v12 - /usr/openv/netbackup/logs/bpcd ] # cat log.042413
08:51:10.035 [9413] <2> bpcd main: offset to GMT -3600
08:51:10.041 [9413] <2> logconnections: BPCD ACCEPT FROM 194.51.183.81.52825 TO 10.6.74.26.13724
08:51:10.041 [9413] <2> bpcd main: setup_sockopts complete
08:51:10.097 [9413] <2> bpcd peer_hostname: Connection from host chev1bkp2 (194.51.183.81) port 52825
08:51:10.097 [9413] <2> bpcd valid_server: comparing chev1bkp2 and chev1bkp2
08:51:10.098 [9413] <4> bpcd valid_server: hostname comparison succeeded
08:51:10.100 [9413] <2> bpcd main: output socket port number = 1
08:51:10.101 [9413] <2> bpcd main: Duplicated vnetd socket on stderr
08:51:10.101 [9413] <2> bpcd main: <---- NetBackup 6.5 0 ------------initiated
08:51:10.101 [9413] <2> bpcd main: VERBOSE = 0
08:51:10.101 [9413] <2> bpcd main: Not using VxSS authentication with chev1bkp2
08:51:10.182 [9413] <2> bpcd main: BPCD_PEERNAME_RQST
08:51:10.227 [9413] <2> bpcd peer_hostname: Connection from host chev1bkp2 (194.51.183.81) port 52825
08:51:10.292 [9413] <2> bpcd main: BPCD_HOSTNAME_RQST
08:51:10.402 [9413] <2> bpcd main: BPCD_CLIENTNAME_RQST
08:51:10.512 [9413] <2> bpcd main: BPCD_GET_VERSION_RQST
08:51:10.622 [9413] <2> bpcd main: BPCD_GET_PLATFORM_RQST
08:51:10.732 [9413] <2> bpcd main: BPCD_GET_VERSION_RQST
08:51:10.842 [9413] <2> bpcd main: BPCD_GET_VERSION_RQST
08:51:10.952 [9413] <2> bpcd main: BPCD_GET_VERSION_RQST
08:51:11.062 [9413] <2> bpcd main: BPCD_READ_HOST_CONFIG_RQST
08:51:11.472 [9413] <2> bpcd main: BPCD_GET_STDOUT_SOCKET_RQST
08:51:11.472 [9413] <2> bpcd main: socket port number = 1
08:51:11.557 [9413] <2> bpcd main: Connected on output socket
08:51:11.557 [9413] <2> bpcd main: Skipping shutdown of send side of stdout.
08:51:11.557 [9413] <2> bpcd main: Duplicated socket on stdout
08:51:11.558 [9413] <2> bpcd main: BPCD_DISCONNECT_RQST
08:51:11.558 [9413] <2> bpcd exit_bpcd: exit status 0 ----------->exiting
08:51:43.705 [9603] <2> bpcd main: offset to GMT -3600
08:51:43.705 [9603] <2> logconnections: BPCD ACCEPT FROM 194.51.183.81.52854 TO 10.6.74.26.13724
08:51:43.705 [9603] <2> bpcd main: setup_sockopts complete
08:51:43.761 [9603] <2> bpcd peer_hostname: Connection from host chev1bkp2 (194.51.183.81) port 52854
08:51:43.761 [9603] <2> bpcd valid_server: comparing chev1bkp2 and chev1bkp2
08:51:43.762 [9603] <4> bpcd valid_server: hostname comparison succeeded
08:51:43.765 [9603] <2> bpcd main: output socket port number = 1
08:51:43.765 [9603] <2> bpcd main: Duplicated vnetd socket on stderr
08:51:43.765 [9603] <2> bpcd main: <---- NetBackup 6.5 0 ------------initiated
08:51:43.765 [9603] <2> bpcd main: VERBOSE = 0
08:51:43.765 [9603] <2> bpcd main: Not using VxSS authentication with chev1bkp2
08:51:43.855 [9603] <2> bpcd main: BPCD_GET_STDOUT_SOCKET_RQST
08:51:43.855 [9603] <2> bpcd main: socket port number = 1
08:51:43.938 [9603] <2> bpcd main: Connected on output socket
08:51:43.938 [9603] <2> bpcd main: Skipping shutdown of send side of stdout.
08:51:43.938 [9603] <2> bpcd main: Duplicated socket on stdout
08:51:43.938 [9603] <2> bpcd main: BPCD_DISCONNECT_RQST
08:51:43.938 [9603] <2> bpcd exit_bpcd: exit status 0 ----------->exiting
08:59:03.079 [11392] <2> bpcd main: offset to GMT -3600
08:59:03.079 [11392] <2> logconnections: BPCD ACCEPT FROM 10.6.74.124.59872 TO 10.6.74.26.13724
08:59:03.079 [11392] <2> bpcd main: setup_sockopts complete
08:59:03.085 [11392] <8> bpcd peer_hostname: gethostbyaddr failed : HOST_NOT_FOUND (1)
08:59:03.085 [11392] <16> bpcd peer_hostname: gethostbyaddr failed to return peer host, herrno = 1
08:59:03.085 [11392] <16> bpcd main: Couldn't get peer hostname
08:59:38.027 [11636] <2> bpcd main: offset to GMT -3600
08:59:38.028 [11636] <2> logconnections: BPCD ACCEPT FROM 10.6.74.124.59879 TO 10.6.74.26.13724
08:59:38.028 [11636] <2> bpcd main: setup_sockopts complete
08:59:38.030 [11636] <8> bpcd peer_hostname: gethostbyaddr failed : HOST_NOT_FOUND (1)
08:59:38.030 [11636] <16> bpcd peer_hostname: gethostbyaddr failed to return peer host, herrno = 1
08:59:38.030 [11636] <16> bpcd main: Couldn't get peer hostname
=================================================================
Job detailed status :-
==========================
04/23/2013 18:00:01 - requesting resource csbkpms1-hcart3-robot-tld-0
04/23/2013 18:00:01 - requesting resource chev1bkp2.NBU_CLIENT.MAXJOBS.cspa1v12
04/23/2013 18:00:01 - requesting resource chev1bkp2.NBU_POLICY.MAXJOBS.sgm_val_sapsysunix
04/23/2013 18:00:15 - granted resource chev1bkp2.NBU_CLIENT.MAXJOBS.cspa1v12
04/23/2013 18:00:15 - granted resource chev1bkp2.NBU_POLICY.MAXJOBS.sgm_val_sapsysunix
04/23/2013 18:00:15 - granted resource 002490
04/23/2013 18:00:15 - granted resource Drive08
04/23/2013 18:00:15 - granted resource csbkpms1-hcart3-robot-tld-0
04/23/2013 18:00:32 - estimated 373981 kbytes needed
04/23/2013 18:00:32 - started process bpbrm (pid=2030)
04/23/2013 18:07:53 - Error bpbrm (pid=2030) bpcd on cspa1v12 exited with status 23: socket read failed
04/23/2013 18:07:54 - Error bpbrm (pid=2030) cannot send mail because BPCD on cspa1v12 exited with status 23: socket read failed
04/23/2013 18:10:06 - mounting 002490
04/23/2013 18:10:10 - end writing
04/23/2013 18:20:43 - Error bpbrm (pid=1976) bpcd on cspa1v12 exited with status 23: socket read failed
04/23/2013 18:20:44 - Error bpbrm (pid=1976) cannot send mail because BPCD on cspa1v12 exited with status 23: socket read failed
socket read failed (23)
========================================================
Client End initial troubleshooting :-
=------------------------------------------------------------
[root@cspa1v12 - /usr/openv/netbackup/bin ] # ./bpps -x
NB Processes
------------
Shared Symantec Processes
-------------------------
root 11871 1 0 05:15:29 ? 0:00 /opt/VRTSpbx/bin/pbx_exchange
[root@cspa1v12 - /usr/openv/netbackup/bin ] # netstat -a | grep bpcd
tcp 0 0 *.bpcd *.* LISTEN
[root@cspa1v12 - /usr/openv/netbackup/bin ] # netstat -a | grep vnetd
tcp 0 0 *.vnetd *.* LISTEN
[root@cspa1v12 - /usr/openv/netbackup/bin ] # uname -a
HP-UX cspa1v12 B.11.23 U ia64 2231644394 unlimited-user license
[root@cspa1v12 - /usr/openv/netbackup/bin ] # cat version
NetBackup-HP-UX11.23 6.5
======================================================================
I have restarted the services on client but no luck.
==========================
Master server end troubleshooting :-
===========================chev1bkp2{root}# /usr/openv/netbackup/bin/admincmd/bptestbpcd -client cspa1v12
1 1 1
194.51.183.81:53325 -> 10.6.74.26:13724
194.51.183.81:53326 -> 10.6.74.26:13724
194.51.183.81:53327 -> 10.6.74.26:13724
chev1bkp2{root}# /usr/openv/netbackup/bin/admincmd/bpgetconfig -g cspa1v12 -L
Client/Master = Client of chev1bkp2
NetBackup Client Platform = HP-UX-IA64, HP-UX11.23
NetBackup Client Protocol Level = 6.5.0
Product = NetBackup
Version Name = 6.5
Version Number = 650000
NetBackup Installation Path = /usr/openv/netbackup/bin
Client OS/Release = HP-UX B.11.23
===================================================
Any suggestions ??