Site BDII,CE and WN Installation
From EUAGwiki
Contents |
[edit] Slides
Media:Site_BDII,_CE_and_WN_Installation_09.pdf
[edit] Pre-Installation
Please refer to Site_Pre-Installation to prepare and set up your machine for gLite middleware installation.
[edit] Host Certificates
All nodes except UI, WN and BDII require the host certificate/key files to be installed.
Contact your national Certification Authority (CA) to obtain a host certificate if you do not have one already.
make sure to place the two files in the target node into the /etc/grid-secutiry directory and check the access right for hostkey.pem is only readable by root and that the public key, hostcert.pem, is readable by everybody.
[edit] Install Site BDII, CE and WN RPMs
1. The middleware repositories
$ cd /etc/yum.repos.d/ $ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/lcg-CE.repo $ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-WN.repo $ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-BDII.repo $ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-TORQUE_client.repo $ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-TORQUE_server.repo $ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-TORQUE_utils.repo
2. Install Site BDII, CE and WN RPMs and YAIM configuration tool
$ yum install lcg-CE glite-WN glite-BDII glite-TORQUE_client glite-TORQUE_server glite-TORQUE_utils
[edit] Modify site-info.def
Media:Example_of_site-info.def.txt
Customized configuration variables to fit your site.
1. Refer to the following wiki pages to modify site-info.def parameters:
- https://twiki.cern.ch/twiki/bin/view/LCG/Site-info_configuration_variables#BDII
- https://twiki.cern.ch/twiki/bin/view/LCG/Site-info_configuration_variables#lcg_CE
- https://twiki.cern.ch/twiki/bin/view/LCG/Site-info_configuration_variables#WN
2. You can use ASGC top BDII in your site-info.def:
- BDII_HOST:bdii.grid.sinica.edu.tw
3. Enable EUAsia VO support
4. Modify wn-list.conf, delete the defult value(wnxx.my.domain)inside and append the host name of your work nodes into it.
$cp /opt/glite/yaim/examples/wn-list.conf /opt/glite/yaim/etc/ $vi /opt/glite/yaim/etc/wn-list.conf
[edit] Configure Site BDII, CE and WN by YAIM
1. Check syntax of our site-info.def
$ source /opt/glite/yaim/etc/site-info.def
2. Verify your site-info.def
$ /opt/glite/yaim/bin/yaim -v -s site-info.def -n BDII_site -n glite-WN -n TORQUE_client -n lcg-CE -n TORQUE_server -n TORQUE_utils
3. Run YAIM to configure site BDII, CE and WN services
$ /opt/glite/yaim/bin/yaim -c -s site-info.def -n BDII_site -n glite-WN -n TORQUE_client -n lcg-CE -n TORQUE_server -n TORQUE_utils
[edit] Test
[edit] Port check
1. Use the netstat command to see what services are listening on which ports.
$ netstat -tnlp 2119: edg-gatekeeper: globus gatekeeper service 9002: glite-lb-logd: workload manager logging daemon 40559,40560: maui: maui scheduler 15004: maui: maui scheduler 15001: pbs_server: Local Resource Management System 2170: bdii-fwd: Site BDII (GIIS) 2171, 2172 slapd 2811: ftpd: globus ftp daemon 22: sshd: ssh daemon 15002, 15003: pbs_mon: Local Resource Management System
[edit] Site BDII function
1. check the information published in site BDII,
$ ldapsearch -x -H ldap://<CE hostname>:2170 -b o=grid
[edit] CE and WN functions
1. batch system
Check maui service status (CE service)
$ service maui status maui (pid 22593) is running...
Check pbs_server status (CE service)
$ service pbs_server status pbs_server (pid 22524) is running...
Check pbs_mom (WN service)
$ service pbs_mom status pbs_mom (pid 17493) is running...
Check WN status
$ pbsnodes -a
ce.euag.org
state = free
np = 1
properties = lcgpro
ntype = cluster
status = opsys=linux,uname=Linux ce.euag.org 2.6.9-89.EL.cernsmp #1 SMP Wed Jun 3 13:16:24 CEST 2009 i686,sessions=2442 22100,nsessions=2,nusers=1,idletime=110,totmem=2610844kb,availmem=2440696kb,physmem=514372kb,ncpus=1,loadave=0.12,netload=656714151,state=free,jobs=,varattr=,rectime=1246957383
wnb.euag.org
state = free
np = 1
properties = lcgpro
ntype = cluster
status = opsys=linux,uname=Linux wnb.euag.org 2.6.9-89.EL.cernsmp #1 SMP Wed Jun 3 13:16:24 CEST 2009 i686,sessions=? 0,nsessions=? 0,nusers=0,idletime=87966,totmem=2610844kb,availmem=2560060kb,physmem=514372kb,ncpus=1,loadave=0.00,netload=251240054,state=free,jobs=,varattr=,rectime=1246957392
wnc.euag.org
state = free
np = 1
properties = lcgpro
ntype = cluster
status = opsys=linux,uname=Linux wnc.euag.org 2.6.9-89.EL.cernsmp #1 SMP Wed Jun 3 13:16:24 CEST 2009 i686,sessions=? 0,nsessions=? 0,nusers=0,idletime=84521,totmem=2610844kb,availmem=2560088kb,physmem=514372kb,ncpus=1,loadave=0.00,netload=247587270,state=free,jobs=,varattr=,rectime=1246957390
2. Test on CE
Change to a regular account on CE.
$su - euasia001
Create a script, named test.sh
$vi test.sh #!/bin/sh sleep 10 hostname
Save it and set the permission of execution.
$chmod 700 test.sh
Submit job to queue
$qsub -q euasia test.sh
Check job status
$qstat -a
Check job output
$cat test.sh.o<x> $cat test.sh.e<x> (in case of any error msg)
3. Remote test (On UI)
a. login UI
b. Create voms proxy
$ voms-proxy-init --voms euasia
Test GRAM Authentication: gloubusrun –a –r <CE_hostname>
$ globusrun -a -r ce.euag.org
Submitting GRAM jobs : globus-job-run <CE_HOST> <COMMAND>
$ globus-job-run ce.euag.org/jobmanager-lcgpbs -queue euasia `which hostname`
wnc.euag.org
[edit] Reference
Simple job submission on the Grid http://aproc.twgrid.org/index.php?option=com_content&task=view&id=14&Itemid=33
Generic Installation and Configuration Guide for gLite 3.1: https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide310
Site testing: http://lists.grid.sinica.edu.tw/apwiki/Installation/Site_Testing
