Site BDII,CE and WN Installation

From EUAGwiki

Jump to: navigation, search

Contents

[edit] Slides

Media:Site_BDII,_CE_and_WN_Installation_09.pdf

[edit] Pre-Installation

Please refer to Site_Pre-Installation to prepare and set up your machine for gLite middleware installation.

[edit] Host Certificates

All nodes except UI, WN and BDII require the host certificate/key files to be installed.

Contact your national Certification Authority (CA) to obtain a host certificate if you do not have one already.

ASGC CA

make sure to place the two files in the target node into the /etc/grid-secutiry directory and check the access right for hostkey.pem is only readable by root and that the public key, hostcert.pem, is readable by everybody.

[edit] Install Site BDII, CE and WN RPMs

1. The middleware repositories

$ cd /etc/yum.repos.d/
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/lcg-CE.repo
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-WN.repo
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-BDII.repo
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-TORQUE_client.repo
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-TORQUE_server.repo
$ wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-TORQUE_utils.repo

2. Install Site BDII, CE and WN RPMs and YAIM configuration tool

$ yum install lcg-CE glite-WN glite-BDII glite-TORQUE_client glite-TORQUE_server glite-TORQUE_utils

[edit] Modify site-info.def

Media:Example_of_site-info.def.txt

Customized configuration variables to fit your site.

1. Refer to the following wiki pages to modify site-info.def parameters:

2. You can use ASGC top BDII in your site-info.def:

  • BDII_HOST:bdii.grid.sinica.edu.tw

3. Enable EUAsia VO support

4. Modify wn-list.conf, delete the defult value(wnxx.my.domain)inside and append the host name of your work nodes into it.

$cp /opt/glite/yaim/examples/wn-list.conf /opt/glite/yaim/etc/
$vi /opt/glite/yaim/etc/wn-list.conf

[edit] Configure Site BDII, CE and WN by YAIM

1. Check syntax of our site-info.def

$ source /opt/glite/yaim/etc/site-info.def

2. Verify your site-info.def

$ /opt/glite/yaim/bin/yaim -v -s site-info.def -n BDII_site -n glite-WN -n TORQUE_client -n lcg-CE -n TORQUE_server -n TORQUE_utils

3. Run YAIM to configure site BDII, CE and WN services

$ /opt/glite/yaim/bin/yaim -c -s site-info.def -n BDII_site -n glite-WN -n TORQUE_client -n lcg-CE -n TORQUE_server -n TORQUE_utils

[edit] Test

[edit] Port check

1. Use the netstat command to see what services are listening on which ports.

$ netstat -tnlp
2119:                   edg-gatekeeper: globus gatekeeper service
9002:                   glite-lb-logd: workload manager logging daemon
40559,40560:      maui: maui scheduler
15004:                 maui: maui scheduler
15001:                 pbs_server: Local Resource Management System
2170:                   bdii-fwd: Site BDII (GIIS)
2171, 2172          slapd
2811:                   ftpd: globus ftp daemon
22:                       sshd: ssh daemon
15002, 15003:     pbs_mon: Local Resource Management System

[edit] Site BDII function

1. check the information published in site BDII,

$ ldapsearch -x -H ldap://<CE hostname>:2170 -b o=grid 

[edit] CE and WN functions

1. batch system

Check maui service status (CE service)

$ service maui status 
maui (pid 22593) is running...

Check pbs_server status (CE service)

$ service pbs_server status
pbs_server (pid 22524) is running...

Check pbs_mom (WN service)

$ service pbs_mom status
pbs_mom (pid 17493) is running...

Check WN status

$ pbsnodes -a
ce.euag.org
    state = free
    np = 1
    properties = lcgpro
    ntype = cluster
    status = opsys=linux,uname=Linux ce.euag.org 2.6.9-89.EL.cernsmp #1 SMP Wed Jun 3 13:16:24 CEST 2009 i686,sessions=2442 22100,nsessions=2,nusers=1,idletime=110,totmem=2610844kb,availmem=2440696kb,physmem=514372kb,ncpus=1,loadave=0.12,netload=656714151,state=free,jobs=,varattr=,rectime=1246957383
wnb.euag.org
    state = free
    np = 1
    properties = lcgpro
    ntype = cluster
    status = opsys=linux,uname=Linux wnb.euag.org 2.6.9-89.EL.cernsmp #1 SMP Wed Jun 3 13:16:24 CEST 2009 i686,sessions=? 0,nsessions=? 0,nusers=0,idletime=87966,totmem=2610844kb,availmem=2560060kb,physmem=514372kb,ncpus=1,loadave=0.00,netload=251240054,state=free,jobs=,varattr=,rectime=1246957392
wnc.euag.org
    state = free
    np = 1
    properties = lcgpro
    ntype = cluster
    status = opsys=linux,uname=Linux wnc.euag.org 2.6.9-89.EL.cernsmp #1 SMP Wed Jun 3 13:16:24 CEST 2009 i686,sessions=? 0,nsessions=? 0,nusers=0,idletime=84521,totmem=2610844kb,availmem=2560088kb,physmem=514372kb,ncpus=1,loadave=0.00,netload=247587270,state=free,jobs=,varattr=,rectime=1246957390

2. Test on CE

Change to a regular account on CE.

$su - euasia001

Create a script, named test.sh

$vi test.sh
#!/bin/sh
sleep 10
hostname

Save it and set the permission of execution.

$chmod 700 test.sh

Submit job to queue

$qsub -q euasia test.sh

Check job status

$qstat -a

Check job output

$cat test.sh.o<x>
$cat test.sh.e<x> (in case of any error msg)

3. Remote test (On UI)

a. login UI

b. Create voms proxy

$ voms-proxy-init --voms euasia

Test GRAM Authentication: gloubusrun –a –r <CE_hostname>

$ globusrun -a -r ce.euag.org

Submitting GRAM jobs : globus-job-run <CE_HOST> <COMMAND>

$ globus-job-run ce.euag.org/jobmanager-lcgpbs -queue euasia `which hostname`
     wnc.euag.org

[edit] Reference

Simple job submission on the Grid http://aproc.twgrid.org/index.php?option=com_content&task=view&id=14&Itemid=33

Generic Installation and Configuration Guide for gLite 3.1: https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide310

Site testing: http://lists.grid.sinica.edu.tw/apwiki/Installation/Site_Testing

Personal tools