SE Installation

From EUAGwiki

Jump to: navigation, search

1 Slide
2 Pre-Installation
3 Host Certificates
4 Install
5 Modify site-info.def
6 Configure
7 Test
- 7.1 Run test on DPM server
- 7.2 Run test on UI
8 Reference

[edit] Slide

Media:DPM_Installation.pdf

[edit] Pre-Installation

Please refer to Site_Pre-Installation to prepare and set up your machine for gLite middleware installation.

[edit] Host Certificates

All nodes except UI, WN and BDII require the host certificate/key files to be installed.

Contact your national Certification Authority (CA) to obtain a host certificate if you do not have one already.

ASGC CA

make sure to place the two files in the target node into the /etc/grid-secutiry directory and check the access right for hostkey.pem is only readable by root and that the public key, hostcert.pem, is readable by everybody.

[edit] Install

In a limited number of cases, DAG provides rpms already represent in the OS. In this case, DAG rpms are of a higher version. Normally the OS is protected from having its RPMs upgraded (protect=1). The solution is to install this RPM by hand:

cd ~/
wget 'http://linuxsoft.cern.ch/dag/redhat/el4/en/i386/RPMS.dag/perl-SOAP-Lite-0.69-1.el4.rf.noarch.rpm'
yum localinstall perl-SOAP-Lite-0.69-1.el4.rf.noarch.rpm

Add YUM repositories for glite-SE_dpm_mysql:

cd /etc/yum.repos.d/
wget http://grid-deployment.web.cern.ch/grid-deployment/glite/repos/3.1/glite-SE_dpm_mysql.repo

Install glite-SE meta package:

yum install glite-SE_dpm_mysql

[edit] Modify site-info.def

Media:Example_of_site-info.def.txt

1. Customize site-info.def with the following settings:

# Hostname of the top level BDII
BDII_HOST=bdii.grid.sinica.edu.tw
# Hostname of the DPM head node
DPM_HOST=<YOUR_DPM_SERVER_HOSTNAME_FQDN>                <== Customize here!
USERS_CONF=${INSTALL_ROOT}/glite/yaim/etc/users.conf
GROUPS_CONF=${INSTALL_ROOT}/glite/yaim/etc/groups.conf
#Your Site Name and Emails
SITE_NAME=MY-TUTOR-00                                   <== Customize here!
SITE_EMAIL="roc@lists.grid.sinica.edu.tw"
#Space separated list of SEs hostnames
SE_LIST=$DPM_HOST
#Space separated list of supported VOs by your site
VOS="euasia ops dteam"
DPMPOOL=data01                                          <== Customize here!
DPM_FILESYSTEMS="$DPM_HOST:/data01"                     <== Customize here!
DPM_DB_HOST=$DPM_HOST 
##########
# EUASIA #
##########
VO_EUASIA_SW_DIR=$VO_SW_DIR/euag
VO_EUASIA_DEFAULT_SE=$DPM_HOST
VO_EUASIA_STORAGE_DIR=$CLASSIC_STORAGE_DIR/euag
VO_EUASIA_VOMS_SERVERS="vomss://voms.grid.sinica.edu.tw:8443/voms/euasia?/euasia"
VO_EUASIA_VOMSES="'euasia voms.grid.sinica.edu.tw 15015 /C=TW/O=AS/OU=GRID/CN=voms.grid.sinica.edu.tw euasia'"
VO_EUASIA_VOMS_CA_DN="'/C=TW/O=AS/OU=GRID/CN=voms.grid.sinica.edu.tw'"
VO_EUASIA_CA_DN="'/C=TW/O=AS/CN=Academia Sinica Grid Computing Certification Authority Mercury'"

You can take a look at site-info.def parameters for DPM here: https://twiki.cern.ch/twiki/bin/view/LCG/DPM_configuration_variables

[edit] Configure

1. Check syntax of our site-info.def

source /opt/glite/yaim/etc/site-info.def

2. Verify your site-info.def

/opt/glite/yaim/bin/yaim -v -s site-info.def -n glite-SE_dpm_mysql

3. Use following YAIM command to configure your DPM head and disk

/opt/glite/yaim/bin/yaim -c -s gridXX-site-info.def -n glite-SE_dpm_mysql

4. YAIM does not make sure that mysql starts up automatically, so add mysqld to start up sequence.

chkconfig mysqld on

[edit] Test

[edit] Run test on DPM server

While on the DPM server, check which services are up and listening on network ports: netstat -tnlp

service         port
mysqld:         3306
dpnsdaemon:     5010
dpm:            5015
rfiod:          5001
GRIS:
bdii-fwd:    2170
slapd:       2171, 2172
GridFTP:        2811
srm1:           8443
srm2:           8444
srm2.2:         8446

DPM copies the original host certificates. Check the status of the copied host certificates:

ll /etc/grid-security/dpmmgr/
-rw-r--r--  1 dpmmgr dpmmgr 1103 Jul 18 06:04 dpmcert.pem
-r--------  1 dpmmgr dpmmgr  887 Jul 18 06:04 dpmkey.pem

You can also refer to dpm log files if you encounter any issues:

#DPM server
/var/log/dpm/log
#DPM Name Server
/var/log/dpns/log            
#SRM servers
/var/log/srmv1/log
/var/log/srmv2/log
#RFIO server
/var/log/rfiod/log
#DPM-enabled GridFTP
/var/log/dpm-gsiftp/gridftp.log
/var/log/dpm-gsiftp/dpm-gsiftp.log

[edit] Run test on UI

Query the DPM server to get the current status:

$ export DPM_HOST=<DPM_HOSTNAME>
$ dpm-qryconf
POOL data01 DEFSIZE 200.00M GC_START_THRESH 0 GC_STOP_THRESH 0 DEF_LIFETIME 7.0d DEFPINTIME 2.0h MAX_LIFETIME 1.0m MAXPINTIME 12.0h FSS_POLICY  maxfreespace GC_POLICY lru RS_POLICY fifo GIDS 0 S_TYPE - MIG_POLICY none RET_POLICY R
                                   CAPACITY 28.83G FREE 25.60G ( 88.8%)
       dpm.euag.org /data01 CAPACITY 28.83G FREE 25.60G ( 88.8%)

Explore the DPM name space:

$ export DPNS_HOST=grid<XX>.euag.org
$ dpns-ls -l /dpm/euag.org/home
drwxrwxr-x   2 root     104                       0 Jul 10 14:18 dteam
drwxrwxr-x   1 root     101                       0 Jul 09 09:08 euasia
drwxrwxr-x   1 root     102                       0 Jul 07 08:25 gilda
drwxrwxr-x   0 root     103                       0 Jul 06 04:30 ops

Check if your DPM is correctly publishing to the Information System:

$ ldapsearch -x -h <DPM_HOSTNAME> -p 2170 -b "mds-vo-name=resource,o=grid" | grep SAState

Try using GridFTP to copy a file to the DPM:

# copy file to DPM
$ globus-url-copy file://`pwd`/<filename>       gsiftp://<DPM_HOSTNAME>/dpm/euag.org/home/gilda/<your file name>
# copy it back with a different name
$ globus-url-copy gsiftp://<DPM_HOSTNAME>/dpm/euag.org/home/gilda/<your file name>   file://`pwd`/<filename2>
# check if there is a difference
$ diff <filename> <filename2>

Once your DPM is on a BDII, you can try lcg-* commands:

$ lcg-infosites --vo euasia se
$ lcg-cr -v -d /<DPM_HOSTNAME> -l lfn:/grid/gilda/<mylogicalname_v1>    file:/home/your_account/your_file
$ lcg-cp lfn:/grid/gilda/<mylogicalname_v1> file:/home/your_account/your_file_copy