GLite Information system
From EUAGwiki
Contents |
[edit] Slides
Media:GLite3_information_system2.pdf
[edit] Prerequisites
- Software
- Linux user background
- laptops with an ssh client (e.g. PuTTY )
- PuTTY Download Page: http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html
- Linux user background
- User Interface
- 117.103.102.99
- Account:
- Username: UPM01~40
- Password: <Your OS Password>
[edit] lcg-infosites
The lcg-infosites command can be used as an easy way to retrieve information on Grid resources for most use cases.
This command is actually just a perl script wrapping a series of LDAP commands and was developed to allow the user to retrieve information on Grid resources for the most common cases.
Before beginning it is worth observing that "lcg-infosites" does not use your VOMS proxy certificate and hence all commands need to include the option "--vo gilda" (note that you can actually query the information for any VO supported by GILDA).
[edit] USAGE
lcg-infosites --vo <vo name> options -v <verbose level> --is <BDII to query>
[edit] lcg-infosites options
[edit] Practicals
Start by getting a list of the compute elements available in the gilda VO and the state of the associated CPU's:
[UPM02@ui ~]$ lcg-infosites --vo gilda ce
#CPU Free Total Jobs Running Waiting ComputingElement ---------------------------------------------------------- 3 3 0 0 0 ce.euag.org:2119/jobmanager-lcgpbs-gilda 26 26 0 0 0 grid010.ct.infn.it:2119/jobmanager-lcgpbs-gilda
A different set of data may be obtained by appending the option "-v 2" (nothing to do with verbose) to the previous command as is shown below
[UPM02@ui ~]$ lcg-infosites --vo gilda ce -v 2
RAMMemory Operating System System Version Processor Subcluster name ------------------------------------------------------------------------------------------------------------------------- 254704 ScientificCERNSLC Beryllium Xeon ce.euag.org 2048 ScientificSL Beryllium GenuineIntel grid010.ct.infn.it
Similarly information about the storage elements may be obtained with the command
[UPM02@ui ~]$ lcg-infosites --vo gilda se
Avail Space(Kb) Used Space(Kb) Type SEs ---------------------------------------------------------- 295110000 76082239 n.a aliserv6.ct.infn.it 27283177 3676332 n.a dpm.euag.org
It is also possible to obtain which SE is closest to which CE. The term "close" in grids can have several interpretations including physical distance apart and speed of data access (available bandwidth). The closest SE to a CE is defined by the manager of the CE. To see the closet SE to each CE use the command:
[UPM02@ui ~]$ lcg-infosites --vo gilda closeSE
Name of the CE: ce.euag.org:2119/jobmanager-lcgpbs-gilda dpm.euag.org Name of the CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-gilda aliserv6.ct.infn.it
[edit] lcg-info
The lcg-info command can list ce or se according to more complicated conditions.
This command is similar to the "lcg-infosites" except that it is used to list either CE's or SE;s satisfying a given set of conditions on their attributes and to print, for each of them, the values of a given set of attributes. This is very similar to the usage of the "Requirements" tag in a JDL file along with the command "glite-job-list-match". The "lcg-info" command can therefore be useful when constructing the "Requirements" tag in a JDL file. Note that "lcg-info" does not in most (but not all) cases need a VO to be specified.
[edit] USAGE
lcg-info [--list-ce | --list-se] [--query <query>] [--attrs <attrs>]
[edit] lcg-info options
[edit] Practicals
The first step is to view the list of attributes available for both the matching and printing aspects of "lcg-info". Run the command:
[UPM02@ui ~]$ lcg-info --list-attrs
Attribute name Glue object class Glue attribute name WorstRespTime GlueCE GlueCEStateWorstResponseTime CEAppDir GlueCE GlueCEInfoApplicationDir TotalCPUs GlueCE GlueCEInfoTotalCPUs MaxRunningJobs GlueCE GlueCEPolicyMaxRunningJobs CE GlueCE GlueCEUniqueID WaitingJobs GlueCE GlueCEStateWaitingJobs MaxCPUTime GlueCE GlueCEPolicyMaxCPUTime LRMSVersion GlueCE GlueCEInfoLRMSVersion MaxTotalJobs GlueCE GlueCEPolicyMaxTotalJobs CEStatus GlueCE GlueCEStateStatus LRMS GlueCE GlueCEInfoLRMSType CEVOs GlueCE GlueCEAccessControlBaseRule AssignedJobSlots GlueCE GlueCEPolicyAssignedJobSlots FreeCPUs GlueCE GlueCEStateFreeCPUs RunningJobs GlueCE GlueCEStateRunningJobs EstRespTime GlueCE GlueCEStateEstimatedResponseTime FreeJobSlots GlueCE GlueCEStateFreeJobSlots Cluster GlueCE GlueCEInfoHostName TotalJobs GlueCE GlueCEStateTotalJobs Priority GlueCE GlueCEPolicyPriority CEDefaultSE GlueCE GlueCEInfoDefaultSE JobManager GlueCE GlueCEInfoJobManager MaxWCTime GlueCE GlueCEPolicyMaxWallClockTime Accesspoint GlueCESEBind GlueCESEBindCEAccesspoint CloseCE GlueCESEBindGroup GlueCESEBindGroupCEUniqueID CloseSE GlueCESEBindGroup GlueCESEBindGroupSEUniqueID Root GlueSA GlueSARoot AvailableSpace GlueSA GlueSAStateAvailableSpace Path GlueSA GlueSAPath SEVOs GlueSA GlueSAAccessControlBaseRule UsedSpace GlueSA GlueSAStateUsedSpace SESite GlueSE GlueForeignKey SEType GlueSE GlueSEType SEArch GlueSE GlueSEArchitecture SEName GlueSE GlueSEName SE GlueSE GlueSEUniqueID SEPort GlueSE GlueSEPort Protocol GlueSEAccessProtocol GlueSEAccessProtocolType ArchType GlueSL GlueSLArchitectureType ServiceID GlueService GlueServiceUniqueID ServiceOwner GlueService GlueServiceOwner ServiceWSDL GlueService GlueServiceWSDL ServiceName GlueService GlueServiceName ServiceVersion GlueService GlueServiceVersion ServiceEndpoint GlueService GlueServiceEndpoint ServiceSite GlueService GlueForeignKey ServiceStatusInfo GlueService GlueServiceStatusInfo ServiceVOs GlueService GlueServiceAccessControlRule ServiceAccesspoint GlueService GlueServiceAccessPointURL ServiceURI GlueService GlueServiceURI ServiceType GlueService GlueServiceType ServiceStatus GlueService GlueServiceStatus SiteSupport GlueSite GlueSiteUserSupportContact SiteName GlueSite GlueSiteName SiteAdmin GlueSite GlueSiteSysAdminContact SiteDesc GlueSite GlueSiteDescription SiteLocation GlueSite GlueSiteLocation SiteSecurity GlueSite GlueSiteSecurityContact SiteInfo GlueSite GlueSiteOtherInfo SiteID GlueSite GlueSiteUniqueID SMPSize GlueSubCluster GlueHostArchitectureSMPSize Processor GlueSubCluster GlueHostProcessorModel PlatformArch GlueSubCluster GlueHostArchitecturePlatformType OSVersion GlueSubCluster GlueHostOperatingSystemVersion VMemory GlueSubCluster GlueHostMainMemoryVirtualSize CFP2000 GlueSubCluster GlueHostBenchmarkSF00 TmpDir GlueSubCluster GlueSubClusterTmpDir OSRelease GlueSubCluster GlueHostOperatingSystemRelease ClockSpeed GlueSubCluster GlueHostProcessorClockSpeed LogicalCPU GlueSubCluster GlueSubClusterLogicalCPUs OutboundIP GlueSubCluster GlueHostNetworkAdapterOutboundIP OS GlueSubCluster GlueHostOperatingSystemName Tag GlueSubCluster GlueHostApplicationSoftwareRunTimeEnvironment CINT2000 GlueSubCluster GlueHostBenchmarkSI00 WNTmpDir GlueSubCluster GlueSubClusterWNTmpDir CPUVendor GlueSubCluster GlueHostProcessorVendor PhysicalCPU GlueSubCluster GlueSubClusterPhysicalCPUs InboundIP GlueSubCluster GlueHostNetworkAdapterInboundIP Memory GlueSubCluster GlueHostMainMemoryRAMSize VORunningJobs GlueVOView GlueCEStateRunningJobs VOTotalJobs GlueVOView GlueCEStateTotalJobs VOWorstRespTime GlueVOView GlueCEStateWorstResponseTime VOEstRespTime GlueVOView GlueCEStateEstimatedResponseTime VOCEVOs GlueVOView GlueCEAccessControlBaseRule VOFreeJobSlots GlueVOView GlueCEStateFreeJobSlots VOWaitingJobs GlueVOView GlueCEStateWaitingJobs
One usage of "lcg-info" is to see which software packages are available on which CE's. The software packages are stored in the "Tag" attribute and can be seen by typing:
[UPM02@ui ~]$ lcg-info --vo gilda --list-ce --attrs Tag
- CE: ce.euag.org:2119/jobmanager-lcgpbs-gilda
- Tag GLITE-3_0_0
GLITE-3_1_0
LCG-2
LCG-2_1_0
LCG-2_1_1
LCG-2_2_0
LCG-2_3_0
LCG-2_3_1
LCG-2_4_0
LCG-2_5_0
LCG-2_6_0
LCG-2_7_0
R-GMA
- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-gilda
- Tag POVRAY-3.5
DEMTOOLS-1.0
CSOUND-4.13
GEANT4-6
VLC-0.7.2
EGEODE-1.0
RASTER3D
G95-3.5.0
MAGIC-6.19
CODESA3D-1.0
CYCAS-3.20
MM5-3.7
MOLSCRIPT-1.0.2
ASTRA-STK
GRELC_DAS_2_2_0
MPICH
MPI-START
GATE-1.0.0-3
MPICH
MPICH-1.2.7p1
MPI-START
MPICH
MPI_NO_SHARED_HOME
VO-gilda-scons-0.96.1
VO-gilda-OCTAVE-2.9.10
VO-gilda-ASTRA
VO-gilda-PARAVIEW-2.4
VO-gilda-MMCS-6.19-1
VO-gilda-FALIGN
VO-gilda-OCTAVE_3_2_0
VO-gilda-GNUPLOT_4_2_4
VO-gilda-MPEG2_V12
VO-gilda-OCTAVE_3_2_0
VO-gilda-GNUPLOT_4_2_4
VO-gilda-MPEG2_V12
VO-gilda-GATE-4.0.0
VO-gilda-root_v5.20.00g
Note that each value is a string and hence numerical tests on version numbers are not possible when applying matching conditions.
Next a more complex example usage of "lcg-info" is given. Suppose you wish to find all sites that support the MPICH package (details of which will be explained in a later tutorial) and display how many CPU's are available plus the other software supported on those sites. It also makes sense to filter out CE's which are not available to the gilda VO. This may be accomplished using:
[UPM02@ui ~]$ lcg-info --vo gilda --list-ce --query 'Tag=MPICH' --attrs 'FreeCPUs,Tag'
- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-gilda
- FreeCPUs 26
- Tag POVRAY-3.5
DEMTOOLS-1.0
CSOUND-4.13
GEANT4-6
VLC-0.7.2
EGEODE-1.0
RASTER3D
G95-3.5.0
MAGIC-6.19
CODESA3D-1.0
CYCAS-3.20
MM5-3.7
MOLSCRIPT-1.0.2
ASTRA-STK
GRELC_DAS_2_2_0
MPICH
MPI-START
GATE-1.0.0-3
MPICH
MPICH-1.2.7p1
MPI-START
MPICH
MPI_NO_SHARED_HOME
VO-gilda-scons-0.96.1
VO-gilda-OCTAVE-2.9.10
VO-gilda-ASTRA
VO-gilda-PARAVIEW-2.4
VO-gilda-MMCS-6.19-1
VO-gilda-FALIGN
VO-gilda-OCTAVE_3_2_0
VO-gilda-GNUPLOT_4_2_4
VO-gilda-MPEG2_V12
VO-gilda-OCTAVE_3_2_0
VO-gilda-GNUPLOT_4_2_4
VO-gilda-MPEG2_V12
VO-gilda-GATE-4.0.0
VO-gilda-root_v5.20.00g
The final stage of this tutorial is to show that "lcg-info" can also query the attributes of CE's as is shown in the below that reverses the earlier search and searches for the closest CE to the SE " aliserv6.ct.infn.it". Type
[UPM02@ui ~]# lcg-info --list-se --query 'SE=aliserv6.ct.infn.it' --attrs CloseCE
- SE: aliserv6.ct.infn.it
- CloseCE grid010.ct.infn.it:2119/jobmanager-lcgpbs-euasia
grid010.ct.infn.it:2119/jobmanager-lcgpbs-gilda
grid010.ct.infn.it:2119/jobmanager-lcgpbs-cert
[edit] If you have time left
- View the names of all the VO's supported on gilda using the "lcg-info" command and the "CEVOs" tag. Try the commands from both sections of this tutorial using a different VO.
- Visit http://goc.grid.sinica.edu.tw/gstat/
- Visit http://gridice.forge.cnaf.infn.it/Main/GridICEWork
- For example select the following set of options
- Select URL on the GILDA row
- VO view (menu)
- Select GILDA (column, far left)
- Charts
- Try also for LCG
