CTSS 4 Built and Test Readiness

From TeraGrid Wiki

Jump to: navigation, search

1 Deploy Build & Test Framework
- 1.1 Central Deployment
- 1.2 Resource Provider Deployments
2 Deployment Issues
- 2.1 PSC Rachel

[edit]

Deploy Build & Test Framework

The abbreviation "BT" in this document referes to the Build & Test framework and software.

[edit]

Central Deployment

Central BT deployment activities and status.

Component	Date deployed	Contact
Central BT Software	September 9, 2006	Charles Bacon
Central Pool	October 4, 2006	JP Navarro
Central BT Web Interface	October 4, 2006	Charles Bacon

[edit]

Resource Provider Deployments

[edit]

BT Related Preparations

In order to run the BT system on a resource, resource providers need to:

Identify a BT launch method
Deploy tgresid 2.0.x
Deploy SoftEnv 1.6.2 as the default production version
Install Condor 6.9.1 as non-default available software (no services)
Allow inbound udp/tcp connections from 192.5.198/24 to port range 50000,51000 of hosts where software builds will happen:
- c0-101 for lonestar, thunderbolt for BigRed
- The GRAM host for resources that specified a GRAM Fork Build & Test launch method
- All compute nodes for resources that specified a GRAM Batch Build & Test launch method

The BT launch methods, in order of preference are:

GRAM/Batch: person building software submits a GRAM job that runs BT Condor on the node assigned by the scheduler.
GRAM/Fork: person building software submits a GRAM fork to run BT Condor on the GRAM front-end node.
Interactive: person building software logs in via gsissh to a login or other designated node(s) and starts BT Condor by hand.

[edit]

RP Status, Launch Method

The following table lists the deployment status of each TeraGrid resource.

Platform	Resource	Launch Method	SoftEnv 1.6.2 check-off date/person	Condor 6.9.1 check-off date/person
aix-5.2	datastar.sdsc.teragrid.org	GRAM/Batch	Mar 28 2007/Tony Vu	Feb 14 2007/Tony Vu
aix-5.3	copper.ncsa.teragrid.org	GRAM/Batch	Apr 25 2007 / Doru Marcusiu	Jan 22 2007 / Doru Marcusiu

linux-redhat_9-ia32	tungsten.ncsa.teragrid.org	GRAM/Batch	May 31 2007 / Doru Marcusiu	Jan 22 2007 / Doru Marcusiu

linux-rhel4-x86_64	abe.ncsa.teragrid.org	GRAM/Batch	May 31 2007 / Doru Marcusiu	May 31 2007 / Doru Marcusiu
linux-rhel4-x86_64	lear.purdue.teragrid.org	GRAM/Batch	March 12, 2007/Preston Smith	March 12, 2007/Preston Smith
linux-rhel4-x86_64	lonestar.tacc.teragrid.org	Interative on c0-101 by way of lonestar	Mar 1 2007 / David Carver	Feb 5 2007 / David Carver

linux-sles8-ia32	dtf.uc.teragrid.org	GRAM/Batch	Feb 28 2007 / Jason Hedden	Jan 17 2007 / Jason Hedden

linux-sles8-ia64	cobalt.ncsa.teragrid.org	GRAM/Batch	Apr 11 2007 / Doru Marcusiu	Jan 22 2007 / Doru Marcusiu
linux-sles8-ia64	dtf.ncsa.teragrid.org	GRAM/Batch	Mar 15 2007 / Doru Marcusiu	Jan 22 2007 / Doru Marcusiu
linux-sles8-ia64	dtf.sdsc.teragrid.org	GRAM/Batch	Mar 15 2007 / Tony Vu	Feb 14 2007/Tony Vu
linux-sles8-ia64	dtf.uc.teragrid.org	GRAM/Batch	Feb 28 2007 / Jason Hedden	Jan 17 2007 / Jason Hedden

linux-sles9-ppc64	bigred.iu.teragrid.org	GRAM/Fork	March 6, 2007/Mike Lowe	Feb 20, 2007/Mike Lowe
linux-sles9-ppc64	frost.ncar.teragrid.org	GRAM/Fork	March 9th, 2007 / Jason Cope	March 27th, 2007 / Jason Cope
linux-sles9-ppc64	intimidata.sdsc.teragrid.org	GRAM/Fork	March 1 2007 / John White	March 30 2007 / John White

linux-sles9-x86_64	bigben.psc.teragrid.org	Interactive on thunderbolt	March 5 2007 / Aaron Shelmire	March 5 2007 / Aaron Shelmire

linux-suse_10.2-ia32	nstg.ornl.teragrid.org	GRAM/Batch	March 15, 2007/Greg Pike	Jan 31 2007/Greg Pike

solaris-9	maverick.tacc.teragrid.org	GRAM/Batch	Mar 1 2007 / David Carver	Feb 5 2007 / David Carver

osf	rachel.psc.teragrid.org	GRAM/Batch	March 9 2007 / Aaron Shelmire	March 5 2007 / Aaron Shelmire

[edit]

Globus Build Related Preparations

In order to build Globus software TeraGrid platforms must have the following pre-requisites installed:

Java 1.4.2 or 1.5.x (satisfied by CTSS 3 Java 1.4.2)
Apache Ant 1.6.5 (satisfied by CTSS 3 Apache Ant)
GNU make, patch, sed, tar
- On AIX 5.2 and 5.3: Flex 2.5.4a, Perl 5.8.5, Bison 1.25, VAC 6, VACPP 6, zlib 1.2.2
- On Solaris 9: m4 1.4.1, Flex 2.5.4a, Perl 5.8.5, byacc 1.9, gzip 1.2.4, gcc 3.4.3, coreutils 5.2.1

The following table lists the deployment status of Globus build pre-requisites on TeraGrid resources. In the GNU tools column enter either a SoftEnv key that provides access to GNU and other AIX 5.2 and Solaris 9 tools shown above, or the word default if the GNU tools are in the default environment.

Platform	Resource	Java SoftEnv key	Ant SoftEnv key	GNU tools
aix-5.2	datastar.sdsc.teragrid.org
aix-5.3	copper.ncsa.teragrid.org	+java-1.4.2	+apache-ant-1.6.5	default

linux-redhat_9-ia32	tungsten.ncsa.teragrid.org	+java-1.4.2_04 (not the default)	+apache-ant-1.6.5	default

linux-rhel4-x86_64	abe.ncsa.teragrid.org	+java-1.4.2_14	+apache-ant-1.6.5	default
linux-rhel4-x86_64	lear.purdue.teragrid.org	+java-1.4.2 (not the default)	+apache-ant-1.6.5-r1	default
linux-rhel4-x86_64	lonestar.tacc.teragrid.org	+java-1.4.2 +java-1.5.0	+apache-ant-1.6.5-r1	default

linux-sles8-ia32	dtf.uc.teragrid.org	+java-1.4.2_13-r1	+apache-ant-1.6.5-r1	default

linux-sles8-ia64	cobalt.ncsa.teragrid.org	+java-hotspot	+apache-ant-1.6.5	default
linux-sles8-ia64	dtf.ncsa.teragrid.org	+java-1.4.2	+apache-ant-1.6.5	default
linux-sles8-ia64	dtf.sdsc.teragrid.org
linux-sles8-ia64	dtf.uc.teragrid.org	+java-1.4.2_13-r1	+apache-ant-1.6.5-r1	default

linux-sles9-ppc64	bigred.iu.teragrid.org	+java	+apache-ant	default
linux-sles9-ppc64	frost.ncar.teragrid.org	+java	+apache-ant	default
linux-sles9-ppc64	intimidata.sdsc.teragrid.org

linux-sles9-x86_64	bigben.psc.teragrid.org	+java-1.4.2	+apache-ant-1.6.5-r1	default


linux-suse_10.2-ia32	nsgw.ornl.teragrid.org

solaris-9	maverick.tacc.teragrid.org	+java-1.4.2 +java-1.5.0	+apache-ant-1.6.5-r1	default

osf	rachel.psc.teragrid.org	+java-1.4.2	+apache-ant-1.6.5-r1	gcc and patch in default; have gmake and gtar; gnu sed is not available