TeraGrid 08 OGCE Tutorial Outline

Tutorial is Monday, June 9. We will make slides and material available for download.

8:30-9:30: Intro, building and using the portal, writing simple grid portlets (Marlon Pierce)

9:30-10:00: Workflow suite part 1 (Suresh Marru, Gopi Kandaswamy)

10:00-10:30: break

10:30-11:15: Worflow suite part 2 (Suresh, Gopi)

11:15-11:45: Web 2.0 for gateways (Gregor von Laszewski)

11:45-12:00: Teragrid gateway authorization requirements and GridShib (Tom Scavo)

OGCE Tutorial at TeraGrid 2008

We will give a 1/2 day tutorial on June 9th at TeraGrid 2008 in Las Vegas. For more information, see http://www.tacc.utexas.edu/tg08/index.php?m_b_c=scienceGateways.

Topics will include building and using the basic portal, using GTLAB to make Grid Web clients, using the OGCE workflow suite of tools to wrap science applications, and Web 2.0 activities for science gateways.

GPIR Service Download Available

An updated version of the Grid Portal Information Repository (GPIR) Web Service is available for download. This is a standalone repackaging of the GPIR Web Service in older OGCE portal releases.

The GPIR service powers the GPIR portlet in the main portal download. Get the GPIR service if you want to provide your own status information server for your grid.

http://www.collab-ogce.org/ogce/index.php/GPIR

Mac OSX Maven Build Errors

We have reports of the following build error on Macs:

*******************************
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD ERROR
[INFO] ------------------------------------------------------------------------
[INFO] Error building POM (may not be this project's POM).


Project ID: org.apache.maven:maven-parent:pom:5

Reason: Cannot find parent: org.apache:apache for project: org.apache.maven:maven-parent:pom:5 for project org.apache.maven:maven-parent:pom:5

*******************************

Workaround: Download and install the Maven third party jars as described in the "Download" section.

The error does not appear in the Mac nightly build dashboard, so we are trying to discover the cause.

Example OGCE Portal

A running, persistent version of the portal software is available from

https://ogceportal.iu.teragrid.org:8443/gridsphere/gridsphere

To log in, you can use the account guest/guest123. If you have a TeraGrid account and credentials in the TeraGrid MyProxy server, you can try out the user interfaces.

To get a personal account or to use this portal with other Grid deployments, contact us for assistance.

Bug Fix in GPIR Portlet

There is a minor bug fix in the GPIR portlet. Clicking machine name links in the portal served from Linux hosts produced an error because of a missing XML parsing library. The fix is available in SVN.

To update existing portals (versions 2.2.0 and 2.2.1), simply replace ogce-portal-only/portlets/gpir-portlet/pom.xml with the update from

http://ogce.svn.sourceforge.net/viewvc/ogce/ogce-portal-only/portlets/gpir-portlet/pom.xml?view=log

Spurious Tomcat Startup Errors

When starting the portal server for the first time, you will notice several errors (see below for a sample) if you are using our startup-tomcat.sh script. These are the standard errors produced by Tomcat's shutdown.sh if no server is running and can be ignored.

Our startup-tomcat.sh script first calls Tomcat's shutdown.sh before calling startup.sh. We do this to prevent accidentally starting two servers that try to use the same ports. This can be a little tricky to clean up (Tomcat's shutdown.sh may not work and you may have to use the kill command).

-bash-3.00$ ./startup-tomcat.sh
####################################
# Starting up Portal Tomcat... #
####################################
Using CATALINA_BASE: /usr/local/dev/maytal/ogce-portal-only/portal_deploy/apache-tomcat-5.5.12
Using CATALINA_HOME: /usr/local/dev/maytal/ogce-portal-only/portal_deploy/apache-tomcat-5.5.12
Using CATALINA_TMPDIR: /usr/local/dev/maytal/ogce-portal-only/portal_deploy/apache-tomcat-5.5.12/temp
Using JRE_HOME: /usr/local/dev/maytal/jdk1.5.0_14
Jan 28, 2008 12:48:29 PM org.apache.catalina.startup.Catalina stopServer
SEVERE: Catalina.stop:
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:520)
at java.net.Socket.connect(Socket.java:470)
at java.net.Socket.(Socket.java:367)
at java.net.Socket.(Socket.java:180)
at org.apache.catalina.startup.Catalina.stopServer(Catalina.java:394)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.catalina.startup.Bootstrap.stopServer(Bootstrap.java:324)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:415)
viUsing CATALINA_BASE: /usr/local/dev/maytal/ogce-portal-only/portal_deploy/apache-tomcat-5.5.12
Using CATALINA_HOME: /usr/local/dev/maytal/ogce-portal-only/portal_deploy/apache-tomcat-5.5.12
Using CATALINA_TMPDIR: /usr/local/dev/maytal/ogce-portal-only/portal_deploy/apache-tomcat-5.5.12/temp
Using JRE_HOME: /usr/local/dev/maytal/jdk1.5.0_14

FileTransfer Portlet Build Error

We have gotten some reports that the filetransfer portlet does not compile correctly on some machines. You will get an error like the one below.


[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Compilation failure
/opt/ogce-portal-only/portlets/filetransfer/src/main/java/xportlets/gridftp/GridFTPClientAction.java:[1046,10] putFile(java.lang.String,java.lang.String) in org.globus.cog.abstraction.interfaces.FileResource cannot be applied to (java.lang.String,java.lang.String,)


This portlet is obsolete and uses an obsolete Java COG API, so it should be disabled. As a workaround, simply delete or comment out the line

<module>portlets/filetransfer</module>

from ogce-portal-only/pom.xml. We will provide a minor update release to fix this bug.

Expeditious Job Submission with Condor Birdbath

You need to call the rescheduler to force jobs to run right away when using Birdbath. Code snippet is

....
xact.submit(clusterId, jobId, userName, universeType,
 executable,arguments,"(TRUE)",
 extraAttributes, null);
xact.commit();

//Magic line is below.
schedd.requestReschedule();

This assumes you have otherwise edited condor_config to run jobs right away (changed UWCS to TESTINGMODE). See the OGCE condor-job-submission portlet for the full code. Thanks to Sangmi for pointing this out.

Link to CIMA Production Portal

This is the production version of the portal: http://cimaportal.indiana.edu:8080/gridsphere/gridsphere

Google finds a few other versions floating around, and so I'm trying to increase this URL's page rank.

OGCE Portal 2.2 Released

Version 2.2 of the portal is now available. We have upgraded the RC5 release candidate to a full release. See http://www.collab-ogce.org/ogce/index.php/Portal_download.

Updated COG GT4 Provider Jar

The GT4 provider in the COG kit needs some configuration and property changes to work with the portal. This is now in Maven:

http://www.collab-ogce.org/maven/cog-gt4-OGCE/jars/cog-provider-gt4_0_0-2.4.jar

To see the differences, unpack this jar and compare the files

• cog-provider.properties
• classloader-gt4_0_0.properties

with those in the Java COG download.

Since this is now working with WS-GRAM services on the TeraGrid, I'll now roll the final Release Candidate for version 2.2 of the portal.

GCE07 and SciNET SC07 Google Capture

GCE07 made the SciNET Google search capture list. I'm not sure if this is good or bad.

http://scinet.sc07.org/security/googlesearches07.html

See also the link's parent for general information--check to see if your password was detected.

OGCE Web Site Updated

The revised OGCE web site (using MediaWiki) is now available. The Web server should redirect from http://www.collab-ogce.org/ogce. If you do not see the new site, trying clearing your browser cache.

NMI Testbed Dashboard

Here's an updated link to the nightly build dashboard on the NMI testbed. We still have some problems finding java stuff on several machines, but this should be corrected soon.

Indiana University's SC07 Booth Schedule

Portals and gateways are Tuesday: http://supercomputing.iu.edu

GCE07 Workshop Program Available

The preliminary program for GCE07 at Supercomputing 2007 is available from http://www.collab-ogce.org/gce07/index.php/Program.

File Agent Service and Community File Manager

We have developed a File Manager portlet and agent service that helps manage file access in TeraGrid community accounts. This will be part of the OGCE SC07 release and is available in SVN now. See http://sangpall.blogspot.com/ for more information.

More on New Build Process

Here are the Unix commands to use the revised build:

svn co https://ogce.svn.sourceforge.net/svnroot/ogce/ogce-portal-only

cd ogce-portal-only

(Edit properties section of ogce-portal-only/pom.xml as necessary).

tar -zxf maven-2.0.7-bin.tar.gz

export PATH=`pwd`/maven-2.0.7/bin/:$PATH

mvn clean install

The portal stuff is installed under portal_deploy/apache-5.5.12. Use the little convenient scripts tomcat-startup.sh and tomcat-shutdown.sh to start and stop the server.

This needs to be tested on Windows.

New Build Process

The old shell script+Ant+Maven1+Maven2 build process is being replaced with a clean Maven 2 build. This is currently in SVN and will be included in the next release.

The base directory structure is now

• portal_deploy: this contains the apache server and is location of the portal after deployment.
  
• global-config: this contains Maven poms for deploying the Java COG jars into tomcat's shared/lib.
  
• portlets: this contains the portlets. Each portlet is in a separate directory.
  
• certificates: this installs the certificates into $HOME/.globus/certificates
  
• containers: this includes various JSR 168 containers. For now, this only contains Gridsphere 2.1.5 but alternative versions of Gridsphere, Sakai, et al will be placed here.
  
• lnf_portal: this directory includes container specific goals for customizing the look and feel of the logo. This includes logos, style sheets, etc.

The entire portal is installed with the command

mvn install

The portal can be cleaned completely with

mvn clean

To update an existing deployment (for example, reinstalling the filetransfer portlet), use the following command:

mvn clean install -f portlets/filetransfer/pom.xml