Tuesday, December 18, 2007

FileTransfer Portlet Build Error

We have gotten some reports that the filetransfer portlet does not compile correctly on some machines. You will get an error like the one below.


[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Compilation failure
/opt/ogce-portal-only/portlets/filetransfer/src/main/java/xportlets/gridftp/GridFTPClientAction.java:[1046,10] putFile(java.lang.String,java.lang.String) in org.globus.cog.abstraction.interfaces.FileResource cannot be applied to (java.lang.String,java.lang.String,)


This portlet is obsolete and uses an obsolete Java COG API, so it should be disabled. As a workaround, simply delete or comment out the line

<module>portlets/filetransfer</module>

from ogce-portal-only/pom.xml. We will provide a minor update release to fix this bug.

Tuesday, December 04, 2007

Expeditious Job Submission with Condor Birdbath

You need to call the rescheduler to force jobs to run right away when using Birdbath. Code snippet is

....
xact.submit(clusterId, jobId, userName, universeType,
executable,arguments,"(TRUE)",
extraAttributes, null);
xact.commit();

//Magic line is below.
schedd.requestReschedule();

This assumes you have otherwise edited condor_config to run jobs right away (changed UWCS to TESTINGMODE). See the OGCE condor-job-submission portlet for the full code. Thanks to Sangmi for pointing this out.

Friday, November 30, 2007

Link to CIMA Production Portal

This is the production version of the portal: http://cimaportal.indiana.edu:8080/gridsphere/gridsphere

Google finds a few other versions floating around, and so I'm trying to increase this URL's page rank.

Wednesday, November 28, 2007

OGCE Portal 2.2 Released

Version 2.2 of the portal is now available. We have upgraded the RC5 release candidate to a full release. See http://www.collab-ogce.org/ogce/index.php/Portal_download.

Wednesday, November 21, 2007

Updated COG GT4 Provider Jar

The GT4 provider in the COG kit needs some configuration and property changes to work with the portal. This is now in Maven:

http://www.collab-ogce.org/maven/cog-gt4-OGCE/jars/cog-provider-gt4_0_0-2.4.jar

To see the differences, unpack this jar and compare the files
  • cog-provider.properties
  • classloader-gt4_0_0.properties
with those in the Java COG download.

Since this is now working with WS-GRAM services on the TeraGrid, I'll now roll the final Release Candidate for version 2.2 of the portal.

Friday, November 16, 2007

GCE07 and SciNET SC07 Google Capture

GCE07 made the SciNET Google search capture list. I'm not sure if this is good or bad.

http://scinet.sc07.org/security/googlesearches07.html

See also the link's parent for general information--check to see if your password was detected.

Tuesday, November 06, 2007

OGCE Web Site Updated

The revised OGCE web site (using MediaWiki) is now available. The Web server should redirect from http://www.collab-ogce.org/ogce. If you do not see the new site, trying clearing your browser cache.

Monday, November 05, 2007

NMI Testbed Dashboard

Here's an updated link to the nightly build dashboard on the NMI testbed. We still have some problems finding java stuff on several machines, but this should be corrected soon.

Thursday, November 01, 2007

Tuesday, October 30, 2007

GCE07 Workshop Program Available

The preliminary program for GCE07 at Supercomputing 2007 is available from http://www.collab-ogce.org/gce07/index.php/Program.

File Agent Service and Community File Manager

We have developed a File Manager portlet and agent service that helps manage file access in TeraGrid community accounts. This will be part of the OGCE SC07 release and is available in SVN now. See http://sangpall.blogspot.com/ for more information.

Friday, September 07, 2007

More on New Build Process

Here are the Unix commands to use the revised build:

svn co https://ogce.svn.sourceforge.net/svnroot/ogce/ogce-portal-only

cd ogce-portal-only

(Edit properties section of ogce-portal-only/pom.xml as necessary).

tar -zxf maven-2.0.7-bin.tar.gz

export PATH=`pwd`/maven-2.0.7/bin/:$PATH

mvn clean install

The portal stuff is installed under portal_deploy/apache-5.5.12. Use the little convenient scripts tomcat-startup.sh and tomcat-shutdown.sh to start and stop the server.

This needs to be tested on Windows.

Wednesday, September 05, 2007

New Build Process

The old shell script+Ant+Maven1+Maven2 build process is being replaced with a clean Maven 2 build. This is currently in SVN and will be included in the next release.

The base directory structure is now
  • portal_deploy: this contains the apache server and is location of the portal after deployment.
  • global-config: this contains Maven poms for deploying the Java COG jars into tomcat's shared/lib.
  • portlets: this contains the portlets. Each portlet is in a separate directory.
  • certificates: this installs the certificates into $HOME/.globus/certificates
  • containers: this includes various JSR 168 containers. For now, this only contains Gridsphere 2.1.5 but alternative versions of Gridsphere, Sakai, et al will be placed here.
  • lnf_portal: this directory includes container specific goals for customizing the look and feel of the logo. This includes logos, style sheets, etc.
The entire portal is installed with the command

mvn install

The portal can be cleaned completely with

mvn clean

To update an existing deployment (for example, reinstalling the filetransfer portlet), use the following command:

mvn clean install -f portlets/filetransfer/pom.xml

Friday, July 27, 2007

Re-compiling individual portlets

0. Set your $MAVEN_HOME variable, if necessary:

export MAVEN_HOME=$HOME/ogce2-x.y/third_party_tools/maven-1.0.2

1. cd to ogce2-x.y/ogce-portal

2. Then run this command below to recompile the :

$HOME/ogce2-x.y/third_party_tools/maven-1.0.2/bin/maven gp:deploy-portlet -Dportlet.name=filetransfer -Denv.CATALINA_HOME=../portal_deploy/apache-tomcat-5.5.12

The value for -Dportlet-name=... should be the specific subdirectory name of ogce-portal/portlets (ie use -Dportlet-name=proxymanager-portlet to compile the proxy manager.

Sunday, June 03, 2007

GTLAB 1.0 Beta Available

Grid Tag Libraries and Beans (GTLAB) version 1.0-Beta is available for portlet development. These are extensions to JSF to simplify the development of complicated Grid portlets for invoking science applications.

http://grids.ucs.indiana.edu/users/manacar/GTLAB-website/

OGCE2 2.1 Available for Download

We are pleased to announce the latest update to the OGCE Grid Portal release. Release 2.1 updates version 2.0.4 with support for Condor-G portlets and various minor bug and build system fixes. Downloads are available from http://www.collab-ogce.org/ogce2/

OGCE grid portlets include support for Globus GRAM and WS-GRAM, GridFTP, SRB, MyProxy, PURSe, Condor, GPIR information services, and Sakai collaboration services.

Friday, June 01, 2007

Using Condor-G Portlets

The Condor-G portlet in the next OGCE release requires a few external steps.
  1. You must install condor (version 6.8), globus, and the OGCE portal server on the same host computer.
  2. You must enable Condor birdbath, as documented on the OGCE web site, http://www.collab-ogce.org/ogce2/condor-job-submission/configuration.html.
  3. You must ensure that Condor-G is enabled in your condor installation. This is probably the case, but see instructions at http://communitygrids.blogspot.com/2006/08/about-condor.html.
  4. You must construct and publish classads for the Grid resources you want to use. The remainder of this post provides basic instructions.

Condor-G uses Condor to act as a client to Globus services. Normally, Condor daemons collect information from the entire condor flock and automatically construct Classads that are used to matchmake your job request to a particular machine. Since Globus services are not part of the flock, you must manually add these to condor on your portal server.

Here is a sample classad for condor-g:

MyType = "Machine"
TargetType = "Job"
Name = "condorTest05"
Machine = "condorTest05"
gatekeeper_url = "login-co.ncsa.teragrid.org/jobmanager"
UpdatesSequenced = 9
CurMatches = 0
Requirements = TARGET.JobUniverse == 9
Rank = 0.000000
CurrentRank = 0.000000
OpSys = "LINUX"
Arch = "INTEL"
State = "Unclaimed"
Activity = "Idle"
LoadAvg = 0.000000
Memory = 2048
WantAdRevaluate = True
StartdIpAddr = "129.79.216.5"

Replace parameters above as appropriate. The StartdIpAddr should be the IP of your portal+condor-g host machine. All other parameters describe the Globus host machine, login-co.ncsa.teragrid.org. Place these values in a file, myCondorClassAd.txt, and then publish this using the command line

[shell-prompt> condor_advertise UPDATE_STARTD_AD myCondorClassAd.txt

This classad will expire in a few minutes, so you will need to execute the above command using a cron script. Rumor has it that better tools for supporting Globus-derived classads exist.

Thursday, May 24, 2007

GFac: Wrapping Science Applications as Grid Services

The OGCE is pleased to announce the public release of the Generic Application Service Factory (a.k.a., GFac). For documentation, see

http://www.extreme.indiana.edu/gfac/userguide.html


The code can be downloaded from

http://www.extreme.indiana.edu/gfac/dist/

Wednesday, April 18, 2007

WS-GRAM Job Submission Configuration

You must provide the port number (typically 8443) for the WS-GRAM service location in your grid.installation.properties. A valid entry will be formatted like so:

firsthost.testinggrid.com:8443


If you omit the port number for a WS-GRAM service, the service invocation will work the first time only and fail on all subsequent invocations. The error message will be or will contain

Error: org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Cannot submit job: ; nested exception is: java.net.ConnectException:
Connection refused



Monday, April 09, 2007

Pom.xml Problem in Condor Portlet

The condor job submission portlet contains a call to an obsolete plugin repository that will cause compilation errors of this portlet. To solve in release version 2.0.4, comment out the plugin section near the top of the ogce2-2.0/ogce-portal/portlets/condor-job-submission2/pom.xml as shown.



<build>
<finalName>condor-job-submission2</finalName>
<plugins>
<!--
<plugin>
<groupId>org.mortbay.jetty</groupId>
<artifactId>maven-jetty6-plugin</artifactId>
<configuration>
<scanIntervalSeconds>10</scanIntervalSeconds>
</configuration>
</plugin>
-->
</plugins>
</build>

Friday, March 16, 2007

Sakai JSR 168 Portlet Support

Sakai support for JSR 168 is in the Sakai SVN trunk. For notes on checking it out, compiling, and using it, see http://communitygrids.blogspot.com/2007/03/sakai-jsr-168-tests.html. This will be officially part of the Sakai 2.4 release.

Sakai uses Pluto 1.1 for portlet support. OGCE grid portlet support in Sakai is currently being tested.

See http://www.flickr.com/photos/dr-chuck/420092745/ for a Google Map portlet photo (built with JSF and using the Apache JSF portlet bridge).

Friday, February 16, 2007

OGF 19 Forum Slides

OGCE presentation slides from the Open Grid Forum 19's Software Forum are available below.

Monday, January 15, 2007

Correction to tar download of version 2.0.4

The file
ogce2-2.0/ogce-portal/portlets/condor-job-submission/project.properties

has a typo that will cause the install script to fail if you do not also install the Maven jar repository. This has been corrected, but we will not immediately increment the version to 2.0.5.

Monday, January 08, 2007

OGCE Maven 1 and 2 Repository URLs

Here are the URLs for OGCE's Maven 1 and Maven 2 repositories: