Loading...
 
ESA > Join & Share > EO Resources > Grid Processing On Demand
Print

Grid Processing On Demand

http://gpod.eo.esa.int/

The ESA G-POD entered into operation in 2004 as a strong and powerful infrastructure dedicated to assist the generation of scientific value-added products. The platform supports all the earth science requirements, most of all in terms of providing near real-time processing of historical and multisource EO mission data.

Thanks to G-POD, scientists can create high-level products, in a shorter time and with less costs and efforts. How? Just browsing the G-POD Web Portal: a flexible, secure, generic and distributed platform, where users can configure, define, execute and monitor services through simple visualisation interfaces.

Image
 Img.1: Example of product realized through the G-POD Platform

G-POD Milestones

How to Create a G-pod Service

1.Proposal: Scientist submits an Application Description

2.Design:  Scientist designs processor modules and related data flows       

       - G-POD Team designs the application (encapsulation)

3.Implementation: Scientist develops/adapts processor modules 

       - G-POD Team integrates processor into a G-POD service 

       - Scientist analyses results

4.Exploitation: Scientist keeps Intellectual Property Rights       

       - G-POD Team exploits the service

G-Pod      G-Pod

 

G-POD resources

  • ESRIN Site
  • Over 350 CPU in about 70 Worker Nodes
  • Over 330 TB of local on-line Storage plus 180 TB of EO data accessed directly from the PACs.
  • Access to Cloud processing and data resources on demand (from Amazon and other providers)
  • UK-PAC Site
  • Internal dedicated 1 Gbit LAN at ESRIN and at UK-PAC archives
  • 100 Mbps external connection
  • HiSEEN WAN to PACs
  • GPOD Baseline OS: Scientific Linux 5.5 64bits
  • Software Resources on-line: IDL, Matlab, BEAT, BEAM, BEST, CQFD, NEST, BRAT
  • Middleware Globus Toolkit 4.2.1

TOTAL on-line data : ~300 TB

Trend: 10% yearly increment

G-POD interoperability

In addition to end-user services, G-POD fully exposes all its services via:

Third Party application can, therefore, embed G-POD services using service orchestration.

For specific projects, G-POD can also interoperation and standard GRID-level; offering access to data resources and processing capabilities using protocols like GRAM (Job control), GridFTP (data transfer) and GSI-HTTPS.


Contributors to this page:

livia ranieri .

Page last modified on Sunday 12 of October 2014 14:06:08 CEST by .