Real-time computing. Real-time news.
December 03, 2007
All About HPC Basic Profile
1 | 2 All »
SuperComputing 2007 in Reno, Nev., saw the second “interoperability fest” involving the OGF’s HPC Basic Profile (HPCBP) specification. Groups from academia, research and industry came together to demonstrate the interoperability of the core specification and to prototype extensions to the core specification used to support more advanced capabilities, such as file staging.
High Performance Computing Basic Profile (HPCBP) Background
The HPCBP specification has been developed by the OGF’s HPC Profile Working Group over the last 18 months to define how to submit, monitor and manage jobs using standard mechanisms across different job schedulers or grid middleware from different software providers. A significant milestone was passed in August 2007 when the HPC Profile Working Group’s first specification --the HPC Basic Profile 1.0 -- was published as a proposed recommendation. As part of the process of moving the HPCBP from a proposed to a full recommendation, it is necessary to gather experiences of implementing the specification, and to demonstrate its interoperability between two or more independent implementations. The working group, comprising individuals from industry, academia and research, decided to use SC07 as the venue for an “interoperability fest” of the published specifications.
The HPCBP is focused just on managing job submission, yet it provides sufficient core functionality to enable its use as a basis for integration into applications (both desktop and Web-based), its use as a basis for meta-scheduling and its use from within workflow engines. It leverages standards developed within the OGF (the Basic Execution Service and the Job Submission Description Language specification) and those from the broader Web services community (WS-Security, WSDL and SOAP).
At SC06, more than a dozen groups drawn from industry, academia and research demonstrated interoperability between their prototype implementations of this Web service on their existing job submission infrastructures. This year, with the HPCBP specification now a proposed OGF standards recommendation, many of these groups returned to show how the longer-term integrations of the HPCBP into their plans were proceeding. Several commercial organizations were using prototypes developed by their engineering teams as part of their plans for inclusion in their products. Teams from academia and research were showing how their implementations could be deployed and used with large-scale grid infrastructure deployments.
SC07 Demonstration Results
Participants in this year’s activity included Altair Engineering, Microsoft, Platform Computing, the London e-Science Centre at Imperial College London on behalf of OMII-UK, the University of Virginia e-Science group, and representatives from the EGEE and NIC/FZJ groups within the OMII-Europe project.
All of the participants were demonstrating their implementations of the HPCBP, revised from last year’s versions due to the final changes made in the specification during the public comment period, and verifying their continued interoperability with other participating implementations. This interoperability work had been greatly accelerated through the use of a Web-based compatibility tester developed by the University of Virginia e-Science group. The portal allows users to run a series of tests, derived from the HPCBP specification, to verify that their endpoint is compliant with the standard by seeing how it accepts and generates the XML messages and responds to failures or incorrect messages.
From this groundwork, the interoperability testing that took place in the run-up to SC07 and at the meeting was broadly very successful. Jobs were passing from clients to services located on different operating systems (different versions of Linux and Windows, for example), using different Web service stacks (including Windows Communication Foundation, gSOAP, Axis and XFire) and interfacing to different jobs scheduling interfaces (including PBS, LSF, Windows Compute Cluster Server v1 & v2, SGE, Torque, ARC, CREAM and Globus). Minor issues continue to be found relating to the interoperability of different Web service hosting environments, (for example, in how WS-Security is handled) rather than any fundamental problems with the HPCBP specification.
Commercial Adoption Plans
Page: 1 of 21 | 2 All »
Article Tools
Share Options
(Digg, Technorati, more)
