NASA Earth Science Data Systems (ESDS) recipient

NASA
ITSC
UAHuntsville

 

News

University of Alabama in Huntsville releases HDF-EOS Subsetting Engine for HDF-EOS 5

The Information Technology and Systems Center at UAH announces the public release of a new version of its HDF-EOS Subsetting Engine (HSE). Last year, UAH released the HSE, which subsets data generated with HDF-EOS v2.x. This new version, HSE5, provides dataset-independent subsetting for data in HDF-EOS 5 format. HSE5 is the latest of many tools from UAH ITSC, including subsetters, data mining software, and data/application interchange technologies. More information on ITSC research and technologies is available from our web site, http://www.itsc.uah.edu.

How the HSE works
HSE5 and HSE are callable functions that can be incorporated into any application that needs to perform HDF-EOS subsetting. Since both versions of HSE function similarly, this document will use the term “HSE”, unless specifically noted, to refer to either version. Since the HSE is a callable function, the user provides a “wrapper” program that provides subsetting parameters to the HSE in a function call. The HSE interprets the subsetting parameters, opens, reads, and subsets the input file(s), and writes the output file(s). The HSE function returns an exit code indicating the level of success.

During the subsetting operation, the HSE may produce status and log messages. These are sent to a user-supplied function for disposition. The user-supplied function may choose to write the messages to a file, send them as e-mail, or ignore them completely.

Utility Library
In order to make the set-up of the parameters for subsetting somewhat easier, a library of utility functions is also provided with the HSE. These optional routines can be used to set-up, search, and destroy the data structures passed to the HSE.

A separate library of “discovery” functions is also supplied. These routines can be used to discover the contents of an HDF-EOS file which are returned in an easily-traversable data structure.
The standard delivery also provides source code for sample log and status message routines which may be used “as is” or tailored to the user’s specifications.

Separate libraries are provided for HSE and HSE5. An application can be built to handle HDF-EOS 2 files, HDF-EOS 5 files, or both.

HSE capabilities
> Subsets multiple files in one call.
> Subsets multiple properly-formatted HDF-EOS grid and swath
   objects.
> Subsets spatially by latitude/longitude or row/column.
> Subsets swaths temporally by date/time range.
> Subsets swaths by full or partial scan-lines.
> Subsets spectrally by HDF-EOS field.
> Subsamples by stride or by index along any dimension.
> Copies all file and field attributes to the output file
> Updates HDF-EOS “core” metadata when possible.

Availability/Documentation
The HSE is currently being used operationally, incorporated into both the EOSDIS Core System and the AMSR-E Science Investigator-led Processing System (SIPS). HSE5 was tested with data from the MLS, TES, HIRDLS, and OMI instruments aboard NASA’s Aura satellite.
The HSE is available in binary form for download from the subset.org web site. Versions of HSE and HSE5 are available for SGI Irix 6.5, SunOS 5.9, and Linux.

Documentation in Microsoft® Word® and Adobe® PDF is also available from the download site--choose the HSE. Contact Matt Smith (msmith@itsc.uah.edu) or subset@itsc.uah.edu if you have questions.

Additional software required
To produce an executable file that uses the HSE, the following additional libraries are required:
-ODL, as modified by UAH
-SDP Toolkit time-conversion routines
-for HSE:
   HDF v4.2, available from hdf.ncsa.uiuc.edu
   HDF-EOS v2.12, available from    hdfeos.gsfc.nasa.gov/hdfeos/softwarelist.cfm
-for HSE5:
   HDF v5-1.6.2, available from hdf.ncsa.uiuc.edu
   HDF-EOS v5.1.8, available from    hdfeos.gsfc.nasa.gov/hdfeos/softwarelist.cfm
The modified ODL library and SDP Toolkit time-conversion routines library can be downloaded from the UAH subsetting portal. Note that the latest versions of HDF and HDF-EOS require the ZLIB, SZIP, and JPEG libraries which are now packaged separately. These libraries are available as part of the HDF-EOS package.

For more information about ITSC research areas and current projects, please visit http://www.itsc.uah.edu.


New and Updated ESML Releases

The Information Technology and Systems Center (ITSC) at the University of Alabama in Huntsville (UAH) announces updates and new releases of binary packages for the Earth Science Markup Language (ESML). ESML is an interchange technology that enables data (both structural and semantic) interoperability with applications without enforcing a standard format within the Earth science community. The following binary deliverables are now available at http://esml.itsc.uah.edu for both Linux and Windows platforms.

Updates:
ESML v3.0.1 - core ESML library
BinaryPlugin v1.1 - plugin for binary format
HDFEOSPlugin v1.1 - plugin for HDF-EOS format
PyESML v1.0 (for ESML v 3.0.1) - Python interface for ESML library modules

New releases:
AsciiPlugin v1.0 - plugin for ASCII format
NetCDFPlugin v1.0 - plugin for NetCDF
Grib2DPlugin v1.0 - plugin for GRIB format
ESMLEditor v2.0 - ESML editor utility

The ESML specifications, software, documentation and additional information are available on the web at http://esml.itsc.uah.edu. The software is freely available for education and research purposes. For information contact:
Information Technology and Systems Center, University of Alabama in Huntsville, Huntsville, AL 35899, 256-824-6868, esml@itsc.uah.edu, http://esml.itsc.uah.edu


ITSC Announces Version 4.0 of Its Algorithm Development and Mining System (ADaM)

The Information Technology and Systems Center (ITSC) at the University of Alabama in Huntsville (UAH) announces the public release of the Algorithm Development and Mining (ADaM) version 4.0 toolkit. ITSC conducts multidisciplinary research in many facets of information technology at the state, regional, national and international levels.
ADaM 4.0 represents a significant restructuring of the ADaM system to focus on providing data mining and image processing toolkits in a form that is flexible and reusable for scientific researchers, educators and students.

These new toolkits are comprised of separate executable modules. These modules support the easy construction of complex solutions with common scripting languages such as Python, Perl, shell scripts and other workflows. ADaM 4.0 components are easily integrated with CGI and web service interfaces to support distributed applications. The modular design achieves interoperability with other mining and image processing systems.

ADaM 4.0 is already being utilized in Earth and space science research projects, as well as in distributed computational and data Grid systems. The ADaM 4.0 software, documentation and additional information are available on the web at for both Linux and Windows platforms. The software is freely available for education and research purposes.

For more information contact: Information Technology and Systems Center, University of Alabama in Huntsville, Huntsville, AL 35899, 256-824-6868, datamining@itsc.uah.edu, http://datamining.itsc.uah.edu/

 

For additional information, e-mail subset@itsc.uah.edu or call +1-256-824-6868.
Copyright © 1999-2003 by the University of Alabama in Huntsville. All rights reserved.
If you have trouble viewing or navigating this page, please contact GHRC User Services.

Home | News | Tools | About Data Formats | Downloads | Documentation
Mailing List | FAQ | Contact Us | Disclaimer