High Performance Storage System

High Performance Storage System (HPSS) is a flexible, scalable, policy-based Hierarchical Storage Management product developed by the HPSS Collaboration. It provides scalable hierarchical storage management (HSM), archive, and file system services using cluster, LAN and SAN technologies to aggregate the capacity and performance of many computers, disks, disk systems, tape drives and tape libraries.[1]

High Performance Storage System
Developer(s)HPSS Collaboration (IBM, LANL, LBNL, LLNL, ORNL, SNL)
Stable release
8.3 / March 2020
Operating systemLinux
TypeHierarchical Storage Management
LicenseProprietary
Websitehpss-collaboration

Architecture

HPSS supports a variety of methods for accessing and creating data. Among them are support for FTP, parallel FTP, FUSE (Linux), as well as a robust client API with support for parallel I/O.

As of version 7.5, HPSS has full support on Linux. The HPSS client API is supported on AIX, Linux, and Solaris.[1]

The implementation is built around IBM's Db2, a scalable relational database management system.

The HPSS Collaboration

The collaboration which produced HPSS began in the fall of 1992, and involved IBM's Houston Global Services and five United States Department of Energy (DOE) National Laboratories (Lawrence Berkeley, Lawrence Livermore, Los Alamos, Oak Ridge, and Sandia).[1] At that time, the DOE national laboratory and IBM HPSS design team recognized there would be a data storage explosion driven by computing power rising to teraops/petaops requiring data stored in HSMs to rise to petabytes and beyond, data transfer rates with the HSM to rise to gigabytes/s and higher, and daily throughput with a HSM in 10s of terabytes/day. Therefore, the collaboration set out to design and deploy a system that would scale by a factor of 1,000 or more and evolve from the base above toward these expected targets and beyond.[2]

The HPSS collaboration is based on the premise that no single organization has the experience and resources to meet all the challenges represented by the growing imbalance between computing power and data collection capabilities, and storage system I/O, capacity, and functionality. Over twenty organizations worldwide including industry, US Department of Energy (DOE), other federal laboratories, universities, National Science Foundation (NSF) supercomputer centers and French Commissariat a l'Energie Atomique (CEA) have contributed to various aspects of this effort.

As of 2014, the primary HPSS development team consists of:

Notable achievements
gollark: If you have anything good to trade, I happen to have one lying around.
gollark: There are various ways to breed leetles:kill TJ09 and take his place, then make it possible for you to breed leetlespay TJ09 and/or ask him nicely to make your leetles breedablemind-control TJ09hack into DC and make your leetles breedable/give yourself a bred leetle
gollark: Or at least under 5d.
gollark: The cave has *more* BSAs, and if you care about their lineages then go there, but the AP's are very low-time usually.
gollark: You should probably use the AP to get BSAs and not the cave.

References
  1. "Official HPSS Collaboration Website". IBM.
  2. Largest HPSS Sites 1+ petabytes
  3. HPCWire Nov 15, 2007 Archived November 17, 2007, at the Wayback Machine
  4. "NCSA puts world's largest High Performance Storage System into production". 2013-05-30. Retrieved 2014-08-30.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.