OpenIO

OpenIO has been founded in 2015 by Laurent Denel (CEO) and six co-founders, to offer an object storage solution for building hyper-scalable IT infrastructures for a wide range of applications.[1] OpenIO leverages open source software, developed since 2006, which is based on a grid technology that enables dynamic behaviors and supports heterogenous hardware.[2] In October 2017 OpenIO completed a $5 million funding round.[3] In October 2019, OpenIO announced that it had crossed the terabit per second barrier by benchmarking an infrastructure provided by Criteo.[4] In July 2020, OVH acquired OpenIO to co-create an alternative European Object Storage solution on the market. [5]

OpenIO
IndustryInformation technology, Data storage, Data processing
Founded2015
Headquarters
France
Area served
Worldwide
Key people
Laurent Denel (CEO,
Jean-François Smigielski (CTO)
ProductsOpenIO Object Storage
Websitewww.openio.io 

Product

OpenIO is a software-defined object storage solution that supports S3 and can be deployed on-premises, cloud-hosted or at the edge, on any hardware mix. It has been designed from the beginning for performance and cost-efficiency at any scale[6], and it has been optimized for Big Data, HPC and AI.[7]

OpenIO stores objects within in a flat structure within a massively distributed directory with indirections, this allows the data query path to be independent of the number of nodes and the performance not to be affected by the growth of the capacity. Servers are organized as a grid of nodes massively distributed, where each node takes part in directory and storage services, which ensures that there is no single point of failure and that new nodes are automatically discovered and immediately available without the need to rebalance data.[8]

The software is built on top of ConsciousGrid, a technology that ensures optimal data placement based on real-time metrics and allows the addition or removal of storage devices with automatic performance and load impact optimization.[9][10] For data protection OpenIO has synchronous and asynchronous replication with multiple copies, and an erasure coding implementation based on Reed-Solomon that can be deployed in one data center or geo-distributed or stretched clusters.[11][12]

The software has a GridForApps feature that catches all events that occur in the cluster and can pass them up in the stack or to applications running on OpenIO nodes. This enables event-driven computing directly into the storage infrastructure.[13][14]

OpenIO has native object APIs and SDKs for Python, C and Java, it integrates a HTTP REST/API and has strong compatibility with the Amazon S3 API and the OpenStack Swift API.[8] The company also offers a proprietary File System connector to access data stored in an OpenIO object store through file access methods: it is based on FUSE and presents a POSIX File System which can be shared over local networks via NFS, SMB and FTP.[15]

OpenIO is compatible with x86 and ARMv7/ARMv8 servers running Linux[16] and has low hardware requirements[17], it can be installed also on Raspberry Pis[18][19] and on storage drives with embedded server.[20][21][22]

The open source code is available on Github and it is licensed under AGPL3 for server code and LGPL3 for client code.

Performance

OpenIO claims to have reached 1.372 Tbps write speed (171 GB/s) on a cluster of 350 physical machines.[23] The benchmark scenario, conducted under production conditions with standard hardware (commodity servers with 7200 rpm HDDs), consisted in backing up a 38 PB Hadoop datalake via the DistCp command.[24] This level of performance marks, according to analysts[25], the arrival of a new generation of object storage technologies oriented toward high performance and hyper-scalability.

gollark: There are 456 cave drops per day (probably).
gollark: DC's server(s) maybe have a few terabytes (a thousandth of that) at best.
gollark: Actually, several exabytes.
gollark: If we assume there's 500 bytes of data per dragon... hmm... you'd need an exabyte of data storage to handle 72.1 petadragons.
gollark: Hmm, you may run into gendering issues; let's say 2 a week.

See also

References
  1. "OpenIO Object Storage Overview". OpenIO Official Website. Retrieved 2019-09-10.
  2. "The History Boys: Object storage ... from the beginning". The Register. Retrieved 2017-10-05.
  3. Dillet, Romain. "OpenIO raises $5 million to build your own Amazon S3 on any storage device". TechCrunch. Retrieved 2017-10-26.
  4. "OpenIO To Lead In Big Data Storage, After Achieving Ultra-High Performance". OpenIO Object Storage. Retrieved 2019-11-22.
  5. https://www.ovh.com/world/news/press/cpl1582.acquisition-openio-ovhclouds-ambition-create-best-object-storage-offer-market
  6. "Openio's objective is opening up object storage space". The Register. Retrieved 2017-10-06.
  7. "OpenIO | High Performance Object Storage for Big Data and AI". OpenIO Official Website. Retrieved 2019-09-30.
  8. "OpenIO Core Concepts". OpenIO Documentation. Retrieved 2016-11-11.
  9. "OpenIO Object Storage for Big Data". OpenIO Official Website. Retrieved 2019-09-30.
  10. "Why We Designed an Object Store with a Conscience". OpenIO Blog. 2017-07-18. Retrieved 2019-10-01.
  11. "OpenIO Data Management Features". OpenIO Documentation. Retrieved 2019-09-30.
  12. "OpenIO Storage Policies". OpenIO Documentation. Retrieved 2019-10-01.
  13. "Simple Metadata Indexing through Grid for Apps". OpenIO Blog. Retrieved 2017-10-06.
  14. "Detect patterns in pictures at scale using Tensorflow and OpenIO GridForApps". OpenIO Blog. Retrieved 2017-10-06.
  15. "OpenIO File System Connector (OIO-FS) Architecture". OpenIO Documentation. Retrieved 2019-10-01.
  16. "OpenIO Supported Linux Distributions". OpenIO Documentation. Retrieved 2019-10-01.
  17. "OpenIO Sizing Guide". OpenIO Documentation. Retrieved 2019-10-01.
  18. "Raspberry Pi in the data center: A unique option for object storage and edge computing". TechRepublic. Retrieved 2017-08-28.
  19. "OpenIO on a Raspberry Pi". OpenIO Documentation. Retrieved 2019-10-01.
  20. "Open source object storage startup OpenIO adds hardware". SearchCloudStorage. Retrieved 2017-08-28.
  21. "OpenIO wants to turn your spinning rust into object storage nodes". The Register. Retrieved 2017-10-06.
  22. "Is this the real life? Is this just fantasy? Self-processing flash drives, we'll need more capacity". The Register. Retrieved 2017-10-06.
  23. "OpenIO 'solves' the problem with object storage hyperscalability – Blocks and Files".
  24. "Terabit Challenge | OpenIO Object Storage".
  25. "S3, file access and high performance… this is not your old object storage".
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.