The HDF Group will be hosting a webinar presented by Loïc Huder of ESRF on Wednesday, August 31 at 9:00 a.m. Central US time, 4:00 p.m. Central European Summer Time. H5Web is a web viewer for HDF5 files. It can be used to browse HDF5 files and display datasets with performant WebGL-based visualisations. While such […]
We are very pleased to announce the release of HDF5 1.13.2, which can now be obtained from the HDF5 Download page.
The HDF Group hosted a webinar presented by the Hermes team on Friday, August 5, 2022. Hermes is a distributed I/O buffering system for deep distributed storage hierarchies, which are commonly found on modern HPC systems. This webinar will highlight an exciting new component of the library, the Buffer Organizer, which will be released in Hermes
If you are looking to store HDF5 data in the cloud there are several different technologies that can be used and choosing between them can be somewhat confusing. In this post, I thought it would be helpful to cover some of the options with the hope of helping HDF users make the best decision for their deployment. Each project will have its own requirements and special considerations, so please take this as just a starting point.
The HDF Group’s M. Scot Breitenfeld will be presenting a training workshop on August 31, 2022 from 10:00 a.m. until 3:00 p.m. central time. This event is free, but registration is required before August 15.
The HDF Group will be hosting a webinar presented by the Hermes team on Friday, August 5, 2022 at 11:00 a.m. Hermes is a distributed I/O buffering system for deep distributed storage hierarchies, which are commonly found on modern HPC systems. This webinar will highlight an exciting new component of the library, the Buffer Organizer,
The Highly Scalable Data Service (HSDS) runs as a set of containers in Docker (or pods in Kubernetes) and like all things Docker, each container instance is created based on a container image file. Unlike say, a library binary, the container image includes all the dependent libraries needed for the container to run. In this blog post, HSDS senior architect John Readey explains how to get HSDS running in a Docker container or Kubernetes pod, and gives some tips and tricks to ensure everything runs smoothly for you.
HSDS (Highly Scalable Data Service) is described as a “containerized” service, but how are these containers organized to create the service?
M. Scot Breitenfeld, HDF application support specialist and software engineer at The HDF Group, will present a session, Introduction to HDF5 for HPC Data Models, Analysis, and Performance on July 27, 2022. Scot’s talk offers a comprehensive overview of HDF5 for anyone who works with big data in an HPC environment. The talk consists of
Accessing large data stores over the internet can be rather slow, but often you can speed things up using multiprocessing—i.e. running multiple processes that divvy up the work needed. Even if you run more processes than you have cores on your computer, since much of the time each process will be waiting on data, in many cases you’ll find things speed up nicely.
