NetApp has brought support for BeeGFS to Kubernetes providing a scalable and high performing option for storage that costs nothing to get started with. If you are a Kubernetes user, you can now use the BeeGFS container storage interface (CSI) driver from NetApp® to access existing datasets in a BeeGFS parallel file system, or request on-demand ephemeral or persistent high-speed scratch space. Furthermore, if you’re already using BeeGFS, you can now use familiar storage while breaking into the next paradigm of workload management and orchestration with Kubernetes. The BeeGFS CSI driver is freely available as a contribution to the open-source, artificial intelligence (AI), and high-performance computing (HPC) communities.
As I help build environments to support NetApp’s own data science initiatives, I’ve been eagerly awaiting the ability to integrate BeeGFS and Kubernetes. While the shipped driver has now earned 1.0 release status, I’ve been using it to back MLOps tools like Kubeflow and data science tools like Jupyter that have been running in our environment for months. This early exposure provided the perfect opportunity to ensure the driver fits seamlessly within AI data pipelines and other workflows.
Joe McCormick is a software engineer at NetApp with over ten years of experience in the IT industry. With nearly seven years at NetApp, Joe's current focus is developing high-performance computing solutions around E-Series. Joe is also a big proponent of automation, believing if you've done it once, why are you doing it again.