Tags: storage

Assess USB Performance While Exploring Storage Caching

The team here at the Dragon Propulsion Laboratory has kept busy building multiple Linux clusters as of late [1]. Some of the designs rely on spinning disks or SSD drives, whereas others use low-cost USB storage or even SD cards as boot media. In the process, I was hastily reminded of the limits of...
Read 0 Comments

Container Storage Interface (CSI) for Kubernetes GA

The Kubernetes implementation of the Container Storage Interface (CSI) has been promoted to GA in the Kubernetes v1.13 release. Support for CSI was introduced as alpha in Kubernetes v1.9 release, and promoted to beta in the Kubernetes v1.10 release. The GA milestone indicates that Kubernetes users...
Read 0 Comments

Working with the Container Storage Library and Tools in Red Hat Enterprise Linux

How containers are stored on disk is often a mystery to users working with the containers. In this post, we’re going to look at how containers images are stored and some of the tools that you can use to work with those images directly -Podman, Skopeo, and Buildah. Evolution of Container Image...
Read 0 Comments

Linux Storage, Filesystem & Memory Management Summit

The Linux Storage, Filesystem & Memory Management Summit gathers the foremost development and research experts and kernel subsystem maintainers to map out and implement improvements to the Linux filesystem, storage and memory management subsystems that will find their way into the mainline...
Read 0 Comments

The Ceph Storage Project Gets a Dedicated Open-Source Foundation

Ceph is an open source technology for distributed storage that gets very little public attention but that provides the underlying storage services for many of the world’s largest container and OpenStack deployments. It’s used by financial institutions like Bloomberg and Fidelity, cloud service...
Read 0 Comments

How to Partition and Format a Drive on Linux

On most computer systems, Linux or otherwise, when you plug a USB thumb drive in, you're alerted that the drive exists. If the drive is already partitioned and formatted to your liking, you just need your computer to list the drive somewhere in your file manager window or on your desktop. It's a...
Read 0 Comments

How to Manage Storage on Linux with LVM

Logical Volume Manager (LVM) is a software-based RAID-like system that lets you create "pools" of storage and add hard drive space to those pools as needed. There are lots of reasons to use it, especially in a data center or any place where storage requirements change over time. Many Linux...
Read 0 Comments

Shared Storage with NFS and SSHFS

Up to this point, my series on HPC fundamentals has covered PDSH, to run commands in parallel across the nodes of a cluster, and Lmod, to allow users to manage their environment so they can specify various versions of compilers, libraries, and tools for building and executing applications. One...
Read 0 Comments

Why the Future of Data Storage is (Still) Magnetic Tape

Studies show [PDF] that the amount of data being recorded is increasing at 30 to 40 percent per year. At the same time, the capacity of modern hard drives, which are used to store most of this, is increasing at less than half that rate. Fortunately, much of this information doesn’t need to be...
Read 0 Comments

Storj Labs Forges Open-Source Vendors and Cloud Services Alliance

At the Linux Foundation's Open Source Summit in Vancouver, Storj Labs a decentralized cloud storage company, announced a partnership that will enable open-source projects to generate revenue when their users store data in the cloud: The Open Source Partner Program. Why? Ben Golub, Storj's executive...
Read 0 Comments

Pages

Click Here!