Tags: cluster

Baidu's Deep Learning Framework Adopts Kubernetes

PaddlePaddle, Baidu's open source framework for deep learning, is now compatible with the Kubernetes cluster management system to allow large models to be trained anywhere Kubernetes can run. This doesn't simply expand the range of systems that can be used for PaddlePaddle training; it also...
Read 0 Comments

GlusterFS Storage Pools

Software-defined storage, which until recently was the preserve of large storage solution vendors, can be implemented today with open source and free software. As a bonus, you can look forward to additional features that are missing in hardware-based solutions. GlusterFS puts you in a position to...
Read 0 Comments

How to Build a Ceph Distributed Storage Cluster on CentOS 7

Ceph is a widely used open source storage platform. It provides high performance, reliability, and scalability. The Ceph free distributed storage system provides an interface for object, block, and file-level storage. Ceph is build to provide a distributed storage system without a single point of...
Read 0 Comments

allen_samuels.png

Allen Samuels
Allen Samuels, Engineering Fellow at Western Digital, talking about Ceph and Flash at LinuxCon Europe.

Improving Storage Performance with Ceph and Flash

Ceph is a storage system designed to be used at scale, with clusters of Ceph in deployment in excess of 40 petabytes today. At LinuxCon Europe, Allen Samuels, Engineering Fellow at Western Digital, says that Ceph has been proven to scale out reasonably well. Samuels says, “the most important thing...
Read 0 Comments

Kubernetes High Availability Setup Using Ansible

I have created an Ansible module to create a highly available (HA) Kubernetes cluster with latest release 1.4.x on CentOS 7.X. You can use this module to install Kubernetes HA cluster with just one click, and your cluster will be ready in few minutes.  There are 8 roles defined in this Ansible...
Read 0 Comments

Build a Hadoop Cluster in AWS in Minutes

Check out this process that will let you get a Hadoop cluster up and running on AWS in two easy steps. I use Apache Hadoop to process huge data loads. Setting up Hadoop in a cloud provider, such as AWS, involves spinning up a bunch of EC2 instances, configuring nodes to talk to each other,...
Read 0 Comments

SUSE Advances its Open-Source Storage System

Besides announcing its next version of Ceph-powered SUSE Enterprise Storage, SUSE has bought openATTIC, the open-source Ceph and storage management framework. SES 4, a software-defined storage system, is powered by Ceph. This is a distributed object store and file system. It, in turn, relies on a...
Read 0 Comments

Linux Dominates November TOP500 Supercomputer List

The latest semi-annual list of the world's top 500 supercomputers was released on November 14, showing little change at the top of the list. The China-based Sunway TaihuLight supercomputer, which first claimed the title of the world's fastest system in June 2016, still reigns supreme. Sunway...
Read 0 Comments

How to Deploy a Fault Tolerant Cluster with Continuous or High Availability

Some companies cannot allow having their services down. In case of a server outage a cellular operator might experience billing system downtime causing lost connection for all its clients. Admittance of the potential impact of such situations leads to the idea to always have a plan B. In this...
Read 0 Comments

How to Solve 5 Elasticsearch Performance and Scaling Problems

This post is the final part of a 4-part series on monitoring Elasticsearch performance. Part 1 provides an overview of Elasticsearch and its key performance metrics, Part 2 explains how to collect these metrics, and Part 3 describes how to monitor Elasticsearch with Datadog. Like a car,...
Read 0 Comments

Pages

Click Here!