Ceph Workshop

I’ve attended the first Ceph Workshop in Amsterdam, Nov 2, 2012, with all the Ceph gurus, Sage Weil, Wildo den Hollander, Ross Turk, Gregory Farnum presenting this outstanding distributed storage technology. I’m sharing with you my notes. Keynote by Wildo den Hollander 42on (@widoth) partners of the first ever workshop day inktank - the founders providing services & support contributed 90% of ceph code 42on spinoff of European company which now focus on Ceph Dell gave gears for Demo facilities Why Ceph ? World of storage is changing everyday, now storing Petabytes of data How to store it is a lot of work Do we use proprietary systems ? How do we scale ? Does that fit in our budget Use Ceph Fully distributed without any SPoF Scales with you into the Petabytes Runs on commodity hardware Keynote by Sage Weil (@liewegas, sage@inktank.com) First ever Ceph day Unified Distributed System Why you should care diverse storage needs object storage block devices (for VMs) with snapshots, cloning shared file system with POSIX, coherent caches structured data: files, block devices, or objects ? scale terabytes, petabytes, exabytes heterogeneous hardware time ease of admin no manual data migration, load balancing painless scaling expansion and contraction seamless integration cost linear function of size, of performance incremental expansion no fork lift upgrades no vendor lock-in choice of hardware and software open What is it, what it’s for It’s a storage system that stores: Objects native API or RESTful API Blocks thin provisioning snapshots layering/cloning Files strong consistency, snapshots It’s a distributed storage system that scale from 10s to 10 000 of machines terabytes to exabytes Which is fault tolerant - no SPoF how it works - architecture - ceph object model ...

November 5, 2012 · 21 min · planetrobbie

MultiMarkdown tips & tricks

MMD is an extension of a well known markup language extending Markdown. Syntax Emphasis *italic* **bold** ***bold italic*** Links <http://yet.org> Inline Links An [example](http://yet.org) Reference Links An [example][id] or [id] [id]: http://yet.org/ "Some Link" class=external style="border: solid black 1px;" Cross Reference ### Overview [Introduction] ## use it: [Introduction][] Inline Images (titles are optional) ![alt text](/path/img.jpg "Title") Reference-style Images ![alt text][id] [id]: /url/to/img.jpg "Title" width=40px height=400px Headers ...

October 29, 2012 · 6 min · planetrobbie

Git

Git is the cornerstone of software development. This article is my git cheatsheet. installation apt-get install git configuration [Anything can be set at three levels] config targets saves to scope --system /etc/gitconfig host --global ~/.gitconfig user --local .git/config repository Minimum configuration: % git config --global user.name "your name" % git config --global user.email "your email" % git config --global core.editor "vim" Querying all entries : % git config --list Querying one entry ...

October 26, 2012 · 6 min · planetrobbie

vCNS

Martin Casado Introduction. When we talk about virtualization, we are lying a little bit. It’s very important to know what’s this lie is. We have to work with 3 decades of madness. We have decoupled VM from the compute but we haven’t decoupled them to the physical network. Look at the addressing, the default gateway, the subnet, … it comes from the physical world. Resulting in : Slow provisionning limited placement Mobility is limited Hardware dependent Operationaly intensive The basic concept of network virtualization is the same as the compute one, a thin layer of software that sits in between. Virtual network will look exactly the same for a VM. If you have this virtual network a lot of the previous problems will disapear. You can move a VM anywhere you want. The physical won’t go away but we are agnostic. It’s not about protocols: STT, VXLAN, at the end of the day it’s about the virtual abstraction. We want to support any physical network. ...

6 min · planetrobbie