Student / community

LCSP Virtualization Infrastructure

Five-node Proxmox cluster with Ceph storage, hosting the lab's services as virtual machines and LXC containers.

Active
Diagram: a five-node Proxmox cluster, four active and one usually kept in reserve. The lab's services run as virtual machines and LXC containers; virtual machine disks are stored on Ceph, and CephFS provides storage shared across nodes, all distributed over the cluster.
Virtualization architectureFunctional, anonymized view of the cluster: node roles, service types and distributed storage. No server models, host names or capacities.

My contribution

I set up most of the LCSP virtualization cluster, with occasional help from my fellow infrastructure co-lead: creating the Proxmox cluster, joining the nodes, setting up Ceph / CephFS storage, and handling quorum, migrations and replication. I now run it day to day: updates, maintenance, incident diagnosis and the platform's evolution.

Highlights

  • Five-node Proxmox cluster, built and joined node by node
  • Ceph storage for virtual machines, CephFS for shared storage
  • Quorum and Ceph upgrade incidents diagnosed and resolved

Goal

Give the lab a shared foundation on which to host its services.

Architecture

The Proxmox cluster has five nodes, one of which is usually kept on standby. Virtual machine disks are stored on Ceph, and CephFS provides storage shared across the nodes. The lab’s services run on it as virtual machines and LXC containers.

Build and operations

The cluster was built step by step: creating the cluster, joining each server, setting up the distributed storage. Running it covers quorum, virtual machine migration and replication, updates and maintenance.

Incidents

Several incidents were diagnosed and resolved: quorum issues, update problems, and Ceph versions that had to be upgraded, which required maintenance and a storage migration.

What is not published

No server models, machine names, versions or storage configuration details: this page is deliberately kept general.