Vitaliy Filippov
a0cae4c180
Old pool configurations with "jerasure" also remain supported as an alias for "ec"
3.8 KiB
3.8 KiB
Documentation → Introduction → Quick Start
Quick Start
- Preparation
- Configure monitors
- Configure OSDs
- Create a pool
- Check cluster status
- Create an image
- Install plugins
Preparation
- Get some SATA or NVMe SSDs with capacitors (server-grade drives). You can use desktop SSDs with lazy fsync, but prepare for inferior single-thread latency. Read more about capacitors here.
- Get a fast network (at least 10 Gbit/s). Something like Mellanox ConnectX-4 with RoCEv2 is ideal.
- Disable CPU powersaving:
cpupower idle-set -D 0 && cpupower frequency-set -g performance. - Install Vitastor packages.
Configure monitors
On the monitor hosts:
- Edit variables at the top of
/usr/lib/vitastor/mon/make-units.shto desired values. - Create systemd units for the monitor and etcd:
/usr/lib/vitastor/mon/make-units.sh - Start etcd and monitors:
systemctl start etcd vitastor-mon
Configure OSDs
- Put etcd_address and osd_network into
/etc/vitastor/vitastor.conf. Example:{ "etcd_address": ["10.200.1.10:2379","10.200.1.11:2379","10.200.1.12:2379"], "osd_network": "10.200.1.0/24" } - Initialize OSDs:
- Simplest, SSD-only:
/usr/lib/vitastor/mon/make-osd.sh /dev/disk/by-partuuid/XXX [/dev/disk/by-partuuid/YYY ...]Warning! This very simple script by default makes units for server-grade SSDs with write-through cache! If it's not your case, you MUST remove disable_data_fsync and immediate_commit from systemd units. - Hybrid, HDD+SSD:
/usr/lib/vitastor/mon/make-osd-hybrid.js /dev/sda /dev/sdb ...— pass all your devices (HDD and SSD) to this script — it will partition disks and initialize journals on its own. This script skips HDDs which are already partitioned so if you want to use non-empty disks for Vitastor you should first wipe them withwipefs -a. SSDs with GPT partition table are not skipped, but some free unpartitioned space must be available because the script creates new partitions for journals.
- Simplest, SSD-only:
- You can change OSD configuration in units or in
vitastor.conf. Check Configuration Reference for parameter descriptions. - If all your drives have capacitors, create global configuration in etcd:
etcdctl --endpoints=... put /vitastor/config/global '{"immediate_commit":"all"}' - Start all OSDs:
systemctl start vitastor.target
Create a pool
Create pool configuration in etcd:
etcdctl --endpoints=... put /vitastor/config/pools '{"1":{"name":"testpool",
"scheme":"replicated","pg_size":2,"pg_minsize":1,"pg_count":256,"failure_domain":"host"}}'
For EC pools the configuration should look like the following:
etcdctl --endpoints=... put /vitastor/config/pools '{"2":{"name":"ecpool",
"scheme":"ec","pg_size":4,"parity_chunks":2,"pg_minsize":2,"pg_count":256,"failure_domain":"host"}`
After you do this, one of the monitors will configure PGs and OSDs will start them.
Check cluster status
vitastor-cli status
Or you can check PG states with etcdctl --endpoints=... get --prefix /vitastor/pg/state. All PGs should become 'active'.
Create an image
Use vitastor-cli (read CLI documentation here):
vitastor-cli create -s 10G testimg
After that, you can run benchmarks or start QEMU manually with this image.