thebestvibedev/tromcho.net
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
v1.6.0
tromcho.net/src
T
History
Vitaliy Filippov ff4414d37e Release 1.6.0 
New features:

- Implement "hierarchical failure domains" and other complex distribution rules, for example
  EC 4+2 over 3 DC, with 2 chunks per each DC ([documentation](docs/config/pool.en.md#level_placement))
- Make OSDs handle ENOSPC - now cluster stays online even if some OSDs fill up
  to 100 %, only writes requiring free space hang
- Implement Stage/Unstage & volume locking for CSI to prevent parallel mounting
  and/or modifications of the same volume
- Warn about full and almost full OSDs in vitastor-cli status
- Add an experimental NBD netlink map mode as an option ([documentation](docs/usage/nbd.en.md))
- Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
- Add [administration docs](docs/usage/admin.en.md)

Bug fixes:

- Fix client operation retry timeout - previously the timeout wasn't applied and writes were
  retries almost instantly
- Fix monitors crashing on invalid pool configurations
- Fix journaling - make each journal write wait for all previous journal writes
- Fix monitor thinking that OSD weight is 0 after deleting /osd/config/ key online
- Fix a write stall caused by flusher possibly not trimming journal on rollback
- Set 32k csum_block_size for HDD by default in vitastor-disk
2024-04-09 16:57:59 +03:00
..
mock
Implement client writeback cache
2023-09-16 17:52:17 +03:00
nfs
Simplified NFS proxy based on own NFS/XDR implementation
2022-05-07 01:01:20 +03:00
addr_util.cpp
Allow multiple interfaces with the same IP address, for "simple routed" full mesh network
2023-12-17 13:25:56 +03:00
addr_util.h
Use the larger sockaddr_storage structure
2022-02-12 11:22:56 +03:00
allocator.cpp
Implement large csum_block_size support (more than 4k) + refactor blockstore_flush
2023-07-29 12:17:18 +03:00
allocator.h
Implement large csum_block_size support (more than 4k) + refactor blockstore_flush
2023-07-29 12:17:18 +03:00
blockstore_disk.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
blockstore_disk.h
Add a third I/O mode: O_DIRECT|O_SYNC, change parameters to data_io/meta_io/journal_io
2023-08-09 00:57:08 +03:00
blockstore_flush.cpp
Fix flusher possibly not trimming journal on rollback
2024-04-05 23:14:39 +03:00
blockstore_flush.h
Fix flusher possibly not trimming journal on rollback
2024-04-05 23:14:39 +03:00
blockstore_impl.cpp
Allow to disable per-inode stats for VitastorFS pools
2024-03-16 13:24:36 +03:00
blockstore_impl.h
Allow to disable per-inode stats for VitastorFS pools
2024-03-16 13:24:36 +03:00
blockstore_init.cpp
Fix another rare OSD hang on zeroing out entries on start
2024-03-16 13:24:36 +03:00
blockstore_init.h
Fix rare OSD hang on zeroing out bad entries on start
2024-03-06 00:41:35 +03:00
blockstore_journal.cpp
Fix journal sequencing: make each journal write wait for all previous journal writes
2024-04-06 23:53:12 +03:00
blockstore_journal.h
Fix journal sequencing: make each journal write wait for all previous journal writes
2024-04-06 23:53:12 +03:00
blockstore_open.cpp
Make journal_trim_interval configurable
2024-02-15 23:38:51 +03:00
blockstore_read.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
blockstore_rollback.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
blockstore_stable.cpp
Allow to disable per-inode stats for VitastorFS pools
2024-03-16 13:24:36 +03:00
blockstore_sync.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
blockstore_write.cpp
Fix journal sequencing: make each journal write wait for all previous journal writes
2024-04-06 23:53:12 +03:00
blockstore.cpp
Allow to disable per-inode stats for VitastorFS pools
2024-03-16 13:24:36 +03:00
blockstore.h
Allow to disable per-inode stats for VitastorFS pools
2024-03-16 13:24:36 +03:00
cli_alloc_osd.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
cli_common.cpp
Fix shared file overlap, add FIXMEs
2024-03-16 13:24:36 +03:00
cli_create.cpp
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
cli_describe.cpp
Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
2024-04-07 12:39:46 +03:00
cli_fix.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
cli_fix.h
Fix compile errors with gcc 10
2023-05-20 23:20:09 +03:00
cli_flatten.cpp
Implement safety check for OSD removal, translate all '-' to '_' in cli options
2022-12-26 02:48:48 +03:00
cli_ls.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
cli_merge.cpp
Merge branch 'rel-1.4'
2024-02-29 09:59:01 +03:00
cli_modify.cpp
Merge branch 'rel-1.4'
2024-02-29 09:59:01 +03:00
cli_pool_cfg.cpp
Plug the new PG combinator into monitor
2024-04-07 02:44:17 +03:00
cli_pool_cfg.h
Rework & fix pool-create / pool-modify / pool-ls
2024-02-28 13:08:04 +03:00
cli_pool_create.cpp
Rework & fix pool-create / pool-modify / pool-ls
2024-02-28 13:08:04 +03:00
cli_pool_ls.cpp
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
cli_pool_modify.cpp
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
cli_pool_rm.cpp
Rework & fix pool-create / pool-modify / pool-ls
2024-02-28 13:08:04 +03:00
cli_rm_data.cpp
Do not use \r if output is not a terminal
2024-02-29 00:21:17 +03:00
cli_rm_osd.cpp
Store next scrub timestamp instead of last scrub timestamp
2023-05-20 23:19:39 +03:00
cli_rm.cpp
Merge branch 'rel-1.4'
2024-02-29 09:59:01 +03:00
cli_status.cpp
Warn about full and almost full OSDs in status
2024-04-07 19:39:51 +03:00
cli.cpp
Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
2024-04-07 12:39:46 +03:00
cli.h
Add documentation and a very basic test for pool management commands
2024-02-28 13:08:04 +03:00
cluster_client_impl.h
Implement client writeback cache
2023-09-16 17:52:17 +03:00
cluster_client_list.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
cluster_client_wb.cpp
Fix unused capture warnings and void* arithmetic (clang)
2023-11-04 14:55:12 +03:00
cluster_client.cpp
Add ENOSPC handling tests
2024-04-07 19:39:33 +03:00
cluster_client.h
Add ENOSPC handling tests
2024-04-07 19:39:33 +03:00
CMakeLists.txt
Release 1.6.0
2024-04-09 16:57:59 +03:00
crc32c.c
Move C/C++ sources to src subdirectory
2021-02-25 23:59:03 +03:00
crc32c.h
Move C/C++ sources to src subdirectory
2021-02-25 23:59:03 +03:00
disk_simple_offsets.cpp
Allow to print simple-offsets just given the device size
2024-03-16 13:24:36 +03:00
disk_tool_journal.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
disk_tool_meta.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
disk_tool_prepare.cpp
Set 32k csum_block_size for HDD by default
2024-03-30 16:16:49 +03:00
disk_tool_resize.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
disk_tool_udev.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
disk_tool_upgrade.cpp
Fix vitastor-disk purge (now it works)
2022-12-27 02:28:20 +03:00
disk_tool_utils.cpp
Check if already mounted before mounting
2024-03-16 13:24:36 +03:00
disk_tool.cpp
Set 32k csum_block_size for HDD by default
2024-03-30 16:16:49 +03:00
disk_tool.h
Check if already mounted before mounting
2024-03-16 13:24:36 +03:00
epoll_manager.cpp
Support --logfile in nfs-proxy
2024-03-16 13:24:36 +03:00
epoll_manager.h
Allow to use epoll_manager without ringloop
2023-10-26 22:57:36 +03:00
etcd_state_client.cpp
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
etcd_state_client.h
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
fio_cluster.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
fio_engine.cpp
Use io_uring SQ size for ringloop capacity - otherwise get_sqe could return NULL when space_left() was > 0 under load
2023-11-20 03:04:06 +03:00
fio_headers.h
Fix compatibility with fio 3.28+
2022-01-31 23:39:14 +03:00
fio_sec_osd.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
http_client.cpp
vitastor-disk prepare: implement first form of the command
2022-08-09 01:29:29 +03:00
http_client.h
Move simple-offsets into vitastor-disk, too
2022-07-15 02:19:35 +03:00
kv_cli.cpp
Reduce kv-cli loadjson load parallelism to 16
2024-03-16 15:35:10 +03:00
kv_db.cpp
Allow to specify KV commands on command line
2024-03-16 13:24:36 +03:00
kv_db.h
K/V fixes after stress-test :-)
2024-03-16 13:24:36 +03:00
kv_stress.cpp
Allow to specify KV commands on command line
2024-03-16 13:24:36 +03:00
malloc_or_die.h
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
messenger.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
messenger.h
Experiment/WIP: Try to track "secondary" recovery ops separately
2023-12-31 01:23:17 +03:00
msgr_op.cpp
Experiment/WIP: Try to track "secondary" recovery ops separately
2023-12-31 01:23:17 +03:00
msgr_op.h
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
msgr_rdma.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
msgr_rdma.h
Support RDMA without ODP by stupidly copying memory. Disable ODP by default
2023-11-12 15:03:47 +03:00
msgr_receive.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
msgr_send.cpp
Experiment/WIP: Try to track "secondary" recovery ops separately
2023-12-31 01:23:17 +03:00
msgr_stop.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
nbd_proxy.cpp
Check if NBD_ATTR_BACKEND_IDENTIFIER is defined
2024-04-09 13:16:58 +03:00
nfs_block.cpp
Implement auto-unmount local NFS server mode for vitastor-nfs
2024-03-16 13:24:36 +03:00
nfs_block.h
Implement auto-unmount local NFS server mode for vitastor-nfs
2024-03-16 13:24:36 +03:00
nfs_common.h
Return block NFS implementation back as an option too
2024-03-16 13:24:36 +03:00
nfs_fsstat.cpp
Fix build errors for gcc 8
2024-03-16 15:35:10 +03:00
nfs_kv_create.cpp
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
nfs_kv_getattr.cpp
Implement async mtime change
2024-03-16 13:24:36 +03:00
nfs_kv_link.cpp
Support ctime
2024-03-16 13:24:36 +03:00
nfs_kv_lookup.cpp
Implement async mtime change
2024-03-16 13:24:36 +03:00
nfs_kv_read.cpp
Store pool ID in inode metadata
2024-03-16 13:24:36 +03:00
nfs_kv_readdir.cpp
Implement async mtime change
2024-03-16 13:24:36 +03:00
nfs_kv_remove.cpp
Store pool ID in inode metadata
2024-03-16 13:24:36 +03:00
nfs_kv_rename.cpp
Store pool ID in inode metadata
2024-03-16 13:24:36 +03:00
nfs_kv_setattr.cpp
Remove extra log
2024-03-16 13:24:36 +03:00
nfs_kv_write.cpp
Fix build errors for gcc 8
2024-03-16 15:35:10 +03:00
nfs_kv.cpp
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
nfs_kv.h
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
nfs_mount.cpp
Implement rename over an existing file/directory
2024-03-16 13:24:36 +03:00
nfs_portmap.cpp
Rename base64.{cpp.h} to str_util
2022-07-31 01:12:37 +03:00
nfs_portmap.h
Simplified NFS proxy based on own NFS/XDR implementation
2022-05-07 01:01:20 +03:00
nfs_proxy.cpp
Fix markdown tables
2024-03-16 15:35:10 +03:00
nfs_proxy.h
Store pool ID in inode metadata
2024-03-16 13:24:36 +03:00
object_id.h
Selectively sync nonsynced objects on STABILIZE/ROLLBACK (fix for github issue #51)
2023-04-08 02:44:02 +03:00
osd_cluster.cpp
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
osd_flush.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
osd_id.h
Store pool ID in inode metadata
2024-03-16 13:24:36 +03:00
osd_main.cpp
Use io_uring SQ size for ringloop capacity - otherwise get_sqe could return NULL when space_left() was > 0 under load
2023-11-20 03:04:06 +03:00
osd_ops.cpp
Implement "describe object(s)" operation
2023-05-20 23:19:39 +03:00
osd_ops.h
Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
2024-04-07 12:39:46 +03:00
osd_peering_pg_test.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
osd_peering_pg.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
osd_peering_pg.h
Implement "describe object(s)" operation
2023-05-20 23:19:39 +03:00
osd_peering.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
osd_primary_chain.cpp
Implement ambiguity detection during scrub
2023-05-20 23:19:39 +03:00
osd_primary_describe.cpp
Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
2024-04-07 12:39:46 +03:00
osd_primary_subops.cpp
Handle ENOSPC during write - rollback partial EC writes, remember partial replica writes
2024-04-07 18:02:05 +03:00
osd_primary_sync.cpp
Fix "opcode=5 retval=-2" errors sometimes possible with EC
2023-04-08 02:44:02 +03:00
osd_primary_write.cpp
Handle ENOSPC during write - rollback partial EC writes, remember partial replica writes
2024-04-07 18:02:05 +03:00
osd_primary.cpp
Handle ENOSPC during write - rollback partial EC writes, remember partial replica writes
2024-04-07 18:02:05 +03:00
osd_primary.h
Handle ENOSPC during write - rollback partial EC writes, remember partial replica writes
2024-04-07 18:02:05 +03:00
osd_rmw_test.cpp
Add a test for EC segfault with partial overwrite in 1234 -> 5030 rebalance scenario
2024-02-11 13:42:51 +03:00
osd_rmw.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
osd_rmw.h
Allow scrub to fix corrupted object states
2023-05-20 23:19:39 +03:00
osd_scrub.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
osd_secondary.cpp
Apply recovery pause before writes, after commits, and do not apply it to syncs to not block EC pools from functioning
2024-02-11 16:13:52 +03:00
osd_test.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
osd.cpp
Wait for blockstore initialisation before starting OSD
2024-02-27 02:20:04 +03:00
osd.h
Handle ENOSPC during write - rollback partial EC writes, remember partial replica writes
2024-04-07 18:02:05 +03:00
pg_states.cpp
Implement ambiguity detection during scrub
2023-05-20 23:19:39 +03:00
pg_states.h
Implement ambiguity detection during scrub
2023-05-20 23:19:39 +03:00
qemu_driver.c
Fix warning with QEMU 8.1
2023-12-04 01:59:07 +03:00
ringloop.cpp
Use io_uring SQ size for ringloop capacity - otherwise get_sqe could return NULL when space_left() was > 0 under load
2023-11-20 03:04:06 +03:00
ringloop.h
Use io_uring SQ size for ringloop capacity - otherwise get_sqe could return NULL when space_left() was > 0 under load
2023-11-20 03:04:06 +03:00
rw_blocking.cpp
Fix read/write return type in rw_blocking
2023-03-15 01:08:14 +03:00
rw_blocking.h
Support zero-copy send in fio_sec_osd to allow testing it
2021-12-27 02:12:44 +03:00
sha256.c
Simplified NFS proxy based on own NFS/XDR implementation
2022-05-07 01:01:20 +03:00
sha256.h
Simplified NFS proxy based on own NFS/XDR implementation
2022-05-07 01:01:20 +03:00
str_util.cpp
Move NBD netlink map&unmap to separate commands, add "netlink-revive" command
2024-04-08 16:34:41 +03:00
str_util.h
Add loadjson command to vitastor-kv
2024-03-16 13:24:36 +03:00
stub_bench.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
stub_osd.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
stub_uring_osd.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
test_allocator.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
test_blockstore.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
test_cas.cpp
Use io_uring SQ size for ringloop capacity - otherwise get_sqe could return NULL when space_left() was > 0 under load
2023-11-20 03:04:06 +03:00
test_cluster_client.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
test_crc32.cpp
Add crc32c test utility
2022-11-20 00:50:13 +03:00
test_pattern.h
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
test_shit.cpp
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
timerfd_manager.cpp
Prevent re-entry into timerfd set_nearest
2023-12-22 02:32:40 +03:00
timerfd_manager.h
Prevent re-entry into timerfd set_nearest
2023-12-22 02:32:40 +03:00
vitastor_c.cpp
Use io_uring SQ size for ringloop capacity - otherwise get_sqe could return NULL when space_left() was > 0 under load
2023-11-20 03:04:06 +03:00
vitastor_c.h
Allow to create vitastor_c with plain epoll without uring :-)
2023-10-26 22:57:36 +03:00
vitastor.pc.in
Release 1.6.0
2024-04-09 16:57:59 +03:00
xor.h
Move C/C++ sources to src subdirectory
2021-02-25 23:59:03 +03:00