state.backend.rocksdb.memory.fixed-per-slot |
(none) |
MemorySize |
The fixed total amount of memory, shared among all RocksDB instances per slot. This option overrides the 'state.backend.rocksdb.memory.managed' option when configured. |
state.backend.rocksdb.memory.fixed-per-tm |
(none) |
MemorySize |
The fixed total amount of memory, shared among all RocksDB instances per Task Manager (cluster-level option). This option only takes effect if neither 'state.backend.rocksdb.memory.managed' nor 'state.backend.rocksdb.memory.fixed-per-slot' are not configured. If none is configured then each RocksDB column family state has its own memory caches (as controlled by the column family options). The relevant options for the shared resources (e.g. write-buffer-ratio) can be set on the same level (flink-conf.yaml).Note, that this feature breaks resource isolation between the slots |
state.backend.rocksdb.memory.high-prio-pool-ratio |
0.1 |
Double |
The fraction of cache memory that is reserved for high-priority data like index, filter, and compression dictionary blocks. This option only has an effect when 'state.backend.rocksdb.memory.managed' or 'state.backend.rocksdb.memory.fixed-per-slot' are configured. |
state.backend.rocksdb.memory.managed |
true |
Boolean |
If set, the RocksDB state backend will automatically configure itself to use the managed memory budget of the task slot, and divide the memory over write buffers, indexes, block caches, etc. That way, the three major uses of memory of RocksDB will be capped. |
state.backend.rocksdb.memory.partitioned-index-filters |
false |
Boolean |
With partitioning, the index/filter block of an SST file is partitioned into smaller blocks with an additional top-level index on them. When reading an index/filter, only top-level index is loaded into memory. The partitioned index/filter then uses the top-level index to load on demand into the block cache the partitions that are required to perform the index/filter query. This option only has an effect when 'state.backend.rocksdb.memory.managed' or 'state.backend.rocksdb.memory.fixed-per-slot' are configured. |
state.backend.rocksdb.memory.write-buffer-ratio |
0.5 |
Double |
The maximum amount of memory that write buffers may take, as a fraction of the total shared memory. This option only has an effect when 'state.backend.rocksdb.memory.managed' or 'state.backend.rocksdb.memory.fixed-per-slot' are configured. |
state.backend.rocksdb.timer-service.factory |
ROCKSDB |
Enum |
This determines the factory for timer service state implementation.
Possible values:- "HEAP": Heap-based
- "ROCKSDB": Implementation based on RocksDB
|