[CONTROLLER-1915] Allow incremental recovery Created: 12/Sep/19 Updated: 12/Jan/21 Resolved: 14/Jun/20 |
|
| Status: | Resolved |
| Project: | controller |
| Component/s: | clustering |
| Affects Version/s: | None |
| Fix Version/s: | Magnesium SR2, Sodium SR4, 2.0.3 |
| Type: | Improvement | Priority: | Medium |
| Reporter: | Robert Varga | Assignee: | Tibor Král |
| Resolution: | Done | Votes: | 0 |
| Labels: | pt | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Description |
|
Currently state recovery logic operates in a way, where the entire journal has to be replayed before recovery succeeds. If this takes a long time and the process is aborted, it will restart from the beginning. Expose a configuration knob, which will allow taking snapshots and purging journal entries in batches, i.e. for 10K journal entries we would process a 1000 of them and then create a snapshot and purge them. This would allow the process to finish faster on subsequent attempts. |