[CONTROLLER-1912] Compress snapshots before they are sent to followers Created: 12/Sep/19 Updated: 12/Sep/19 |
|
| Status: | Open |
| Project: | controller |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Improvement | Priority: | Medium |
| Reporter: | Tomas Cere | Assignee: | Tomas Cere |
| Resolution: | Unresolved | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Description |
|
Using something like lz4 should be quite cheap on processing power. Tests shown the fast compressor can shrink 450mb snasphot down to 60mb while taking 3 seconds for the compression stage and less than 1 second for the decompression. |
| Comments |
| Comment by Robert Varga [ 12/Sep/19 ] |
|
Three seconds feels quite heavy, but then it may be worth it on the storage side. I wonder if we should be looking at making some sort of size-based cut-off. |