Intelligent Tiering for RGW
Day 1 | 11:05 | 00:30 | K.3.401 | Shreyansh Sancheti, Jiffin Tony Thottan
Note: I'm reworking this at the moment, some things won't work.
Ceph can currently provide Tiering(Storage Classes) using different pools in the Ceph on-prem cluster and can also do cloud transitions(AWS, s3 compatible endpoints). The movement of data through different storage classes can be achieved using S3 lifecycle rules based on the age of the files. Intelligent tiering for RGW (Rados Gateway) is a feature in Ceph storage that automatically moves data between storage tiers based on policies. This feature optimises storage costs and performance by moving frequently accessed data to faster storage tiers and less frequently accessed data to lower-cost, higher-capacity tiers. The intelligent tiering policy is customizable, allowing users to define criteria for data migration, such as access frequency, time, and size. This feature is particularly useful for large-scale object storage deployments, where optimizing storage costs and performance is crucial. The first step is to extend the existing cloud transition to include features like read-through, restore API(like glacier in s3 protocol)