Fine grained snapshots of data
InfinSnap for S3 enhances S3 with snapshot capabilities. Most applications treat S3 like a hierarchical file system and read multiple objects from S3, e.g. read all files in a directory for a machine learning training run, or an analytics query.
WHAT IS INFINSNAP?
Infinite fine grained snapshots of data stored in cloud object stores.
InfinSnap provides consistent snapshot view of data for applications including ML Training. InfinSnap is like a time machine for cloud object stores, enhanced to provide instant access to snapshots.
Reproducible ML Training is finally possible, because you can re-run the training against the same snapshot. Since a read-only copy of the data is perpetually available, you can go back and tweak parameters in past experiments and retrain against the same data.