lakeFS

lakeFS provides Git-like version control and management for data lakes built on object storage. It enables isolated experimentation, data governance, and atomic operations, including zero-copy branching on petabytes of data. This platform offers a higher-level abstraction for managing data lifecycle and collaboration within data lakes. It supports reproducible ML workflows and is designed for petabyte-scale data. lakeFS provides a data lake versioning platform with an API, offering capabilities for data management and ML/AI use cases. Both open source and enterprise versions are available.