AI

Migrating the Hub from Git LFS to Xet

The Hugging Face team is moving its popular model hub, a platform for sharing and collaborating on AI models, from Git Large File Storage (Git LFS) to Xet. The change aims to improve the performance and scalability of the hub by reducing storage costs and increasing data transfer speeds. According to the team, Xet offers better compression rates and more efficient data retrieval than Git LFS.
The Hugging Face team is moving its popular model hub, a platform for sharing and collaborating on AI models, from Git Large File Storage (Git LFS) to Xet. The change aims to improve the performance and scalability of the hub by reducing storage costs and increasing data transfer speeds. According to the team, Xet offers better compression rates and more efficient data retrieval than Git LFS. --- Why it matters: This matters to researchers and engineers because it will make it easier for them to share and collaborate on large AI models, potentially speeding up innovation in areas like natural language processing and computer vision. Source: https://huggingface.co/blog/migrating-the-hub-to-xet

This article was originally published at: https://huggingface.co/blog/migrating-the-hub-to-xet