AI

Releasing Swift Transformers: Run On-Device LLMs in Apple Devices

Apple has released a new library called Swift Transformers, which allows users to run large language models (LLMs) on Apple devices. The library is based on the Hugging Face Transformers model and uses Core ML for on-device processing. This means that LLMs can now be used in apps running on iPhones and iPads without requiring internet connectivity or cloud services.
Apple has released a new library called Swift Transformers, which allows users to run large language models (LLMs) on Apple devices. The library is based on the Hugging Face Transformers model and uses Core ML for on-device processing. This means that LLMs can now be used in apps running on iPhones and iPads without requiring internet connectivity or cloud services. --- Why it matters: This release matters to AI researchers because it enables the development of more portable and self-sufficient language models, which can run independently on Apple devices without relying on external infrastructure. This could lead to new applications and use cases for LLMs in mobile and embedded systems. Source: https://huggingface.co/blog/swift-coreml-llm

This article was originally published at: https://huggingface.co/blog/swift-coreml-llm