AI

AI

The Technology Behind BLOOM Training

BLOOM is a large language model trained using the Megatron-LaNRL and DeepSpeed technologies. These tools allow for more efficient training of models, ...

Jul 14 πŸ—³οΈ 0 πŸ’¬ 0
AI

Policy Gradient with PyTorch

Researchers at Hugging Face have implemented policy gradient methods using PyTorch, a popular deep learning framework. The implementation is part of t...

Jun 30 πŸ—³οΈ 0 πŸ’¬ 0
AI

DALLΒ·E 2 pre-training mitigations

OpenAI has implemented safeguards for its DALLΒ·E 2 model to minimize the risk of generating objectionable content. These 'guardrails' aim to prevent i...

Jun 28 πŸ—³οΈ 0 πŸ’¬ 0
AI

Accelerate Large Model Training using DeepSpeed

Hugging Face's researchers have developed a method to speed up large model training using an open-source library called DeepSpeed. The technique lever...

Jun 28 πŸ—³οΈ 0 πŸ’¬ 0
AI

Announcing Evaluation on the Hub

Hugging Face has announced a new feature called 'Evaluation on the Hub', which allows users to evaluate and compare models directly within their model...

Jun 28 πŸ—³οΈ 0 πŸ’¬ 0
AI

Getting Started With Embeddings

Hugging Face's blog post 'Getting Started with Embeddings' provides an introduction to word embeddings, a fundamental concept in natural language proc...

Jun 23 πŸ—³οΈ 0 πŸ’¬ 0