FM News
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
On a story from Hugging Face3h ago
Read the original at huggingface.co
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
fmode.me/n/scaling-indic-pretraining-28-trillion-tokens-and-an-open-data-generation-pipeline
More from FM News
When it came to Cal AI’s viral success, a small army of influencers paid off1 pts · TechCrunch AI40+ startups calling BS on AI fakes1 pts · CB InsightsHackers hijacked 1,900 GitHub accounts. Then they went after 30,000 repos.1 pts · The New StackGranite Switch 4.1: Chat, Decisions, and Speech from One Endpoint1 pts · Hugging Face