PhysicsWallah’s Aryabhata 1.0 Scores 90.2% in JEE — Outperforms Open-Weight AI Models, Trails Frontier Leaders PhysicsWallah PhysiscsWallah , an ed-tech startup has developed and launched a small language model ((SLM) named as " Aryabhata 1.0 ",a 7-billion parameter LLM containing 4000 tokens. The model is named after ancient Indian mathematician. The naming of the model reflects India's longstanding heritage in mathematical advancements. Aryabhata 1.0 Math Benchmarks How the model is built? Physicswallah AI Research division started by merging several models including Qwen 2.5 Math, an Alibaba backed open model, Ace Math, a Nvidia tuned Qwen model for mathematical benchmarking, DeepSeek R1 Distill for reasoning, which is then trained on 130k questions distilled from PhysicsWallah's database. The company stated that it used in-house Group Relative Policy Optimiation (GRPO) as a math specific reward function, removing KL divergence penalty (An approach designed ...
News | Insights | Opinion