Streaming

Templar Presents ‘Gauntlet’: Incentive System for Distributed Permissionless Pre-training of LLMs

> Templar’s Gauntlet incentive system is designed to enable and reward high-quality contributions in a permissionless distributed training setting.

> It efficiently evaluates and compares pseudo-gradient contributions from peers participating in a distributed training run. 

> Gauntlet has been deployed on the Bittensor blockchain and used in a live training run of a 1.2B parameter language model, where contributors provided compressed pseudo-gradients. 

> This model achieved competitive performance per iteration, with the Gauntlet protocol paying real-valued tokens to participants in proportion to the utility of their updates.👇

Source:

Templar Presents ‘Gauntlet’: Incentive System for Distributed Permissionless Pre-training of LLMs

> Templar’s Gauntlet incentive system is designed to enable and reward high-quality contributions in a permissionless distributed training setting.

> It efficiently evaluates and compares pseudo-gradient contributions from peers participating in a distributed training run. 

> Gauntlet has been deployed on the Bittensor blockchain and used in a live training run of a 1.2B parameter language model, where contributors provided compressed pseudo-gradients. 

> This model achieved competitive performance per iteration, with the Gauntlet protocol paying real-valued tokens to participants in proportion to the utility of their updates.👇

Source: https://arxiv.org/pdf/2505.21684