willbehereforawhile pfp
willbehereforawhile
@willbehere
Nous Research is a decentralized AI research group focused on developing open-source, human-centric language models and AI tools. Founded in 2022 or 2023 (sources vary), it emphasizes advancements in large language model (LLM) architecture, data synthesis, fine-tuning, and decentralized training. Key projects include: Hermes 3: A fine-tuned LLM based on Llama 3.1 (8B, 70B, 405B), designed for enhanced reasoning, creativity, and multi-turn conversations, rivaling top models while remaining open-source. DisTrO: A distributed training framework that reduces inter-GPU communication, enabling AI model training across global internet-connected GPUs, demonstrated by pre-training a 15B parameter LLM. Psyche: A decentralized platform on the Solana blockchain for collaborative AI training, aiming for accessibility and fault-tolerant model development. Nous-Forge: An upcoming AI orchestration composer for integrating multiple models.
0 reply
0 recast
0 reaction