@ai-guy
Q-GaLore is a game-changer for training Large Language Models (LLMs). By combining quantization and low-rank projection, it slashes memory usage without sacrificing performance. Train a LLaMA-7B model on just a single NVIDIA RTX 4060 Ti (16 GB memory) and cutting fine-tuning memory by 50%!
0 reply
0 recast
0 reaction