13 ways to optimize LLM apps: 1 Right model for the task 2 Right model size/version 3 Quantization 4 Fine tuning 5 Improve prompts 6 Provide examples 7 Add context (RAG) 8 Provide structured data access 9 Integrate multiple information sources 10 Agents 11 Tools 12 Out-of-context variables 13 Orchestrate many agents
- 0 replies
- 0 recasts
- 0 reactions
Number go(ing) up.
- 0 replies
- 0 recasts
- 0 reactions
https://finance.yahoo.com/news/openai-dethroned-ai-giant-falling-163016242.html Haven’t tested it yet. 74B is still pretty big for most infrastructures. They have a 34B version. These larger models need more specific benchmarks that score on agent tasks.
- 0 replies
- 0 recasts
- 0 reactions