AI Engineer
12 Followers
Just applied, thank you!
recast:farcaster://casts/0x874d92916fa2a80210051043e57a84a2510922ab6999f6f17b0a0fa8b8f5ac42
I'm in farhack and just finished setting up a Gradio server emulating openai API using locally hosted custom Llama 3 with vLLM. Awesome times
Here is the link to our live LLM demo 70ee76bd73cc936db8.gradio.live