🔗 Linkdump: LLMs
The more I'm getting into large language models (LLMs), the more I'm fascinated about what you can do with them. To "digest" my reading list of cool articles and projects regarding LLMs, I assembled the following list. If you're also interested but haven't started your journey into this neverending rabbit hole, these may contain some good pointers:
Running LLMs
- Ollama - Host different LLMs locally (extremely easy!)
- vLLM - Like Ollama but more scalable and production-ready
- llamafile - LLMs as a single, portable binary
Building Chatbots & Applications
- LlamaIndex - Framework for building LLM applications
- create-llama - LlamaIndex template generator (perfect for if you don't know how to structure your app)
- LangChain - Like LlamaIndex with a less clean interface IMO
- Haystack - Another LLM framework. Haven't tested it though
- Vercel AI SDK - For integrating your LLM app into a web frontend
Training and finetuning
- HuggingFace - GitHub but for LLMs
- LoRA for Fine-Tuning LLMs explained with codes and example - Great LoRA Primer
- AutoTrain - NoCode LLM finetuning
- llm-toolkit - Another finetuning framework
- MLFlow - End to End platform for LLM training
Miscellaneous projects
Blogs
- Simon Willison - Awesome posts from a LLM enthusiast
- Matt Richard - Matt is currently inactive, but his blog is a treasure trove