🔗 Linkdump: LLMs


The more I'm getting into large language models (LLMs), the more I'm fascinated about what you can do with them. To "digest" my reading list of cool articles and projects regarding LLMs, I assembled the following list. If you're also interested but haven't started your journey into this neverending rabbit hole, these may contain some good pointers:

Running LLMs

  • Ollama - Host different LLMs locally (extremely easy!)
  • vLLM - Like Ollama but more scalable and production-ready
  • llamafile - LLMs as a single, portable binary

Building Chatbots & Applications

  • LlamaIndex - Framework for building LLM applications
  • create-llama - LlamaIndex template generator (perfect for if you don't know how to structure your app)
  • LangChain - Like LlamaIndex with a less clean interface IMO
  • Haystack - Another LLM framework. Haven't tested it though
  • Vercel AI SDK - For integrating your LLM app into a web frontend

Training and finetuning

Miscellaneous projects


  • Simon Willison - Awesome posts from a LLM enthusiast
  • Matt Richard - Matt is currently inactive, but his blog is a treasure trove

Continue Reading