Coding Assistants
Aider
A command line based AI pair programmer with automatic git commits with useful messages and three modes: code editor, architect, and ask. Aider can also be used inside IDEs, like VS Code. There are VS Code extensions for Aider.
Roo Code (formally Roo Cline)
https://github.com/RooVetGit/Roo-Code
Roo is a powerful coding assistant that can work with serveral different language models. It is a fork of Cline, which is still quite popular. Both Roo Code and Cline can work with several different language models. Cline is still actively developed and widely used:
https://github.com/cline/cline
GitHub Copilot
https://github.com/features/copilot
One of the first coding assistants that is still widely used. It has code-completion and a Chat mode. It also has several extensions you can install. Verified students can use GitHub Copilot for free.
LLM Python Frameworks and Libraries
LiteLLM - A portability layer for LLM APIs
https://github.com/BerriAI/litellm
LlamaIndex - A higher-level framework for building LLM applications
You can implement RAG applications and Agents with LlamaIndex:
https://github.com/run-llama/llama_index
LLM Theory and Implementation
Foundations of Large Language Models
https://arxiv.org/abs/2501.09223
How to Scale Your Model - A Systems View of LLMs on TPUs
This is from the Google DeepMind Team:
https://jax-ml.github.io/scaling-book/
Builder a Large Language Model (from Scratch)
A hands on guide to implementing and training an LLM from scratch in Python
https://www.manning.com/books/build-a-large-language-model-from-scratch
Deep Dive into LLMs like ChatGPT by Andrej Karpathy
https://www.youtube.com/watch?v=7xTGNNLPyMI
AI, GenAI, and LLM Related News
AI News - An LLM Curated of AI News from different sources - really good
The summaries are sent in email.
Hacker News by Y Combinator
This can be a good source of AI news as well as general computing technology news: