Personal thoughts, projects, and discoveries
Interesting article: GPT in 60 Lines of NumPy | Jay Mody. Implementing a GPT model from scratch in NumPy. This is a detailed article including python source code. Ive skimmed it and it does explain a lot. But even without my being a neural net, ai, machine learning, gpt, chatgpt expert, i think i would learn a lot. Also the article is very well written presented. Note: written a few years ago before we know how far the "AI thing" was going to go!
I've been dreading this: My robot's rasberry pi 5 was built months ago. I have been using it a lot, installing, updating and changing code and config. All my code is separately in github repos. But there is a lot more state than the github repos. It is in config files, pip installs, and so on. I s...
I came across this fascinating piece by Adrian Colyer — Applying the Universal Scalability Law to organisations — and it genuinely reframed how I think about both technical systems and leadership. The core...
I came across a fascinating research paper that puts LLMs head-to-head with human participants in a classic creativity task, and the results are worth sitting with for a moment. [Ideas are Dimes a Dozen: Large Language Models for Idea Generation in Innovation](https://papers.ssrn.com/sol3/papers.cfm...
I stumbled across this post by Hamel Husain on Dokku and immediately wanted to spin up a server to try it. The pitch is simple but compelling: it's essentially Heroku, except you own the infrastructure. ...