Transformer models: an introduction and catalog — 2023 Edition
Link: Transformer models: an introduction and catalog — 2023 Edition: "Author" "I have a terrible memory for names. In the past few years we have seen the meteoric appearance of dozens of models of the Transformer family, all of which have funny, but not self-explanatory, names. The goal of this post is to offer a short and simple catalog and classification of the most popular Transformer models. In other words, I needed a Transformers cheat-sheet and couldn’t find a good enough one online, so I thought I’d write my own. I hope it can be useful to you too""
How The Post is replacing Mapbox with open source solutions - Kevin Schaul
Link: How The Post is replacing Mapbox with open source solutions - Kevin Schaul: "Last week I published a story for The Washington Post that required an interactive slippy map. Lookup maps like this are a common pattern to show a geographic trend and let readers explore the data …"
How The Post is replacing Mapbox with open source solutions – Kevin Schaul
How The Post is replacing Mapbox with open source solutions - Kevin Schaul –Last week I published a story for The Washington Post that required an interactive slippy map. Lookup maps like this are a common pattern to show a geographic trend and let readers explore the data …
Rails initializers you don't know about - Inflections
Link: Rails initializers you don't know about - Inflections: "Fun Rails Esoterica. One of the features that new Rails people are amused and surprised by: "Rails come with a lot of initializers that we are not quite familiar with. One of them is the inflections initializer. In this post, we will look at what inflections.rb is and how we can use them.""
Rails initializers you don’t know about – Inflections
Rails initializers you don't know about - Inflections –Fun Rails Esoterica. One of the features that new Rails people are amused and surprised by: "Rails come with a lot of initializers that we are not quite familiar with. One of them is the inflections initializer. In this post, we will look at what inflections.rb is and how we can use them."
What Is ChatGPT Doing … and Why Does It Work?
Link: What Is ChatGPT Doing … and Why Does It Work?: "This is a pretty amazing article. Even though it's "non technical" and I read all of it, I think I only understood about 75%: "Stephen Wolfram explores the broader picture of what's going on inside ChatGPT and why it produces meaningful text. Discusses models, training neural nets, embeddings, tokens, transformers, language syntax.""
GPT in 60 Lines of NumPy | Jay Mody
Link: GPT in 60 Lines of NumPy | Jay Mody: "Implementing a GPT model from scratch in NumPy. This is a detailed article including python source code. Ive skimmed it and it does explain a lot. But even without my being a neural net, ai, machine learning, gpt, chatgpt expert, i think i would learn a lot. Also the article is very well written presented."
Inter-process communication in Linux: Using pipes and message queues
Link: Inter-process communication in Linux: Using pipes and message queues: "Learn how processes synchronize with each other in Linux."
Visual design rules you can safely follow every time
Link: Visual design rules you can safely follow every time: "I love rules of thumb. Here are a set of them for graphic or visual design. I am not a designer but I fancy myself being to tell better design from worse. Anyway, this is a good tool for those of us who are wannabee designers"
35% Faster Than The Filesystem
Link: 35% Faster Than The Filesystem: "An interesting study of performance. It seems hard to believe."