Essays · guides · experiments

Articles

Thoughts on AI, NLP, and building things

13 pieces

Latest writing

All writing

01

NLP

Series · Part 4/5

How to grow a rock

Scaling laws, the compute arms race, and the quadratic wall — how the AI industry learned that bigger models need bigger appetites.

How to grow a rock
02

NLP

Series · Part 5/5

How to teach a rock to see

From pixels to poetry — how one architecture learned to see, hear, and dream.

How to teach a rock to see
03

NLP

Series · Part 2/5

How to teach a rock to understand

From short-term amnesia to Attention — how Transformers broke the AI industry wide open.

How to teach a rock to understand
04

NLP

Series · Part 3/5

How to teach a rock to write

GPT-3, hallucinations, and the art of whispering to a calculator — how the infinite autocomplete changed everything.

How to teach a rock to write
05

NLP

Series · Part 1/5

How to teach a rock words

From Word2Vec to Attention — how machines learned to understand words, with interactive visualizations.

How to teach a rock words
06

AI & Economy

When the Machines Came for the Farmers

What the Agricultural Revolution teaches us about AI's impact on the global workforce — with interactive data visualizations.

When the Machines Came for the Farmers
07

Archived from Labelf

Can AI Help Design Our Mascot?

We ordered designs from freelancers and compared them to what AI could generate. The results were surprising.

Can AI Help Design Our Mascot?
08

Archived from Labelf

An AI-Generated Art Experience

How far has AI (deep learning) come? We tested creating a fully AI-generated experience.

An AI-Generated Art Experience
09

Archived from Labelf

What is "Narrow AI part 1"

The type of AI we currently have is Narrow AI. I will with two posts try to explain what that means in practice for someone wishing to utilize deep learning.

What is "Narrow AI part 1"
10

Archived from Labelf

AI Surpasses The Human Baselines on SuperGLUE

Understanding AI progress and its current capabilities through the SuperGLUE benchmark.

AI Surpasses The Human Baselines on SuperGLUE
11

Articles

Training a Transformer

Some advice for training a Transformer in a new language

Training a Transformer
12

Articles

What does this new language understanding mean for us?

AI gets a better score than 80% of Swedes on our advanced test for language understanding

What does this new language understanding mean for us?