Start the course
machine learning, from scratch

kino is a course in AI, machine learning and deep learning. Learn how models become less wrong, from a single dot product to a transformer, by reading the idea, passing the test and writing the code yourself.

6 modules / 18 units / 54 lessons / 42 challenges / 0 installs

the roadmap

Six modules. From a dot product to a transformer.

  1. 01

    The maths of learning

    Vectors, gradients and probability: the three tools every model is built from.

    • Vectors and matrices
    • Derivatives and gradients
    • Probability and statistics
    • Project: Fit a line by gradient descent
  2. 02

    Supervised learning

    Learning a mapping from labelled examples: regression, classification, neighbours, trees and ensembles.

    • Linear regression
    • Classification
    • Neighbours, trees and ensembles
    • Project: A flower classifier from scratch
  3. 03

    Models that generalise

    Overfitting, regularisation, honest evaluation, and learning from data without labels.

    • Overfitting and regularisation
    • Measuring models honestly
    • Learning without labels
    • Project: An honest diagnosis model
  4. 04

    Neural networks

    From a single neuron to backpropagation, and the tricks that make deep networks train.

    • Neurons and networks
    • Backpropagation
    • Training deep networks
    • Project: A digit recogniser from scratch
  5. 05

    Deep architectures

    Convolutions for images, recurrence for sequences, and attention, the idea behind transformers.

    • Convolutional networks
    • Sequence models
    • Attention and transformers
    • Project: Train a convolutional network from scratch
  6. 06

    Language models and generative AI

    How large language models and image generators work: tokens, next-token prediction, scaling, alignment and diffusion.

    • Language models
    • Large language models
    • Generating images
    • Project: A tiny language model
how every unit works

Read it, test it, code it. Then build something real.

01

Three lessons

Short articles with interactive figures you can drag, and code cells you can edit and run on the spot.

02

A theory test

Six questions on the ideas. Pass at 80%, retake as often as you like, and read why each answer is right.

03

A practical

Write a function in Python. Hidden checks run against it in your browser and tell you exactly what's off.

04

A project

Every module ends with a guided build on real data: a line fit, a classifier, a neural network, a language model.

runs in your browser

Real Python and numpy, on your machine. Nothing to install.

practical 2.2 / your code
def softmax(z):
    z = z - z.max(axis=1, keepdims=True)
    e = np.exp(z)
    return e / e.sum(axis=1, keepdims=True)

Python runs inside the page through WebAssembly, so your code never leaves your computer and a runaway loop can be stopped with one click.

hidden checks
  • rows sum to 1
  • matches the formula on a small example
  • survives logits of 1000 without overflowing
  • works on a batch of 64 rows
finish the course

Solve all 42 and download a certificate with your name on it.

The Kino Certificate in AI/ML is issued when every theory test, practical and project passes. It carries the first and last name on your account, the date you finished, and a certificate number.

See it full size →
built on the classics

Distilled from the courses and books the field learns from.

Stanford CS229

Andrew Ng's machine learning course: the derivations behind regression, classification and generalisation.

Stanford CS231n

Convolutional networks and backpropagation, taught by building them in numpy.

Dive into Deep Learning

The open textbook used at hundreds of universities, from linear algebra to transformers.

Zero to Hero

Andrej Karpathy's series that builds autograd and a GPT from an empty file.

The full reading list →

Start with a single vector.

Lesson 1.1 takes nine minutes and ends with your first lines of numpy.

Start the course →