PyTorch

A little PyTorch

Notebook (download/open locally): /kicsigeze/notebooks/03_pytorch_mini_intro.ipynb

What you should get out of this

  • Understand tensors vs NumPy arrays (device, dtype, gradients)
  • Understand autograd and how computation graphs behave
  • Implement a tiny training loop (linear regression / 2-layer MLP)

Exercises (quick list)

  • Re-derive MSE gradient and validate with autograd
  • Train logistic regression on a synthetic dataset
  • Add L2 regularization and observe effect

Readings/videos: Reading / Videos