1  Syllabus

1.1 Content by week

Week Content Notes
1 Introduction to Neural Networks and LLM
2 Single-Layer Perceptrons
3 Multi-Layer Perceptrons
4 Torch and autograd, Activation functions
5 Loss functions, convexity, gradient descent, optimizers
6 Recurrent Neural Networks: GRU, LSTM
7 Attention Mechanisms and Transformers
8 Encoding
9 Embedding
10 GPT Model
11 Pre training
12 Fine tuning Classification
13 Fine tuning To Follow Instructions
14 Review other models GPT4, Deepseek

1.2 Books

1.3 Exams

  • %40 Midterms
  • %60 Finals