Sumários
Test 3 and Muli-Layer NNs
14 junho 2022, 15:30 • Pedro Alexandre Simões dos Santos
Test 3
Multi-layer Neural Networks
- Why are they needed
- Calculating the output in vector form
- The back-propagation algorithm
- The Universal Approximation Theorem
Neural Networks and Leaning
7 junho 2022, 15:30 • Pedro Alexandre Simões dos Santos
- What is "deep learning"?
- A Neuron
- One Neuron Neural Networks
- Logistic Regression
- What error function?
- Calculation of the gradient
- Implementation of SGD
- Limitations of one layer NNs
Learning and Optimization
6 junho 2022, 14:00 • Pedro Alexandre Simões dos Santos
- Learning as Optimization
- Convex Learning Problems
- Gradient Descent Algorithms
- Stochastic Gradient Descent
- Possible problems with GD algorithms
- Advanced Optimization for GDAs