DateWeekSessionTopic and outcomesAssessment
Lecture
Introduction of machine learning and tools Basic Learning outcomes
Core · all students
- Set up Google Colab and run basic Python code
- Save and load data
- Create simple plots using matplotlib
- Simple data exploration and cleaning
- Use AI tools (ChatGPT/Copilot) to debug code
Advanced · MPS439
- Explore advanced IDE (VS Code/Cursor)
Assessment —
Lab
Tool usage: iPython notebook, Google Colab
Programming: Python basics and visualization
Assessment —
Lecture
linear regression (with a machine learning framework, input, output, loss, training) regression Learning outcomes
Core · all students
- Apply sklearn's LinearRegression to predict continuous outcomes
- Explain why minimizing squared error makes sense
- Understand metrics like R2, MSE, MAE, etc
- Describe what the normal equation solution tells us
- Compare training vs testing performance
Advanced · MPS439
- Reproduce full least squares derivation
- Implement gradient descent from scratch
Assessment Assessment 1 Release
Lab
linear regression
Assessment —
Lecture
linear regression Plus Learning outcomes
Core · all students
- Apply simple feature engineering
- Use Ridge and Lasso regression in sklearn
- Explain why Ridge regression shrinks coefficients toward zero
- Describe when regularization prevents overfitting
- Choose regularization strength using cross-validation
Advanced · MPS439
- Derive Ridge/Lasso cost functions using Lagrange multipliers
- Implement regularized regression from scratch
Assessment —
Lab
linear regression Plus
Assessment —
Lecture
linear classification (with metrics for classifications) classification Learning outcomes
Core · all students
- Apply LogisticRegression for binary classification
- Explain why we use sigmoid function for probabilities
- Describe when linear classification fails
- Interpret confusion matrices and classification metrics, ROC curve, AUC
Advanced · MPS439
- Derive cross-entropy loss function
- Implement logistic regression using gradient descent
Assessment Exercise 1 (optional)
Release
Lab
linear classification
Assessment —
Lecture
Discriminative analysis Learning outcomes
Core · all students
- Use sklearn's LinearDiscriminantAnalysis and QuadraticDiscriminantAnalysis
- Explain why LDA assumes equal covariances
- Describe when LDA vs QDA is appropriate
- Compare LDA vs logistic regression performance
Advanced · MPS439
- Derive LDA decision boundaries mathematically
- Implement LDA in python
Assessment —
Workshop (Optional)
Questions on assignments; General discussions;
Demonstration of AI for study
Assessment —
Lab
Discriminative analysis
Assessment —
Lecture
Decision Tree Learning outcomes
Core · all students
- Build decision trees using sklearn's DecisionTreeClassifier
- Explain how splitting criteria (Gini, entropy) work
- Describe when trees overfit and how to prevent it
- Interpret tree structure and feature importance
Advanced · MPS439
- Calculate Gini impurity by hand
- Explore using other classification method in sklearn (eg, SVM)
- Explore advanced ensemble methods (XGBoost)
Assessment Assessment 1 submission deadline
Lab
Decision Tree
Assessment —
Lecture
Reading week
Assessment Assessment 2 Release
Lecture
Principal component analysis (PCA) Dimension reduction (non-supervise learning) Learning outcomes
Core · all students
- Use sklearn's PCA for dimensionality reduction
- Explain why PCA finds directions of maximum variance
- Describe what eigenvalues represent
- Determine optimal number of components
Advanced · MPS439
- Derive PCA from eigenvalue decomposition
- Implement PCA using SVD from scratch
Assessment Exercise 1 (optional) submission deadline
Lab
Principal component analysis (PCA)
Assessment —
Lecture
k-means and Hierarchical Clustering Clustering (non-supervise learning) Learning outcomes
Core · all students
- Apply K-means clustering using sklearn
- Explain why K-means finds spherical clusters
- Describe when hierarchical vs K-means is better
- Choose optimal K using elbow method
Advanced · MPS439
- Implement K-means algorithm from scratch
Assessment —
Lab
k-means and Hierarchical Clustering
Assessment —
Lecture
Deep learning Deep Learning Learning outcomes
Core · all students
- Implementing neural networks using Keras
- Explain why we need multiple layers
Advanced · MPS439
- Understand the backpropagation algorithm
- Implement a simple neural network with different tricks: regularization, dropout, stochastic gradient descent, etc
Assessment Assessment 1 feedback to student
Lab
Deep learning
Assessment —
Lecture
Deep learning Convolutional network Learning outcomes
Core · all students
- Understand how a convolutional layer works
- Implementing a CNN using Keras
Advanced · MPS439
- Build Convolutional neural networks using Keras
- Describe what convolutions detect in images
- Load pre-built CNN (eg, vgg-16) or other architecture to a classification problem
Assessment Exercise 1 (optional) feedback to student
Workshop (Optional)
Questions on assignments; General discussions;
Demonstration of AI for study; convolutional networks and applications
Assessment —
Lab
Deep learning Convolutional network
Assessment —
Week Week 13
Assessment
Assessment 2 Submission deadline
Assessment —
Week —
Assessment
Assessment 2 feedback to student
Assessment —