Overview This course introduces undergraduate computer science students to the field of machine learning. Assuming no prior knowledge in machine learning, the course focuses on two major paradigms in machine learning which are supervised and unsupervised learning. In supervised learning, we learn various methods for classification and regression. Dimensionality reduction and clustering are discussed in the case of unsupervised learning. If time permits, we will learn how to extend those methods to be deep. ## Target AudienceThis course is aimed at 3rd- or 4th-year undergraduate students in computer science. ## For non-CS studentsPlease contact either Romeo Kumar <kumar _at_ cs.nyu.edu> or Leeann Longi <longi _at_ cs.nyu.edu>, the student adivors at the CS Department, directly. ## General InformationLecture: 9.30-10.45am on Mondays and Wednesdays at 60 5th Ave (C12) These are chalkboard lectures, and there will not be any slide.
Instructor: Kyunghyun Cho Grader: Varun D N
Office Hours Instructor: 11.00-12.00 on Mondays at 60 5th Ave (616) TA: 2-3pm on Fridays at 60 5th Ave (660)
Grading: Homeworks (40%) + Final Exam (40%) + Review Paper (20%) Final Exam: 8.00am-9.50am on May 10 (Wed)
Course Site: https://piazza.com/nyu/spring2017/csciua0473001/home
Book: [tentative] The following books are highly recommended but not necessary. Kevin Murphy. Machine Learning: a Probabilistic Perspective. 2nd edition. Chris Bishop. Pattern Recognition and Machine Learning. Andreas C. Müller & Sarah Guido. Introduction to Machine Learning with Python.
Lecture Note The lecture note will be updated before each lecture at
https://github.com/nyu-dl/Intro_to_ML_Lecture_Note/blob/master/lecture_note.pdf ## Prerequisites## RequiredMATH-UA 121 Calculus I CSCI-UA 310 Basic Algorithms MATH-UA 140 Linear Algebra (may be taken together)
## RecommendedMATH-UA 235 Probability and Statistics MATH-UA 234 Mathematical Statistics DS-GA 1001 Introduction to Data Science Exercise materials are highly recommended. DS-GA 1002 Statistical and Mathematical Methods
## ScheduleNote that the schedule below is only a guideline. The content of each lecture will be decided as the course progresses.
## HomeworksThere will be bi-weekly homeworks, starting from the second week of the semester. Each homework will be announced at the beginning of the lecture on Wednesday every other week. The answer must be submitted by email to the grader within two weeks after the announcement, and there will be no extension. All the answers must be typesetted using either LaTeX or Microsoft Word and submitted as a pdf file. Handwritten answers will not be accepted. Each homework may include one or more programming assignments. ## Review PaperAs a part of the course, a student is expected to read at least five research papers on one of the following topics and summarize them into a single review paper. From perceptron, neocognitron to modern convolutional networks. Matrix Factorization for Collaborative Filtering: from SVD, non-negative matrix factorization, probabilistic PCA to Bayesian matrix factorization Gaussian Process Latent Variable Models: from PCA to Gaussian process latent variable models and deep Gaussian process Unsupervised representation learning: independent component analysis, sparse coding, restricted Boltzmann machines and denoising autoencoders From k-means algorithm, Gaussian mixture models to the infinite Gaussian mixture model
Each student must compile a list of at least ten papers to read by March 1 and send by email the list to the instructor for feedback. Based on the feedback, the student should choose at least four papers from the list and write a review paper. The review paper must put different models under a single general framework and describe each model as its special case. In doing so, the similarities among those models will naturally emerge, and differences must be separately discussed in detail. The final review paper must be sent by email to the instructor by May 5. ## RemarksA student in this course is expected to act professionally. Please also follow the GSAS regulations on academic integrity found here http://gsas.nyu.edu/page/academic.integrity |