Computational cognitive modeling - Spring 2024

NYU PSYCH-GA 3405.004 / DS-GA 1016.003

This project is maintained by brendenlake

Computational cognitive modeling - Spring 2024

Instructors: Brenden Lake and Todd Gureckis

Teaching Assistants: Solim LeGris and Cindy Luo

Meeting time and location:
Lecture. Lectures are on Thursdays 10-11:40AM in 12 Waverly Pl Room G08. There is no zoom or lecture capture; if you can’t make it to class, you can email us to request last year’s video (instructors-ccm-spring2024@googlegroups.com).

Labs. Fridays 12:30-1:20PM in 12 Waverly Pl Room G08. Labs are recorded.

Brightspace access for waitlist and auditors. We won’t need bright space for anything except lab recordings. If you feel you need bright space access and don’t have it, please add your email to this spreadsheet. We will add the emails from the spreadsheet periodically.

Course numbers:
DS-GA 1016 (Data Science)
PSYCH-GA 3405.004 (Psychology)

Contact information and Ed Discussion:
The class Ed Discussion page is the main point of contact. We use Ed Discussion for questions and class discussions. Rather than emailing questions to the teaching staff, please post your questions on Ed Discussion. It will get you a faster response and the answer will benefit others with the same question.

Enrolled students should automatically have access to the Ed Discussion. If for whatever reason this isn’t the case for you, a signup link for our Ed Discussion page is available here (https://edstem.org/us/join/xCQY7G).

Once enrolled, our class Ed Discussion page is available here (https://edstem.org/us/courses/55155/discussion/).

If you have a question that isn’t suitable for Ed Discussion and there is a need to email the teaching staff directly, please use the following email address: instructors-ccm-spring2024@googlegroups.com

Office hours:
Default is in person, but email us to request zoom if need be.
Brenden Lake, Mondays 4:30-5:30pm, 60 5th Ave., Room 610
Todd Gureckis, Wednesdays, 2-3pm, 6 Washington Place, Room 590
Solim LeGris, Tuesdays, 1-2pm, 6 Washington Place, Room 593
Cindy Luo, Mondays 2-3pm, 60 5th Ave., Room 242

Summary: This course surveys the leading computational frameworks for understanding human intelligence and cognition. Both psychologists and data scientists are working with increasingly large quantities of human behavioral data. Computational cognitive modeling aims to understand behavioral data and the mind and brain, more generally, by building computational models of the cognitive processes that produce the data. This course introduces the goals, philosophy, and technical concepts behind computational cognitive modeling.

The lectures cover artificial neural networks (deep learning), reinforcement learning, Bayesian modeling, model comparison and fitting, classification, probabilistic graphical models, and program induction. Modeling examples span a broad set of psychological abilities including learning, categorization, language, memory, decision-making, and reasoning. The homework assignments include examining and implementing the models surveyed in class. Students will leave the course with a richer understanding of how computational modeling advances cognitive science, how cognitive science can inform research in machine learning and AI, and how to fit and evaluate cognitive models to understand behavioral data.

Please note that this syllabus is not final and there may be further adjustments.

Pre-requisites

Grading

The final grade is based on the homeworks (65%) and the final project (35%).

Class participation may be used to decide grades in borderline cases.

Final Project

The final project proposal is due April 10 (0.5 pages written). Please submit via email to instructors-ccm-spring2024@googlegroups.com with the file name lastname1-lastname2-lastname3-ccm-proposal.pdf. Make sure to include the names of all of your group members at the top of the document too.

The final project is due May 10. Please submit via email to instructors-ccm-spring2024@googlegroups.com with the file name lastname1-lastname2-lastname3-ccm-final.pdf. Make sure to include the names of all of your group members at the top of the document too.

The final project will be done in groups of 3-4 students. A short paper will be turned in describing the project (approximately 6 pages). The project will represent either a substantial extension of one of the homeworks (e.g., exploring some new aspect of one of the assignments), implementing and extending an existing cognitive modeling paper, or a cognitive modeling project related to your research. We provide a list of project ideas here, but of course, you do not have to choose from this list.

The final project must relate to computational cognitive modeling and cannot be a purely machine learning / data science project. Thus, your project must connect, in some way, to the human mind and behavior. This could be collecting (informally) behavioral data to compare your computational model to. Or you could compare your model against results in the literature or particular dataset of human behavior or ratings. Or you could compare your algorithm with human intelligence in a more abstract sense. There are many ways to make the connection, but your final project must connect to cognitive modeling.

Your write-ups should be organized and written as a scientific paper. We encourage you to use this latex template. It must include the following sections: Introduction (with review of related work), Methods/Models, Results, and Discussion/Conclusion. Here is a good example:
Singh, P., Peterson, J. C., Battleday, R. M., & Griffiths, T. L. (2020). End-to-end deep prototype and exemplar models for predicting human behavior. Proceedings of the 42nd Annual Conference of the Cognitive Science Society. link here

Code submission is not required for the final project.

Lecture schedule

Live lectures are

Lab schedule

Fridays 12:30-1:20PM (in person or zoom)

Readings

For each major topic, there are assigned readings that go with the lectures. The papers were selected to be fundamental readings on this topic any computational cognitive scientist would be expected to know. You should aim to read these over the semester, especially during the periods when we are covering the same topic. The papers should be downloadable on Google Scholar via NYU Library. However, they are available for download on Ed Discussion website under the “resources” tab (see the down-pointing arrow along the top bar or this link).

Neural networks and deep learning

Reinforcement learning and decision making

Bayesian modeling

Rational versus mechanistic modeling approaches

Model comparison and fitting, tricks of trade

Probabilistic graphical models

Program induction and language of thought models

Computational Cognitive Neuroscience

Course policies and FAQ

Collaboration and honor code:
We take the collaboration policy and academic integrity very seriously. Violations of the policy will result in zero points and a possible disciplinary referral. You may discuss the homework assignments with your classmates, but you must run the simulations and complete the write-ups **for the **homework on your** own.** Under no circumstance should students look at each other’s code or write-ups, or code/write-ups from previous years of this course. Do not share your write-up or code with any of your classmates under any circumstances.

Late work:
We will take 10% off each day a homework or final project is late. Assignments should be turned in all at once and not in pieces. If an assignment is incomplete and later completed, the late penalty is applied to the entire assignment.

Extensions:
If you are requesting an extension, email the teaching team (instructors-ccm-spring2024@googlegroups.com) and explain the reason. You must submit a request for an extension at least 24 hours before the due date of the assignment.

Regrading:
If you feel there was a mistake in the grading of your assignment, you can formally request a regrade through Gradescope. This will prompt us to regrade the full portion of the assignment and could lead to your grade being either raised or lowered depending on what the regrade finds. You can submit a regrade request via Gradescope.

Did you forget to turn in part of the homework, or did it print improperly on the PDF?:
We will not regrade homework because your answer did not display correctly in the version you submitted. Before turning in your assignment, you must double-check that all of your answers appear clearly in the PDF printout.

Extra credit:
No extra credit will be given, out of interest of fairness.

Preconfigured cloud environment

Students registered for the course have the option of completing homework assignments on their personal computers, or in a cloud Jupyter environment with all required packages pre-installed. Students can log onto the environment using their nyu net ids here.