Assignment 5
Neural Networks and Deep Learning

CSCI 5922
Spring 2017

Assigned Tue Oct 31, 2017
Due: Tue Nov 7, 2017

Assignment submission

Please read instructions here.

Goal

The goal of this assignment is to look through the literature, find interesting research, and write a commentary about one paper that you found that you feel is noteworthy.

Sources

The most trustworthy sources of interesting articles are the proceedings of Neural Information Processing Systems (NIPS), the International Conference on Learning Representations (ICLR)  and the International Conference on Machine Learning (ICML).

Most of these papers will also be posted on arXiv.org and it's fine to select a paper from arXiv, but since any crap can be posted on arXiv, please select only papers that have been peer reviewed and published, preferably in one of the proceedings above.

The only restriction on the paper is that it should address neural network models. Ideally, you will find a paper that is on a topic of interest to you and that might lead to a final project topic or a tie-in to your main research interest.  The paper can be on an application of neural nets or a more theoretical contribution. I would like you to pick some work we have not yet talked about in class, though it's fine if you cover articles I have on the syllabus for the last month of class.

I expect that half of your effort on this assignment will be on finding a 'just right' paper. Select wisely, and have fun looking through articles.

Commentary

Your job is to read the paper and to write a commentary of no more than one page.  The commentary should include a summary of what you think the main or most interesting ideas are behind the work, However, there is no need to provide a complete abstract of the paper. I want to know your perspective on what the work had to offer, and how you'd explain it to a classmate.

The remainder of your commentary could include such reactions as:

  • questions you have about the paper, either clarification questions or points of disagreement with the authors (``I don't see how such and such will work as the author claims...'').
  • comments on how the paper relates to other work you've read;
  • a critique of the work. What are the flaws in the ideas presented? What are the limitations? Did the speaker place their work in the appropriate theoretical context? Did the authors overstate their results? 
  • If the paper gave you inspiration for new research ideas, describe these ideas.  The ideas might be extensions of the work, new directions to move in, or applications of the work to other subfields.