轉載自http://baojie.org/blog/2013/01/27/deep-learning-tutorials/
?
Stanford Deep Learning wiki: http://deeplearning.stanford.edu/wiki/index.php/Main_Page
?
幾個不錯的深度學習教程，基本都有視頻和演講稿。附兩篇綜述文章和一副漫畫。還有一些以后補充。
Jeff Dean 2013 @ Stanford
http://i.stanford.edu/infoseminar/dean.pdf
一個對DL能干什么的入門級介紹，主要涉及Google在語音識別、圖像處理和自然語言處理三個方向上的一些應用。參《Spanner and Deep Learning》（2013-01-19）
Hinton 2009
A tutorial on Deep Learning
Slides http://videolectures.net/site/normal_dl/tag=52790/jul09_hinton_deeplearn.pdf
Video http://videolectures.net/jul09_hinton_deeplearn/? (3 hours)
從神經網絡的背景來分析DL，為什么要有DL說得很清楚。對DL的基本模型結構也說得很清楚。十分推薦
更多Hinton的教程 http://www.cs.toronto.edu/~hinton/nntut.html
斯坦福的Deep Learning公開課（2012）Samy Bengio, Tom Dean and Andrew Ng
http://openclassroom.stanford.edu/MainFolder/CoursePage.php?course=DeepLearning
教學語言是Matlab。
參2011年的課程CS294A/CS294W? Deep Learning and Unsupervised Feature Learning
更多的斯坦福工作： Deep Learning in Natural Language Processing
Deep Learning for Natural Language Processing, 2009 tutorial by Ronan Collobert (senna author)?
-
http://ronan.collobert.com/pub/matos/2009_tutorial_nips.pdf
-
video http://videolectures.net/nips09_collobert_weston_dlnl/
這個介紹了DL在三個方向上的應用：tagging (parsing), semantic search, concept labeling
Ronan Collobert的Senna是一個c的深度學習實現，只有2000多行代碼
ACL 2012 tutorial
Deep Learning for NLP (without Magic)?
http://www.socher.org/index.php/DeepLearningTutorial/DeepLearningTutorial?
by Richard Socher, Yoshua Bengio and Chris Manning?
PDF: http://nlp.stanford.edu/~socherr/SocherBengioManning-DeepLearning-ACL2012-20120707-NoMargin.pdf?
Video: http://www.youtube.com/watch?v=IF5tGEgRCTQ&list=PL4617D0E28A5781B0
Kai Yu’s Tutorialhttp://vipl.ict.ac.cn/News/academic-report-tutorial-deep-learning-dr-kai-yu?
On November 26, 2012
Title: “A Tutorial on Deep Learning”?
Abstract:?
In the past 30 years, tremendous progress has been made in building effective classification models. Despite the success, we have to realize that, in major AI challenges, the key bottleneck is not the quality of classifiers but that of features. Since 2006, learning high-level features using deep architectures has become a big wave of new learning paradigms. In recent two years, performance breakthrough was reported in both image and speech recognition tasks, indicating deep learning are not something ignorable. In this talk, I will walk through the recent works and key building blocks, e.g., sparse coding, RBMs, auto-encoders, etc. and list the major research topics, including modeling and computational issues. In the end, I will discuss what might be interesting topics for future research.?
Bio of Dr. Kai Yu:?
余 凱任百度技術副總監，多媒體部負責人，主要負責公司在語音，圖像，音頻等領域面向互聯網和移動應用的技術研發。加盟百度前，余凱博士在美國NEC研究院擔 任Media Analytics部門主管(Department Head)，領導團隊在機器學習、圖像識別、多媒體檢索、視頻監控，以及數據挖掘和人機交互等方面的產品技術研發。此前他曾在西門子公司任Senior Research Scientist。2011年曾在斯坦福大學計算機系客座主講課程“CS121: 人工智能概論”。他在NIPS, ICML, CVPR, ICCV, ECCV，SIGIR, SIGKDD，TPAMI，TKDE等會議和雜志上發表了70多篇論文，H-index=28，曾擔任機器學習國際會議ICML10, ICML11, NIPS11, NIPS12的Area Chair. 2012年他被評為中關村高端領軍人才和北京市海聚計劃高層次海外人才。?
Slides link: http://pan.baidu.com/share/link?shareid=136269&uk=2267174042[1]?
Video link: KaiYu_report.mp4 (519.2 MB)?
Theano Deep Learning Tutorial這個是實戰, 如何用Python實現深度學習
http://deeplearning.net/tutorial/
Code https://github.com/lisa-lab/DeepLearningTutorials?
Survey Papers很多，不過初學看這兩篇應該就夠了
Yoshua Bengio, Aaron Courville, Pascal Vincent. (2012) Representation Learning: A Review and New Perspectives
Yoshua Bengio?(2009). Learning Deep Architectures for AI.
更多
- Itamar Arel, Derek C. Rose, and Thomas P. Karnowski. (2010)?Deep Machine Learning – A New Frontier in Artificial Intelligence Research ?這篇沒什么公式，也不長，就是籠統的介紹一下
- 截至2009的一些重要文章 http://www.iro.umontreal.ca/~lisa/twiki/bin/view.cgi/Public/ReadingOnDeepNetworks
Deep Learning雖好，也要牢記它的局限
