Download Nicolas Boulanger-Lewandowski

Nicolas Boulanger-Lewandowski
Contact
Information
Google, Inc.
1600 Amphitheatre Parkway
Mountain View (CA) 94043, USA
mobile: +1 650 248-9370
e-mail: nicolas [email protected]
Research
Interests
Machine learning, neural networks, music information retrieval, sequential models, polyphonic transcription.
Education
Université de Montréal, Canada
Doctor of Philosophy in Computer Science
September 2009 – July 2014
• Thesis: Modeling High-Dimensional Audio Sequences with Recurrent Neural Networks
• Advisors: Yoshua Bengio, Pascal Vincent
École Polytechnique de Montréal, Canada
Master of Science (Applied) in Engineering Physics
September 2007 – May 2009
• Thesis: Intrusive Imaging in Scanning Tunneling Microscopy
• Advisor: Alain Rochefort
Bachelor of Engineering Physics
• Concentration: Micro and Nano-Technologies
• Cumulative GPA: 3.84/4.0
September 2003 – May 2007
Complementary Vincent-d’Indy Musical School, Montréal
formation
th
Laureate II (9
Year) in Clarinet
1993 – 2001
Honours and
Awards
Runner-Up Best Student Paper Award, ICML, 2012
Alexander Graham Bell Canada Doctoral Scholarship, NSERC, 2010–2013
Doctoral Research Scholarship, FQRNT, 2009–2013 (declined)
National Bank of Canada Award, 2009
Alexander Graham Bell Canada Masters Scholarship, NSERC, 2008
Masters Research Scholarship, FQRNT, 2008 (declined)
Undergraduate Student Research Award, NSERC, 2006
Arthur Yelon – John Low Brebner Scholarship, RQMP, 2006
Entrance Scholarship, École Polytechnique de Montréal, 2003
Governor General’s Award, Séminaire de la Très-Sainte-Trinité, 2001
Publications
Sigtia, S., Boulanger-Lewandowski, Dixon, S., “Audio Chord Recognition with a Hybrid Recurrent
Neural Network”, Proceedings of the 16th International Society for Music Information Retrieval
Conference (ISMIR), 2015. pdf
Sigtia, S., Benetos, E., Boulanger-Lewandowski, N., Weyde, T., Garcez, A., Dixon, S., “A Hybrid
Recurrent Neural Network For Music Transcription”, Proceedings of the 40th International Conference
on Acoustics, Speech, and Signal Processing (ICASSP), 2015. pdf
Boulanger-Lewandowski, N., “Modeling High-Dimensional Audio Sequences with Recurrent Neural
Networks”, PhD thesis, University of Montréal, 2014. pdf
Boulanger-Lewandowski, N., Droppo, J., Seltzer, M. and Yu, D., “Phone Sequence Modeling with
Recurrent Neural Networks”, Proceedings of the 39th International Conference on Acoustics, Speech,
and Signal Processing (ICASSP), 2014. pdf
Boulanger-Lewandowski, N., Mysore, G. and Hoffman, M., “Exploiting Long-Term Temporal Dependencies in NMF Using Recurrent Neural Networks with Application to Source Separation”, Proceedings of the 39th International Conference on Acoustics, Speech, and Signal Processing (ICASSP),
2014. pdf
Boulanger-Lewandowski, N., Bengio, Y. and Vincent, P., “Audio Chord Recognition with Recurrent
Neural Networks”, Proceedings of the 14th International Society for Music Information Retrieval
Conference (ISMIR), 2013. pdf
Boulanger-Lewandowski, N., Bengio, Y., Vincent, P., “High-dimensional Sequence Transduction”,
Proceedings of the 38th International Conference on Acoustics, Speech, and Signal Processing (ICASSP),
2013. pdf
Bengio, Y., Boulanger-Lewandowski, N., Pascanu, R., “Advances in Optimizing Recurrent Networks”, Proceedings of the 38th International Conference on Acoustics, Speech, and Signal Processing
(ICASSP), 2013. pdf
Kahou, S., Pal, C., Bouthillier, X., Froumenty, P., Glehre, ., Memisevic, R., Vincent, P., Courville, A.,
Bengio, Y., Ferrari, R., Mirza, M., Jean, S., Carrier, P., Dauphin, Y., Boulanger-Lewandowski, N.,
Aggarwal, A., and others, “Combining modality specific deep neural networks for emotion recognition
in video”, Proceedings of the 15th ACM International Conference on Multimodal Interaction, pp. 543550, 2013.
Boulanger-Lewandowski, N., “Recent Advances in Polyphonic Music Generation and Transcription”,
26th Conference on Artificial Intelligence (AAAI), 2012, invited presentation.
Boulanger-Lewandowski, N., Bengio, Y. and Vincent, P., “Discriminative Non-Negative Matrix Factorization for Multiple Pitch Estimation”, Proceedings of the 13th International Society for Music
Information Retrieval Conference (ISMIR), 2012. pdf
Boulanger-Lewandowski, N., Bengio, Y. and Vincent, P., “Modeling Temporal Dependencies in HighDimensional Sequences: Application to Polyphonic Music Generation and Transcription”, Proceedings of the 29th International Conference on Machine Learning (ICML), 2012, runner-up best
student paper award. pdf
Boulanger-Lewandowski, N., Vincent, P. and Bengio, Y., “Energy-based Recurrent Neural Network
for Multiple Fundamental Frequency Estimation”, Snowbird Learning Workshop, 2011. pdf
Bengio, Y., Bastien, F., Bergeron, A., Boulanger-Lewandowski, N., Breuel, T., Chherawala, Y., Cisse,
M. and others, “Deep Learners Benefit More from Out-of-Distribution Examples”, Proceedings of the
14th International Conference on Artificial Intelligence and Statistics (AISTATS), 2011. pdf
Boulanger-Lewandowski, N. and Rochefort, A., “Intrusive STM Imaging”, Physical Review B, volume
83, p. 115430, 2011. pdf
Bastien, F., Bengio, Y., Bergeron, A., Boulanger-Lewandowski, N., Breuel, T., Chherawala, Y.,
Cisse, M. and others, “Deep Self-Taught Learning for Handwritten Character Recognition”, NIPS
Deep Learning and Unsupervised Feature Learning Workshop, 2010. pdf
Boulanger-Lewandowski, N. and Rochefort, A., “Intrusive Approach in Computational STM Imaging”, International Scanning Probe Microscopy Conference (ISPM), 2008.
Boulanger-Lewandowski, N., Bedwani, S. and Rochefort, A., “Solveur intrusif pour l’imagerie STM
temps réel”, 21e Entretiens du Centre Jacques Cartier, 2008.
Bedwani, S., Boulanger-Lewandowski, N., Janta-Polczynski, B., Éthier-Majcher, G., Cerdá, J., Guibault,
F. and Rochefort, A., “Applications du logiciel SPAGS-STM en imagerie et spectroscopie de nanostructures”, Regroupement québécois sur les matériaux de pointe (RQMP), 2008.
Boulanger-Lewandowski, N., Bedwani, S., Janta, B., Cerdá, J., Guibault, F. and Rochefort A.,
“Recent Development and Applications for the SPAGS-STM Software”, Regroupement québécois sur
les matériaux de pointe (RQMP), 2007.
Bedwani, S., Boulanger-Lewandowski, N., Miwa, J., Cicoira, F., Janta-Polczynski, B., Rosei, F.,
Cerdá, J. and Rochefort, A., “Application of SPAGS-STM to the Formation of Thin Organic Semiconducting Layer”, Proceedings of the Canadian Semiconductor Technology Conference (CSTC),
2007.
Professional
Experience
Google, Mountain View, CA, United States
Software Engineer
August 2014 – present
• Development of a robust metadata management system for Google Play Music.
• Incorporation of large-scale multimodal data to improve music metadata quality, user experience
and recommendations via machine learning.
Adobe Systems, San Francisco, CA, United States
Creative Technologies Lab Intern
August 2013 – November 2013
• Developement of an RNN-based prior for non-negative matrix factorization.
• Implementation and analysis of different cost functions and inference strategies.
• Application to supervised and semi-supervised audio source separation, which led to an ICASSP
submission and the filing of a patent.
Microsoft Research, Redmond, WA, United States
Research Intern
May 2013 – August 2013
• Development of an RNN-based phone sequence model for speech recognition.
• Implementation of EM training, and efficient decoding and alignment algorithms.
• Evaluation on the TIMIT and Switchboard datasets leading to an ICASSP submission.
LISA laboratory & Ubisoft, Montréal, Canada
The Internet Connectome Project (PINGS)
December 2012 – April 2013
• Development of a website to collect Internet connection information via crowdsourcing.
• Training and evaluation of graph-inspired models to predict yet unmeasured network latencies.
• Performance feedback to volunteer users of the Java applet according to a preliminary model.
Droit Inc., Montréal, Canada
Web Developer
April 2012 – present (part time)
• Development of a news website / business blog targeted to lawyers, based on Tiki Wiki (online).
• Implementation of custom modules like video streaming, job listings, continuing education, etc.
Google, Mountain View, CA, United States
Software Engineering Intern
September 2011 – December 2011
• Analysis of machine learning algorithms for audio music classification based on winner-take-all
(WTA) sparse codes.
• Large-scale implementation on Google distributed computing architecture via MapReduce.
• Exploration of variants: code concatenation, hierarchical representations, temporal aggregation,
preprocessing techniques, code optimization via a genetic algorithm.
École Polytechnique de Montréal, Canada
Laboratory Instructor
September 2007 – December 2009
• Write-up of experiments and directives, support and evaluation for Quantum Mechanics II.
• Laboratory assistant in the Electromagnetic Fields and Logic Circuits courses.
• Examination invigilator for various undergraduate courses.
Nanostructures Laboratory, Montréal, Canada
Research Intern
Summer 2006
• Establishment of an imaging procedure for the Scanning Tunneling Microscope (STM).
• Interfacing of meshing, visualization (OpenDX) and quantum simulation modules.
• Development of a graphical user interface for Gnome/GTK+.
Grantech, Inc., Contrecoeur, Canada
Software Developer and Technician
2004 – 2006 (part time)
• Development of a management system in VB/Access.
• Technical support.
Patent
Boulanger-Lewandowski, N., Mysore, G., Hoffman, M., “Non-negative Matrix Factorization Regularized by Recurrent Neural Networks for Audio Processing”, 2015, U.S. Patent No. 20150242180.
Programming
C++, C, Python, Matlab, LATEX 2ε , VB, Access, MPI, GTK+, Windows API, VHDL.
PHP, MySQL, Flash, Java, Javascript, Perl, CSS.
MapReduce, BigTable, SSTable and other Google internals.
Reviews
•
•
•
•
•
•
•
Open-source
development
• General purpose Hessian-free optimizer in Theano (online).
• Deep Learning Tutorial on the RNN-RBM (online).
International Society for Music Information Retrieval Conference (ISMIR)
Journal of Machine Learning Research (JMLR)
NIPS Deep Learning Workshop
International Conference on Learning Representations (ICLR)
Proceedings of the National Academy of Sciences (PNAS)
International Journal of Software and Informatics (IJSI)
Transactions on Knowledge and Data Engineering