You are here: Home / Colloquium / Summer Semester 2015 / Talk: Djork-Arné Clevert

Talk: Djork-Arné Clevert

When May 07, 2015
from 05:15 PM to 06:15 PM
Add event to calendar vCal
iCal

CE Colloquium

Thursday, May 7, 5:15 pm

Room S3-055 in Science Park 3

 

Title: Rectified Factor Networks

Speaker: Djork-Arné Clevert

Affiliation: JKU

Abstract:  Deep learning is currently one of the most hottest topics in machine learning. During this talk, we will introduce a new deep learning approach, namely,  rectified factor networks (RFNs). RFNs are generative unsupervised models, which learn robust, very sparse, and non-linear codes with many code units. RFN learning is a variational expectation maximization (EM) algorithm with unknown prior which includes (i) rectified posterior means, (ii) normalized signals of hidden units, and (iii) dropout. Like factor analysis, RFNs explain the data variance by their parameters. For pretraining of deep networks on several benchmark datasets, e.g., MNIST, rectangle data, convex shapes, NORB, and CIFAR, RFNs were superior to restricted Boltzmann machines (RBMs) and denoising auto encoders.


Short Bio: Djork-Arné Clevert, trained in Computer Science at TU Berlin, received his PhD in computational biology from the Charité Medical University Berlin in 2011. He was a senior scientist at the Institute of Bioinformatics at Johannes Kepler University from 2007 to 2013. During that time, he has been Co-PI in several large projects with pharma industry. After working for industry as senior data scientist at Zalando AG. Dr. Clevert became a post-doctoral researcher within a Marie Curie fellowship at Johannes Kepler University in 2014. While Dr. Clevert’s research has mainly been concerned with microarray data in earlier years, his research focus recently shifted to the analysis of big data sets with methods, such as, deep learning. Jointly with Prof. Hochreiter, Dr. Clevert is co-organizer of the Conference “Critical Assessment of Massive Data Analysis (CAMDA)”.