Prostate cancer is the most common cancer in Norwegian males. But most cases have a very good prognosis if diagnosed and treated early. Could deep learning algorithms assist medical personnel in early detection and correct classification of prostate cancer from MRI scans? This presentation will cover how to implement deep learning models for detection and classification of prostate cancer in medical images, methods for working with very imbalanced datasets and relate the experience of trying to solve what turned out to be a very hard problem.