We develop datasets and methods to perform visual question answering on pathology images.