We utilize transfer learning on the ADNI dataset, reduced in sample size by entropy selection to acheive state-of-the-art performance in multi-task classification. We provide a detailed analysis using class activation maps to demonstrate the model’s performance on neuropathological regions that are task-relevant and can help healthcare practicioners in interpreting the model’s decision.