Diagnostic/Probing Classifiers

image.png

  • Diagnostic classifiers are usually very simple (e.g., a single softmax).
  • Otherwise they could learn to do the tasks without looking at the model representations