This is probably not what the original paper had in mind for "interpolating between classes" but it mostly works.