Edit > Delete by Type > Non-Deformer History
 
 
 

See Edit > Delete by Type > Non-Deformer History.