Layers > Undo Assign
 
 
 

Moves the last assigned objects back to the default layer.