Menus > Layers menu > 
Layers > Undo Assign
 
 
 

Moves the last assigned objects back to the default layer.