Castillo de Torés, As Nogais