In 1608, Saku Manor passed from the Mekes family into the possession of Bernhard von Scharenberg.
During the Swedish rule, this part of the Sausti Manor belonged to the von Scharenbergs, and ever since, a certain decline or at least incomplete and not very prudent care can be seen in the history of Saku and its economic power. After the Scharenbergs, Saku has been at the disposal of several pledge owners.
Around the 1620s, when the Saku manor house had burned down, the Scharenbergs had Saku Manor brought to its current location. This accident has gone down in history in connection with a witchcraft process that was very popular at that time.
In the summer of 1622, a royal trial was held in Saku, where the case of Anna (Anne), a servant of the manor, who was accused of being the devil’s handmaid and a thief, was discussed. The servant was accused of stealing 5 silver spoons, 5 silver rings from the wet nurse, and various clothes from the manor. Soon after the theft, the Saku manor house was set on fire. Anne testified that an old man in sky blue clothes approached her and invited her to go with him to the court of the manor. There, he handed her a torch. Anne took it and threw it in the eaves. The house caught fire and burned to the ground. The old man, however, disappeared. The court sentenced Anne to death by impalement.
Bernhard von Scharenberg died in 1645, leaving all his property to his young wife Helene, who in 1646 married Johann von Hastfer, the landowner of Aaspere. Thus, Saku Manor passed to the Hastfers, in whose hands the manor remained throughout the second half of the eighteenth century.
Like Scharenberg, Johann von Hastfer was also a man of many talents: a major, a county councillor, and in 1647–1650, also the head of the knighthood. He was also rich enough, because in addition to Aaspere and Saku, he also owned the Hageri-Maidla and Tõdva-Kõnnu manors. In 1673, the manor was left to his son Adam Bernhard, who died in 1676 in Stockholm. The last Hastfers associated with Saku were brothers Karl Johann (died in 1721 in Russian captivity) and Georg (drowned in 1709 on his way from Tallinn to Stockholm).