The designed landscape dates from the second half of the 18th century when the 2nd Earl Fife carried out many major agricultural improvements. Further developments were made by the 4th Earl c.1825. Since 1910 the gardens have been remodelled, the arboretum established and the present entrance to the north of the House created.
The lands of the barony of Innes were granted to the first laird, Beorald the Fleming, by Malcolm IV in 1160. Sir Robert Innes, the 24th Laird, who had been created a Baronet of Nova Scotia in 1624, built Innes House on the present site between 1640- 1653. The only documentary map evidence of the designed landscape prior to this time is provided by General Roy's map of c.1750 although Tait refers to Thomas Winter working at Innes in 1747 (SRO GD/248/173/2). In 1767, Sir James Innes, the 6th Baronet, sold the lands to James Duff, 2nd Earl Fife, a powerful political figure at that time. The 2nd Earl added two wings to the house, planted up the policies and modernised the whole estate. Many improvements were also made by the 4th Earl, who spent the last years of his life at Innes, from 1825, following law-suits establishing his claims to the Fife estates. His nephew, the 5th Earl, who succeeded in 1857, carried out the extensive Victorian alterations. In 1889, the 6th Earl Fife married HRH Princess Marie-Louise, eldest daughter of Edward VII and was created Duke of Fife. He subsequently sold the estate to a Mr Mackenzie, who leased it before selling in 1910 to Mr F.J. Tennant.
The Tennants made extensive alterations to the house, effectively turning it back to front by making the new main entrance at the north front and the gardens were laid out in the structure seen today. Captain Iain Tennant, the present laird, succeeded in 1946. In 1976 he moved from the house to Loch-na-bo Lodge nearby, after the conversion of the house into flats in 1947. His son now lives at Innes in a private apartment retained for family use.