The Scrymgeours can trace their ancestry back to the Irish Kings, through Agnes's ancestors Gillascop MacGilchrist of Glassary and the dynastic family of Cowall and Knapdale, descendants of Aodh O'Neill and the O’Neill High Kings of Ireland.