The title appears to have been in existence in England a considerable time before it was held in accordance with any strict legal principle. Alan Le Roux (c. 1040?1089), was a Breton relative of Geoffrey of Brittany. He took part in William the Conqueror's invasion of England, and Le Roux obtained grants of land in various parts of England, including manors formerly held by Earl Edwin in Yorkshire. He built the castle of Richmond in one of these.
His brother Alan Le Noir, or Niger, (c. 1045?1093), succeeded to these estates on the former's death. Le Noir was in turn succeeded by Stephen (d. 1137), Count of Penthievre, who was either his son or another brother. These counts were territorial lords of Richmond, and are often reckoned as 'earls of Richmond', though they were not so in the strict later sense.

