He hailed from Pingling 平陵 (near modern Xianyang 咸陽, Shaanxi) and began his career as a petty official in a commandery. He then rose into the staff of the Minister of Works (dasikong 大司空) and then in that of the Censor-in-chief (yushi dafu 御史大夫) He Wu 何武. He Wu highly estimated him and recommended him to the post of magistrate (ling 令) of Changling 長陵.
He Bing was known as a just yet severe magistrate, so that Emperor Ai 漢哀帝 (r. 7-1 BCE) promoted him to governor (taishou 太守) of the commandery of Longxi 隴西, then of Yingchuan 穎川. Strictly enacting the law, he provided law in order under his jurisdiction. He was therefore promoted to the post of Director of the Imperial Secretariat (shangshu ling 尚書令). As a person with the right feeling for justice, he charged Zhong Wei 鍾威, a brother of the Chamberlain for law enforcement (tingwei 廷尉), for his misdoings and had him executed.
He Bing died in office. As a most honest person he had beforehand arranged that he would not be granted a state funeral.