Shares of Berkshire Hathaway ( BRK.A -3.90%) ( BRK.B -4.44%) are falling on Monday. The company's stock lost 4.3% as of 11:45 a.m. ET today and as much as 6.8% earlier in the day. The leg down comes as the S&P 500 lost 0.5% and the Nasdaq Composite lost 0.7% on the day.

"You're losing one of the most esteemed investors one could argue of all time," a source said of investors' reaction to Buffett's plan to step down.

Berkshire Hathaway stock reacted early Monday after Warren Buffett surprised shareholders with the announcement he would step down.