His breakout film role came as a tough sheriff in Walking Tall (1973). Over a career spanning decades, he starred in 57 films, including Mitchell, Charlie Varrick, and Mud, for which he won a Robert Altman Award. He also earned a BAFTA nomination for the British TV series Edge of Darkness and a nod for the miniseries George Wallace.

Baker retired in 2012. Known for his kindness, love of nature, and cats, he never had children and is survived by relatives in Texas and close friends.

A funeral will be held on May 20, 2025, at Utter McKinley Mortuary in Mission Hills, California