The Evolution of Stellar Radial Velocity Jitter: Toward an Astrophysically-Motivated Predictor of Stellar RV Jitter