Canon (aka the star wars: rebels series and Word of God) actually says that due to the accelerated aging they died/became too old to fight any longer by the time of the OT. Which is super depressing to think about, I rather prefer your version.