I was messing around with that feature and didn’t realize I was on the keeper league page instead of the champs league page. I had to go through the next week and a half re-benching my farm team players.
I can't trust the autostarter because I've got guys on my farm that are playing for the team, so they're not listed as NA. But I still manually check everything every day so I'm good.