I definitely don't think that optimizing every minute of your life is, well, optimal for everyone. I know that for someone like myself, trying to do that would just stress me out to no end and I would probably just give up in frustration.
I think it helps to have a balance between self-forgiveness and discipline. Give yourself general deadlines and guidelines for how you want to spend your time and really try to stick with them, but also don't beat yourself up if you do things a little off schedule.