Is it other people that bother me? Or the judgment I make about other people? - Oliver Burkeman

And here lies the essential difference between Stoicism and the modern-day 'cult of optimism.' For the Stoics, the ideal state of mind was tranquility, not the excitable cheer that positive thinkers usually seem to mean when they use the word, 'happiness.' And tranquility was to be achieved not by strenuously chasing after enjoyable experiences, but by cultivating a kind of calm indifference towards one's circumstances.

Pessimism, when you get used to it, is just as agreeable as optimism. –

So maybe it's not that you've been cheated out of an unlimited supply of time; maybe it's almost incomprehensibly miraculous to have been granted any time at all.