I update negatively on people who mislead (including expressing great confidence while being wrong, and especially including avoidable mischaracteriz… - Holden Karnofsky

I think it's somewhat of a happy coincidence so far that most breakthroughs have been good. To say, I see a breakthrough on the horizon. Is that good or bad? How can we prepare for it? That's another thing academia is really not set up to do. Academia is set up to get the breakthrough. That is a question I ask myself a lot is here's an intellectual activity. Why can't it be done in academia? These days, my answer is if it's really primarily of interest to a very cosmopolitan philanthropist trying to help the whole future, and there's no one client and it's not frontier advancing, then I think that does make it pretty plausible to me that there's no one doing it. We would love to change that, at least somewhat, by funding what we think is the most important work.

I now believe that there simply is no mainstream academic or other field (as of today) that can be considered to be "the locus of relevant expertise" regarding potential risks from advanced AI. These risks involve a combination of technical and social considerations that don't pertain directly to any recognizable near-term problems in the world, and aren't naturally relevant to any particular branch of computer science. This is a major update for me: I've been very surprised that an issue so potentially important has, to date, commanded so little attention – and that the attention it has received has been significantly (though not exclusively) due to people in the effective altruism community.

Regarding (b) <nowiki>[</nowiki>"checking boxes I want to check for considering myself a personally moral/ethical person, which is related but not identical to trying for maximum expected positive impact on the world"<nowiki>]</nowiki>: every year, I want to give a significant amount to "charity" as conventionally construed, straightforwardly helping the less fortunate. I generally believe in trying to be an ethical person by a wide variety of different ethical standards (not all of which are consequentialist). And I wouldn't feel that I were meeting this standard if I were giving nothing (or a trivial amount) to known, outstanding opportunities to help the less fortunate, for purposes of saving as much money as possible for adversarial projects (such as political campaigns) and/or more speculative projects (such as work related to artificial intelligence). I think the best giving opportunities in this category are GiveWell's top charities, so I will be giving a portion of this year's donation there, following the recommended allocation.