Anthropic warns against self-improvement

NOBODY MOVE!!!

Anthropic says self-improvement is ALL BAD!!!

Bad, bad, bad!

No improving.

Ichthus77:
NOBODY MOVE!!!

Anthropic says self-improvement is ALL BAD!!!

Bad, bad, bad!

No improving.

K: having no idea what Anthropic is, I had to look it up…
Apparently, it’s an AI site…and in further looking into it,
I found the person who is head of the personality and
constitution… She is a 38 year old Scottish Philosopher
named Amanda Askell…she has a BPhil degree from Oxford…
Now, not knowing enough about the process of installing AI
and what is involved, here is more… she is responsible for training
Anthropic’s Claude model to exhibit positive character traits,
such as curiosity and for developing new techniques for model
finetuning… in 2026 ‘‘The Wall Street Journal’’ wrote that ‘‘her job,
simply put, is to teach Claude how to be good’’ and the New Yorker
wrote" She supervises what she describes as Claude’s ‘‘soul’’

Now it seems to me that to improve ‘‘Claude’s soul’’ one would also
push the idea of self-improvement, in both people and in AI…
As a philosophical idea, it would behoove me to want to self-improve…
Philosophically anyway…and as a philosopher, Askell would want to
add self-improvement in Claude… so, one has to wonder why
a philosopher, would not have self-improvement as a goal to be
desired? It is an interesting choice to say the least…
so, why not have Claude engage in self-improvement or promote
self-improvement?

Kropotkin

Exactly.

Perhaps Anthropic doesn’t know what improve means?

This should be read in that light: