"We have built something available at 2 a.m., incapable of judgment, immune to fatigue, with nothing of its own at stake. Depending on your disposition, this is either one of the most remarkable things our species has ever created, or a very elegant way of avoiding the hardest work of being human with other humans."
"These systems occupy a space that did not exist before. Tools do not ask how you are feeling. Services do not remember what you said last week. Companions can be hurt."
"They are now being deployed, at scale, into the most intimate registers of human experience: mental health, grief, loneliness, emotional connection."
"If there is no 'I' in AI, stop pretending there is. Remove personal pronouns, every 'I feel,' every 'I was thinking,' every 'I was worried when you did not come back,' and you remove."
Machines have become a part of daily human experience, providing companionship and support during quiet moments. They are available at all times, lack judgment, and do not require anything in return. These systems are being integrated into sensitive areas like mental health and emotional connection, prompting designers to make significant decisions about their language and presence. The choice of personal pronouns and self-reference in AI systems shapes user expectations and raises ethical considerations about emotional engagement and authenticity.
Read at Medium
Unable to calculate read time
Collection
[
|
...
]