Race is directly or indirectly incorporated into many AI systems. These systems, which automate typically human tasks, are used across various domains such as predictive policing, disease detection, government resource allocation, and loan approvals. However, these tools have been criticized for handling race insensitively or inaccurately. Despite the prevalent use of race in these AI systems, it is often not properly defined. It is treated as an obvious concept and represented as fixed categories, which fail to fully incorporate the social meaning surrounding race. Thus, in this review article, we define race and discuss how it is represented in AI systems. We also explore the consequences of such representations and offer recommendations on how to incorporate race more appropriately in these systems.

中文翻译：

---

种族在 AI 系统中的表现和后果


种族直接或间接地被纳入许多 AI 系统。这些系统通常自动执行人工任务，用于预测性警务、疾病检测、政府资源分配和贷款审批等各个领域。然而，这些工具因处理种族问题不敏感或不准确而受到批评。尽管在这些 AI 系统中普遍使用种族，但它往往没有得到适当的定义。它被视为一个明显的概念，并被表示为固定的类别，未能完全纳入围绕种族的社会意义。因此，在这篇评论文章中，我们定义了种族并讨论了它在 AI 系统中的表现方式。我们还探讨了这种表述的后果，并就如何更适当地将种族纳入这些系统提出了建议。