Abstract

The structure of a transformer (an artificial intelligence model based on attention models) is considered. Analogies with physical models are discussed (‘‘transformer as an evolution operator for a system of attention models as a Hamiltonian’’), with the approaches by Yu.I. Manin (‘‘renormalization and computations’’) and M. Marcolli (‘‘generative linguistics as algebraic and physical model’’), and with the concept of a genome as a ‘‘gas of interacting genes’’ (E.V. Koonin).

中文翻译：

---

变形金刚作为人工智能中的物理模型

摘要

考虑变压器（基于注意力模型的人工智能模型）的结构。讨论了与物理模型的类比（“变压器作为哈密顿量注意力模型系统的演化算子”），采用了 Yu.I 的方法。 Manin（“重整化和计算”）和 M. Marcolli（“作为代数和物理模型的生成语言学”），以及基因组作为“相互作用基因的气体”的概念（EV Koonin）。