应用于视觉叙事的场景感知和事件理解理论 (SPECT)。,Topics in Cognitive Science

当前位置： X-MOL 学术 › Topics in Cognitive Science › 论文详情

Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)

应用于视觉叙事的场景感知和事件理解理论 (SPECT)。
Topics in Cognitive Science ( IF 2.9 ) Pub Date : 2019-09-04 , DOI: 10.1111/tops.12455
Lester C Loschky ₁ , Adam M Larson ₂ , Tim J Smith ₃ , Joseph P Magliano ₄

Affiliation

了解人们如何理解视觉叙事（包括图画故事、漫画和电影）需要结合传统上独立的理论，这些理论跨越复杂视觉场景的初始感官和知觉处理、随着时间的推移对事件的感知以及对叙事的理解。现有的零碎方法无法捕捉这些处理级别之间的相互作用。在这里，我们提出了应用于视觉叙事的场景感知和事件理解理论（SPECT），它区分了前端和后端认知过程。前端过程发生在单眼注视期间，包括注意力选择和信息提取。后端流程发生在多个固定点上，并支持事件模型的构建，它反映了对叙事中（存储在工作记忆中）和整个叙事过程中（存储在长期情景记忆中）中正在发生的事情的理解。我们描述了前端和后端流程之间的关系，以及可能导致跨媒体前端和后端流程变化的媒介特定差异（例如，图片故事与电影）。我们描述了从我们探索的 SPECT 衍生的几个新的研究问题。通过解决这些问题，我们更深入地了解注意力、信息提取和事件模型过程如何动态协调以感知和理解叙事和现实世界中复杂的自然主义视觉事件。我们描述了前端和后端流程之间的关系，以及可能导致跨媒体前端和后端流程变化的媒介特定差异（例如，图片故事与电影）。我们描述了从我们探索的 SPECT 衍生的几个新的研究问题。通过解决这些问题，我们更深入地了解注意力、信息提取和事件模型过程如何动态协调以感知和理解叙事和现实世界中复杂的自然主义视觉事件。我们描述了前端和后端流程之间的关系，以及可能导致跨媒体前端和后端流程变化的媒介特定差异（例如，图片故事与电影）。我们描述了从我们探索的 SPECT 衍生的几个新的研究问题。通过解决这些问题，我们更深入地了解注意力、信息提取和事件模型过程如何动态协调以感知和理解叙事和现实世界中复杂的自然主义视觉事件。

"点击查看英文标题和摘要"

The Scene Perception & Event Comprehension Theory (SPECT) Applied to Visual Narratives.

Understanding how people comprehend visual narratives (including picture stories, comics, and film) requires the combination of traditionally separate theories that span the initial sensory and perceptual processing of complex visual scenes, the perception of events over time, and comprehension of narratives. Existing piecemeal approaches fail to capture the interplay between these levels of processing. Here, we propose the Scene Perception & Event Comprehension Theory (SPECT), as applied to visual narratives, which distinguishes between front‐end and back‐end cognitive processes. Front‐end processes occur during single eye fixations and are comprised of attentional selection and information extraction. Back‐end processes occur across multiple fixations and support the construction of event models, which reflect understanding of what is happening now in a narrative (stored in working memory) and over the course of the entire narrative (stored in long‐term episodic memory). We describe relationships between front‐ and back‐end processes, and medium‐specific differences that likely produce variation in front‐end and back‐end processes across media (e.g., picture stories vs. film). We describe several novel research questions derived from SPECT that we have explored. By addressing these questions, we provide greater insight into how attention, information extraction, and event model processes are dynamically coordinated to perceive and understand complex naturalistic visual events in narratives and the real world.

更新日期：2019-09-04

点击分享查看原文

点击收藏

公开下载

阅读更多本刊新发论文