Reconstructing fine-grained cognition from brain activity.

Item request has been placed! ×
Item request cannot be made. ×
loading   Processing Request
Read More Add to Saved list
  • Additional Information
    • Source:
      Publisher: Academic Press Country of Publication: United States NLM ID: 9215515 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1095-9572 (Electronic) Linking ISSN: 10538119 NLM ISO Abbreviation: Neuroimage Subsets: MEDLINE
    • Publication Information:
      Original Publication: Orlando, FL : Academic Press, c1992-
    • Subject Terms:
      Models, Biological* ; Video Games*; Cerebral Cortex/*physiology ; Cognition/*physiology ; Electroencephalography/*methods ; Functional Neuroimaging/*methods ; Psychomotor Performance/*physiology ; Spatial Navigation/*radiation effects; Adolescent ; Adult ; Female ; Humans ; Male ; Young Adult
    • Abstract:
      We describe the Sketch-and-Stitch method for bringing together a cognitive model and EEG to reconstruct the cognition of a subject. The method was tested in the context of a video game where the actions are highly interdependent and variable: simply changing whether a key was pressed or not for a 30th of a second can lead to a very different outcome. The Sketch level identifies the critical events in the game and the Stitch level fills in the detailed actions between these events. The critical events tend to produce robust EEG signals and the cognitive model provides probabilities of various transitions between critical events and the distribution of intervals between these events. This information can be combined in a hidden semi-Markov model that identifies the most probable sequence of critical events and when they happened. The Stitch level selects detailed actions from an extensive library of model games to produce these critical events. The decision about which sequence of actions to select from the library is made on the basis of how well they would produce weaker aspects of the EEG signal. The resulting approach can produce quite compelling replays of actual games from the EEG of a subject.
      (Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.)
    • Contributed Indexing:
      Keywords: Cognitive modeling; Cognitive reconstruction; EEG; Game playing
    • Publication Date:
      Date Created: 20200605 Date Completed: 20210301 Latest Revision: 20210301
    • Publication Date:
      20221213
    • Accession Number:
      10.1016/j.neuroimage.2020.116999
    • Accession Number:
      32497786