Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information

Bibliographic Details
Main Author: Bergström, Fredrik
Publication Date: 2021
Other Authors: Wurm, Moritz, Valério, Daniela Filipa Codinha, Lingnau, Angelika, Almeida, Jorge
Format: Article
Language: por
Source: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
Download full: https://hdl.handle.net/10316/95722
https://doi.org/10.1016/j.cortex.2021.03.004
Summary: When we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.
id RCAP_398ed31a53a7ea86cebd9682a2c53f8f
oai_identifier_str oai:estudogeral.uc.pt:10316/95722
network_acronym_str RCAP
network_name_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository_id_str https://opendoar.ac.uk/repository/7160
spelling Decoding stimuli (tool-hand) and viewpoint invariant grasp-type informationHands; Parietal cortex; Prehension; Tools; fMRIHand StrengthHumansMagnetic Resonance ImagingParietal LobePsychomotor PerformanceBrain MappingHandWhen we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.2021-03info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttps://hdl.handle.net/10316/95722https://hdl.handle.net/10316/95722https://doi.org/10.1016/j.cortex.2021.03.004por00109452Bergström, FredrikWurm, MoritzValério, Daniela Filipa CodinhaLingnau, AngelikaAlmeida, Jorgeinfo:eu-repo/semantics/openAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2022-05-25T03:29:15Zoai:estudogeral.uc.pt:10316/95722Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-29T05:43:43.187769Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse
dc.title.none.fl_str_mv Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
spellingShingle Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
Bergström, Fredrik
Hands; Parietal cortex; Prehension; Tools; fMRI
Hand Strength
Humans
Magnetic Resonance Imaging
Parietal Lobe
Psychomotor Performance
Brain Mapping
Hand
title_short Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title_full Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title_fullStr Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title_full_unstemmed Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title_sort Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
author Bergström, Fredrik
author_facet Bergström, Fredrik
Wurm, Moritz
Valério, Daniela Filipa Codinha
Lingnau, Angelika
Almeida, Jorge
author_role author
author2 Wurm, Moritz
Valério, Daniela Filipa Codinha
Lingnau, Angelika
Almeida, Jorge
author2_role author
author
author
author
dc.contributor.author.fl_str_mv Bergström, Fredrik
Wurm, Moritz
Valério, Daniela Filipa Codinha
Lingnau, Angelika
Almeida, Jorge
dc.subject.por.fl_str_mv Hands; Parietal cortex; Prehension; Tools; fMRI
Hand Strength
Humans
Magnetic Resonance Imaging
Parietal Lobe
Psychomotor Performance
Brain Mapping
Hand
topic Hands; Parietal cortex; Prehension; Tools; fMRI
Hand Strength
Humans
Magnetic Resonance Imaging
Parietal Lobe
Psychomotor Performance
Brain Mapping
Hand
description When we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.
publishDate 2021
dc.date.none.fl_str_mv 2021-03
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://hdl.handle.net/10316/95722
https://hdl.handle.net/10316/95722
https://doi.org/10.1016/j.cortex.2021.03.004
url https://hdl.handle.net/10316/95722
https://doi.org/10.1016/j.cortex.2021.03.004
dc.language.iso.fl_str_mv por
language por
dc.relation.none.fl_str_mv 00109452
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron:RCAAP
instname_str FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron_str RCAAP
institution RCAAP
reponame_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
collection Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository.name.fl_str_mv Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
repository.mail.fl_str_mv info@rcaap.pt
_version_ 1833602453947285504