(1)Supplementary Material:
Title: Where and how our brain represents the temporal structure of observed action
Authors: R.M. Thomas
1,2,^
, T. De Sanctis
1,^
, V. Gazzola
1,3,*
, C. Keysers
1,3,*
,
Supplementary Methods and Results
Supplementary Table S1. Regions corresponding to ISC Intact > baseline.
Supplementary Table S2. Regions corresponding to ISC Scrambled > baseline.
Supplementary Table S3. Regions corresponding to bGLM Intact > baseline.
Supplementary Table S4. Regions corresponding to bGLM Scrambled > baseline.
Supplementary Methods S1. Action observation execution network (AOEN) localizer.
Supplementary Methods S2. Motor localizer. Supplementary Figure S1. Correlation between ISC-ROIs.
Supplementary Excel Table ISC bGLM differences
The contrasts (ISC I>S and bGLM I>S) can be downloaded at
https://www.dropbox.com/sh/wqok5s43cb8nlsi/AABgfJb0itEDmS1PUCyimohHa?dl=0
The fMRI data can be downloaded at https://doi.org/10.5281/zenodo.1285838
Supplementary Table S1. Regions corresponding to ISC Intact > baseline.
Supplementary Table S1. Regions with ISC Intact > baseline thresholded at max(t
FDR
=2.57, t
unc
=3.53)
and k=48 to survive the FWE correction at cluster level. Conventions as in Table 2 of the main
manuscript.
ISC(I-0)Cluster
size # Voxels incyto areas
%
Cluste
r
He
m Cyto/anatomical description Area%
Peak Information
T x y z
ISC(I>0), max(tFDR=2.57, tunc=3.53)=3.53, k=48
121081 2480.1 2 L Area 6 54.9
2222.3 1.8 R Area 6 49.4
1996.3 1.6 R Area hOc1 [V1] 94.5 15.82 10 -82 -2
1871.9 1.5 L Area hOc1 [V1] 90.7
1541.5 1.3 L Lobule VI (Hem) 78.8
1517.8 1.3 L Lobule VIIa crusI (Hem) 48.8
1196.3 1 L Area 7A (SPL) 93.5
956.3 0.8 L Area hOc3d [V3d] 94
928.4 0.8 R Area hOc2 [V2] 89.1 15.70 18 -98 14
917 0.8 R Lobule VI (Hem) 49.3
884.9 0.7 L Area hOc3v [V3v] 93.5
856.4 0.7 R Area hOc4la 94.4
849.9 0.7 L Area hOc2 [V2] 88.1
838.2 0.7 L Area hOc4la 95.9
831.5 0.7 L Area hOc4lp 95.2 16.65 -32 -96 6
820.1 0.7 L Area PGp (IPL) 96.7
820 0.7 R Area PGp (IPL) 81.2
798.8 0.7 R Area 45 75.7
790 0.7 R Area hOc3v [V3v] 90.7
738.1 0.6 L Lobule VIIa crusII (Hem) 44.1
737.8 0.6 R Area Fp1 42.3
724.5 0.6 L Area hOc4v [V4(v)] 98.1
716.5 0.6 R Area TE 3 67.1
714.4 0.6 R Area 1 99
706.1 0.6 R Area PFm (IPL) 97.9
702.4 0.6 R Area 7A (SPL) 88.6
668.1 0.6 R Area PF (IPL) 96.8
665.8 0.5 R Area 2 100 14.03 44 -30 44
652.7 0.5 L Area 5L (SPL) 92.1
646.5 0.5 L Area TE 3 71.2
629.5 0.5 R Area PGa (IPL) 82.9
602.2 0.5 R Area 3b 94.3
595.2 0.5 L Area PFt (IPL) 100
592.6 0.5 R Area hOc4v [V4(v)] 93.5
590.6 0.5 R Area 5L (SPL) 78.7
580.5 0.5 L Area Fp2 78
564.7 0.5 L Area PGa (IPL) 86.5
560 0.5 L Area hOc4d [V3A] 96 14.34 -22 -88 26
547.5 0.5 R Area hOc3d [V3d] 96.8 15.18 26 -96 16
540.2 0.4 L Area 2 99.7
535.8 0.4 L Area 1 91.6
528.9 0.4 L Area PF (IPL) 99
514 0.4 R Area hOc4lp 90
507.6 0.4 L Area FG2 86.3
492 0.4 R Lobule V (Hem) 60.5
480.9 0.4 L Area 3b 84.2
469.4 0.4 R Area 44 76.5
468.6 0.4 L Area hIP3 (IPS) 100
456.5 0.4 R Area hIP3 (IPS) 97.8
437.5 0.4 R Area 7PC (SPL) 93.9
431.8 0.4 R Area Fp2 68.5
426 0.4 R Area PFt (IPL) 100
406.6 0.3 R Area 7P (SPL) 84.1
399.8 0.3 R Area hOc4d [V3A] 93.2 14.84 24 -88 40
395.7 0.3 R Area OP1 [SII] 98.7
390.5 0.3 L Area PFm (IPL) 65.9
372.9 0.3 L Area OP1 [SII] 97.7
371.8 0.3 L Area 44 41.5
350.6 0.3 L Lobule V (Hem) 46.7
338.7 0.3 L Area Fp1 18.5
333.2 0.3 R Area 4a 29.9
331.2 0.3 L Area 7P (SPL) 92.6
330.7 0.3 R Area PFcm (IPL) 99.3
330.7 0.3 L Area PFcm (IPL) 99.8
327.7 0.3 L Area hIP1 (IPS) 88
326.9 0.3 L Lobule VIIIa (Hem) 42
311.8 0.3 L Lobule VIIb (Hem) 45
271 0.2 L Area OP4 [PV] 73.6
268.7 0.2 R Area hIP1 (IPS) 90.8
266.4 0.2 L Area FG1 100
265.7 0.2 L Area 4a 27.8
265.5 0.2 R Area FG2 77.4
258.8 0.2 R Area FG1 99.7
255.3 0.2 R Area OP4 [PV] 80.5
233.8 0.2 L Area 5M (SPL) 47.2
228.2 0.2 L Area hIP2 (IPS) 99.3
227.4 0.2 R Area PFop (IPL) 97.2
227 0.2 L Area PFop (IPL) 99.9
219.2 0.2 R Entorhinal Cortex 66.9
215.6 0.2 L Area 4p 65
215.5 0.2 R Area hIP2 (IPS) 100
209.3 0.2 R Area 4p 65.8
200.3 0.2 R Area 5M (SPL) 66.9
190.8 0.2 R Area TE 1.1 92.3
175.2 0.1 L Area 7PC (SPL) 99.9
160.2 0.1 L Area TE 1.1 97.1
155.4 0.1 L Area 7M (SPL) 99.4
155.2 0.1 R Area TE 1.0 100
142.8 0.1 L Area 3a 48.2
141.5 0.1 R Area 3a 68.3
136.5 0.1 L Area TE 1.2 95.4
128 0.1 R Area 5Ci (SPL) 63.2
126.4 0.1 L Area TE 1.0 100
120.9 0.1 R Lobule VIIa crusI (Hem) 3.6
115.3 0.1 R Area Ig2 70.7
115 0.1 L Area 5Ci (SPL) 95.5
109.3 0.1 L Lobule I IV (Hem) 22.2
103.9 0.1 R Area TE 1.2 97.5
103.8 0.1 R Area 7M (SPL) 100
102.3 0.1 R Area OP3 [VS] 47.7
102.3 0.1 R Lobule I IV (Hem) 20.1
95.9 0.1 L Area Ig2 69.1
95.1 0.1 L Area Id1 79.2
94.3 0.1 R Lobule VI (Verm) 39.8
93.8 0.1 L Lobule VI (Verm) 43.8
85.8 0.1 R Area OP2 [PIVC] 94.9
82.2 0.1 L Area hOc5 [V5/MT] 100
80.7 0.1 R Area Id1 48.3
72.3 0.1 R Area 33 32.7
65.3 0.1 L Area 33 30.1
59.6 0 R Area hOc5 [V5/MT] 100
53.3 0 R Area Ig1 68.4
51.8 0 L Lobule VIIIb (Hem) 8.3
51.3 0 L Area Ig1 73
31.3 0 R Thal: Temporal 5.6
28.1 0 R Subiculum 7.3
26.1 0 R CA1 (Hippocampus) 8.8
24.9 0 L Area OP2 [PIVC] 42.1
19.7 0 L Area s32 9.4
19.2 0 L Thal: Premotor 15.7
17 0 R Lobule VIIIa (Hem) 2.3
233 160.6 68.9 R Lobule VIIa crusI (Hem) 4.9 5.19 30 -88 -38
72.1 31 R Lobule VIIa crusII (Hem) 5.1
204 194.2 95.2 L Area Fp1 10.8 4.3 -30 62 8
159 17.1 10.8 L Area 45 2.5 4.42 -54 30 -8
157 70.9 45.1 L Area 25 93.6 4.59 -2 14 -16
16.9 10.7 L Area s24 9.9
12.4 7.9 R Area 25 22.3
4.2 2.7 L Area 33 2
2.4 1.5 R Area s24 1.6
1 0.6 R Area 33 0.5
106 27.5 25.9 L Entorhinal Cortex 9.7 4.98 -22 2 -46
66 39 59.1 R Lobule VIIb (Hem) 6 5.04 14 -74 -56
25.8 39 R Lobule VIIIa (Hem) 3.5
0.1 0.2 R Lobule VIIIa (Verm) 0.1
Supplementary Table S2. Regions corresponding to ISC Scrambled > baseline.
Supplementary Table S2. Regions with ISC Scrambled > baseline thresholded at max(t
FDR
=2.58,
t
unc
=3.53) and k=12 to survive the FWE correction at cluster level. Conventions as in Table 2 of the
main manuscript.
Cluster
size # Voxels incyto areas
%
Cluste
r
He
m Cyto/anatomical description Area%
Peak Information
T x y z
ISC(S>0), max(tFDR=2.58, tunc=3.53)=3.53, k=12
112233 2010.2 1.8 R Area hOc1 [V1] 95.2
1890.1 1.7 L Area hOc1 [V1] 91.5 12.62 -10 -80 10
1890.1 1.7 L Area 6 42.8
1575.5 1.4 R Lobule VIIa crusI (Hem) 47.4
1513.6 1.3 L Lobule VIIa crusI (Hem) 48.7
1494.8 1.3 R Area 6 34
1435.6 1.3 L Lobule VI (Hem) 73.4
1145.9 1 L Area 7A (SPL) 89.6
1084.4 1 R Lobule VI (Hem) 58.3
956.4 0.9 L Area hOc3d [V3d] 94 13.87 -18 -102 16
934.6 0.8 R Area hOc2 [V2] 89.7 13.05 8 -80 -4
885.1 0.8 L Area hOc3v [V3v] 93.5 13.01 -14 -78 -10
857.5 0.8 R Area hOc4la 94.5
855.6 0.8 L Area hOc2 [V2] 88.7
838.3 0.7 L Area hOc4la 95.9
831.7 0.7 L Area hOc4lp 95.2
790.7 0.7 R Area hOc3v [V3v] 90.8 13.91 18 -84 -14
724.7 0.6 L Area hOc4v [V4(v)] 98.1
707.9 0.6 R Area PGp (IPL) 70.1
702 0.6 R Area 45 66.5
701.4 0.6 R Area 7A (SPL) 88.4 12.44 26 -60 70
687.4 0.6 R Area 1 95.2
669.4 0.6 R Area TE 3 62.7
661.2 0.6 R Area 2 99.3
602.2 0.5 R Area hOc4v [V4(v)] 95
588.2 0.5 L Area PFt (IPL) 98.8
583.4 0.5 R Area PF (IPL) 84.5
577.5 0.5 L Lobule VIIIa (Hem) 74.1
562.7 0.5 L Area FG2 95.7
560.1 0.5 L Area hOc4d [V3A] 96
547.6 0.5 R Area hOc3d [V3d] 96.8 17.04 12 -96 28
544 0.5 L Area 5L (SPL) 76.8
517.8 0.5 L Area 2 95.5
514.1 0.5 R Area hOc4lp 90
503.5 0.4 R Area PGa (IPL) 66.3
474.4 0.4 L Area Fp1 25.8
471.6 0.4 L Area TE 3 51.9
468.6 0.4 R Area 3b 73.4
467.8 0.4 R Area 5L (SPL) 62.3
455.4 0.4 L Area Fp2 61.2
443.5 0.4 R Area hIP3 (IPS) 95
441.6 0.4 L Lobule VIIIb (Hem) 71.2
436.9 0.4 R Area 7PC (SPL) 93.7
426.1 0.4 R Area PFt (IPL) 100
416 0.4 R Lobule VIIIb (Hem) 56.8
413.5 0.4 L Lobule VIIa crusII (Hem) 24.7
406.7 0.4 R Area 7P (SPL) 84.1
399.9 0.4 R Area hOc4d [V3A] 93.2 14.26 32 -90 20
396.1 0.4 R Area Fp2 62.8
395.7 0.4 L Area hIP3 (IPS) 84.4
395.6 0.4 R Area OP1 [SII] 98.6
395.3 0.4 L Area 44 44.1
370.4 0.3 L Area OP1 [SII] 97.1
347.6 0.3 R Lobule VIIa crusII (Hem) 23.9
347.5 0.3 L Area PGp (IPL) 41
345.3 0.3 R Area Fp1 19.8
333.2 0.3 R Area PFcm (IPL) 100 12.38 54 -36 20
332.8 0.3 R Area PFm (IPL) 46.1
332 0.3 R Area FG2 96.8
327.7 0.3 L Area 45 45.9
323.7 0.3 L Lobule VIIb (Hem) 46.7
322.8 0.3 L Area PFcm (IPL) 97.5
316.2 0.3 L Area 7P (SPL) 88.4
315.5 0.3 L Area 1 53.9
303.9 0.3 L Area 3b 53.2
276.7 0.2 R Lobule VIIb (Hem) 41.4
269.3 0.2 L Area PF (IPL) 50.4
266.4 0.2 L Area FG1 100
261.5 0.2 R Area 44 42.6
259.7 0.2 R Area FG1 100
229.4 0.2 R Lobule V (Hem) 28.2
228.1 0.2 L Lobule V (Hem) 30.4
227.3 0.2 R Area PFop (IPL) 97.2
227.1 0.2 L Area PFop (IPL) 99.9
219.6 0.2 R Lobule IX (Hem) 30.5
215.8 0.2 R Lobule VIIIa (Hem) 29
207.6 0.2 R Area 4p 65.3
206.2 0.2 R Area TE 1.1 99.8
181.7 0.2 L Area hIP2 (IPS) 79
180.9 0.2 R Subiculum 46.6
177.1 0.2 R Area OP4 [PV] 55.8
175.3 0.2 L Area 7PC (SPL) 99.9
164.5 0.1 L Area TE 1.1 99.8
162.9 0.1 R Area hIP2 (IPS) 75.6
155.5 0.1 L Area PFm (IPL) 26.2
155.5 0.1 L Area 7M (SPL) 99.4
155.2 0.1 R Area TE 1.0 100
151.9 0.1 R Area 5Ci (SPL) 75
148.8 0.1 L Area hIP1 (IPS) 40
143.4 0.1 R Area Id1 85.9
142.7 0.1 L Area OP4 [PV] 38.7
142.4 0.1 L Lobule IX (Hem) 22.4
138.8 0.1 L Area TE 1.2 97.1
137.1 0.1 R Lobule VI (Verm) 57.8
130.7 0.1 L Area 3a 44.1
127.2 0.1 L Lobule VI (Verm) 59.4
122.4 0.1 L Area TE 1.0 96.8
122.1 0.1 R Area Ig2 74.8
110.1 0.1 R Area 3a 53.1
106.6 0.1 R Area TE 1.2 100
103.8 0.1 R Area 7M (SPL) 100
103.8 0.1 R CA1 (Hippocampus) 35.1
99.5 0.1 L Area Id1 82.9
99 0.1 R Area 5M (SPL) 33
95 0.1 L Thal: Prefrontal 14.8
93.2 0.1 L Lobule X (Hem) 72.6
91.9 0.1 R Area 4a 8.3
82.2 0.1 L Area hOc5 [V5/MT] 100
81.6 0.1 R Thal: Temporal 14.5
81.2 0.1 R Area hIP1 (IPS) 27.4
70.8 0.1 L Area 4p 21.3
67.5 0.1 L Area PGa (IPL) 10.3
65.8 0.1 R Area Ig1 84.4
60.5 0.1 L Area Ig2 43.6
60.3 0.1 L Area Ig1 86
59.6 0.1 R Area hOc5 [V5/MT] 100
54.6 0 R DG (Hippocampus) 41.4
50.8 0 R Lobule I IV (Hem) 10
49.5 0 L Area 5Ci (SPL) 41.1
49 0 L Area 5M (SPL) 9.9
48.3 0 L Thal: Premotor 39.5
47.8 0 L Area OP2 [PIVC] 80.8
47.6 0 R Lobule VIIIa (Verm) 22.3
46.4 0 R Thal: Parietal 13.6
46.2 0 R Area OP2 [PIVC] 51.1
45.8 0 L Thal: Parietal 14.1
41.7 0 L Subiculum 10.7
34 0 L Area 33 15.7
32.7 0 R Area OP3 [VS] 15.3
29.7 0 L Thal: Motor 59.5
28.6 0 R Area 33 12.9
28 0 R Lobule VIIa crusII (Verm) 48.9
26.8 0 R Lobule X (Hem) 26.2
25.1 0 L CA1 (Hippocampus) 11.2
23.5 0 L Lobule I IV (Hem) 4.8
21.7 0 L Thal: Somatosensory 66.4
21.6 0 L Entorhinal Cortex 7.5
20.3 0 L Lobule VIIb (Verm) 65.4
16.2 0 R CA2 (Hippocampus) 26.4
15 0 R Thal: Visual 34.4
14.8 0 R BF (Ch 4) 34.8
14.8 0 R CA3 (Hippocampus) 24.5
13.8 0 R Amygdala (AStr) 87.8
11.8 0 R Amygdala (CM) 42
358 6.1 1.7 R Area s24 4.1
6 1.7 R Area s32 4.1
1.1 0.3 L Area s24 0.7
0.2 0.1 L Area s32 0.1
250 0.5 0.2 L Entorhinal Cortex 0.2
133 8.1 6.1 R Area Fp1 0.5
44 31 70.5 L Amygdala (LB) 12.8 4.17 -28 0 -24
Supplementary Table S3. Regions corresponding to bGLM Intact > baseline.
Supplementary Table S3. Regions with bGLM Intact > baseline thresholded at max(t
FDR
=2.8, t
unc
=3.53)
and k=277 to survive the FWE correction at cluster level. Conventions as in Table 2 of the main
manuscript.
Cluster
size
# Voxels
in cyto
areas
%
Cluster
Hem
Cyto/anatomical
description
%
Area
Peak Information
T
x
y
z
bGLM(I>0), max(tFDR=2.8, tunc=3.53)=3.5, k =277
3251
382
11.8
R
Area hOc4la
43.1
9.11
38
-80
4
371.4
11.4
R
Area hOc4v [V4(v)]
59.9
7.44
28
-76
-18
276.9
8.5
R
Area hOc3v [V3v]
32.5
16.11
26
-90
-10
193.8
6
R
Area hOc4lp
34.7
10.13
40
-72
-10
174.6
5.4
R
Area FG1
68.8
5.15
32
-62
-14
124.2
3.8
R
Area hOc1 [V1]
6
119.9
3.7
R
Area FG2
35.8
68.2
2.1
R
Lobule VIIa crusI (Hem)
2.1
61.2
1.9
R
Area hOc2 [V2]
6
48.6
1.5
R
Area hOc5 [V5/MT]
83.5
30.8
0.9
R
Lobule VI (Hem)
1.7
2532
429.4
17
L
Area hOc4la
50.2
10.05
-46
-74
0
319.1
12.6
L
Area hOc4v [V4(v)]
44.2
242.5
9.6
L
Area hOc4lp
28.4
6.23
-30
-90
12
205.1
8.1
L
Area hOc3v [V3v]
22.2
10.84
-24
-92
-10
151
6
L
Area FG2
26.3
103.5
4.1
L
Area FG1
39.7
81.5
3.2
L
Area hOc5 [V5/MT]
101.4
31.4
1.2
L
Lobule VIIa crusI (Hem)
1
2272
504.2
22.2
R
Area 2
77.4
7.28
38
-34
40
290
12.8
R
Area PFt (IPL)
69.6
8.04
50
-24
38
253
11.1
R
Area 7PC (SPL)
55.5
8.9
28
-52
62
248.2
10.9
R
Area 7A (SPL)
32
198.5
8.7
R
Area hIP3 (IPS)
43.5
112.8
5
R
Area 3b
18.1
91.9
4
R
Area PFop (IPL)
40.2
88.6
3.9
R
Area 1
12.6
45.9
2
R
Area hIP2 (IPS)
21.8
38.9
1.7
R
Area 5L (SPL)
5.3
36
1.6
R
Area 3a
17.8
10.4
0.5
R
Area 7P (SPL)
2.2
2013
457.2
22.7
L
Area 7A (SPL)
36.6
8.65
-34
-50
56
341.9
17
L
Area PFt (IPL)
58.7
7.07
-44
-32
38
231.4
11.5
L
Area 2
43.7
7.08
-38
-42
52
175.8
8.7
L
Area hIP3 (IPS)
38.4
130.5
6.5
L
Area 7PC (SPL)
76.1
76.1
3.8
L
Area 5L (SPL)
11
29.4
1.5
L
Area hIP1 (IPS)
8.1
17.6
0.9
L
Area PFop (IPL)
7.9
15.1
0.8
L
Area hIP2 (IPS)
6.7
12.4
0.6
L
Area 3b
2.2
Supplementary Table S4. Regions corresponding to bGLM Scrambled > baseline.
Supplementary Table S4. Regions with bGLM Intact > thresholded at max(tFDR=2.8, tunc=3.53) and
k=2178 to survive the FWE correction at cluster level. Conventions as in Table 2 of the main
manuscript.
Cluste
r size
# Voxels in
cyto
%
Cluster
Hem
Cyto/anatomical
description
%
Are
a
Peak Information
T
x
y
z
5563
448.6
8.1
L
Area hOc4la
52.5
9.53
-40
-76
-8
389.8
7
L
Area hOc4v [V4(v)]
54
364.9
6.6
L
Area 7A (SPL)
29.2
275.8
5
L
Area hOc4lp
32.3
8.45
-30
-90
6
252.1
4.5
L
Area FG2
43.8
239.9
4.3
L
Area hOc3v [V3v]
25.9
12.37
-22
-88
-8
239.1
4.3
L
Area hIP3 (IPS)
52.2
226.9
4.1
L
Area PFt (IPL)
39
204.5
3.7
L
Area FG1
78.5
8.05
-32
-72
-8
163.2
2.9
L
Area 2
30.8
131.4
2.4
L
Area 7PC (SPL)
76.6
125.5
2.3
L
Lobule VIIa crusI (Hem)
4.1
104
1.9
L
Lobule VI (Hem)
5.4
82
1.5
L
Area hOc5 [V5/MT]
102
10.13
-46
-68
4
41.9
0.8
L
Area hIP1 (IPS)
11.5
36.8
0.7
L
Area 5L (SPL)
5.3
17.1
0.3
L
Area hOc2 [V2]
1.8
16.9
0.3
L
Area hOc4d [V3A]
3
16.4
0.3
L
Area hOc1 [V1]
0.8
12.9
0.2
L
Area hIP2 (IPS)
5.7
4050
409
10.1
R
Area hOc4v [V4(v)]
66
13.01
26
-92
-2
401.6
9.9
R
Area hOc4la
45.3
11.99
40
-74
-10
298.9
7.4
R
Area hOc3v [V3v]
35.1
14.14
24
-88
-10
237.5
5.9
R
Area FG1
93.5
195.1
4.8
R
Area hOc4lp
34.9
181
4.5
R
Area FG2
54
140.9
3.5
R
Area hOc1 [V1]
6.8
110.2
2.7
R
Lobule VIIa crusI (Hem)
3.4
69.2
1.7
R
Area hOc2 [V2]
6.8
56.8
1.4
R
Lobule VI (Hem)
3.1
48.6
1.2
R
Area hOc5 [V5/MT]
83.5
10.4
0.3
R
Area hOc4d [V3A]
2.5
2178
443.8
20.4
R
Area 2
68.2
6.99
38
-36
42
274
12.6
R
Area 7A (SPL)
35.3
6.92
24
-58
50
259
11.9
R
Area hIP3 (IPS)
56.7
235.5
10.8
R
Area PFt (IPL)
56.5
225.9
10.4
R
Area 7PC (SPL)
49.5
8.21
30
-52
60
105
4.8
R
Area 3b
16.8
52.6
2.4
R
Area hIP2 (IPS)
25
49.1
2.3
R
Area 1
7
36
1.7
R
Area 3a
17.8
34.2
1.6
R
Area PFop (IPL)
15
8.29
50
-26
38
24.2
1.1
R
Area 7P (SPL)
5.1
13
0.6
R
Area 5L (SPL)
1.8
Supplementary Table S5. Overlap between ISC (I>S) and bGLM (I>S).
Supplementary Table S5. Overlap between ISC (I>S) and bGLM (I>S). The overlap was calculated by
applying an inclusiving masking in spm to the ISC I>S maps. The bGLM mask was generated by
thresholding the bGLM (I>S) maps with a t=3.87 corresponding to the max(T
FDR
=3.87, T
unc
=3.52) and
a minimum cluster size of 163 voxels which ensure to only select clusters surviving a FWE correction
at cluster level. ISC (I>S) maps were then visualized at FDR 0.05 (t=3.92) and the table indicates
whether the cluster also survive FWE. Conventions as in Table 2 of the main manuscript.
Cluster size
#
Voxels
in cyto
%
Cluster
Hem
Cyto or anatomical
description
%
Area
Peak Information
T
x
y
z
ISC(I>S) & bGLM (I>S), T=3.93
59
29
49.2
L
Area 5L (SPL)
4.2
4.34
-28
-48
68
p
FWE
<0.000
18.8
31.8
L
Area 7A (SPL)
1.5
4.56
-26
-52
66
L
4.46
-22
-54
62
L
4.43
-18
-58
60
8.8
14.8
L
Area 7PC (SPL)
5.1
34
24
70.6
R
Area 7PC (SPL)
5.3
4.92
30
-52
66
p
FWE
<0.000
R
4.66
24
-54
66
6.5
19.1
R
Area 5L (SPL)
0.9
2.5
7.4
R
Area 2
0.4
1
2.9
R
Area 7A (SPL)
0.1
Supplementary Methods S1. The action observation and execution network (AOEN).
The AOEN mask used in the current manuscript was generated from data collected on an independent
sample of 35 participants who underwent an action execution and action observation task in MRI. The
stimuli and tasks used with this sample of participants were identical to the Observation, Manipulate and
Eye Execution conditions used by Arnstein et al. (Arnstein et al. 2011). The full study will be published
separatly, but this data was used because it represents the largest sample ever used to localize the AOEN.
All participants signed an informed consent in accordance to the declaration of Helsinki, prior to the
experiment, and met MRI safety requirements, had a normal or corrected to normal vision and had no
history of neurological conditions or treatments. Four participants were excluded from the analysis: two
because of excessive head motions, one reported sleepiness, and one because of image distortion. The
remaining group was therefore composed of 31 participants.
Observation task. Participants watched 39 unique movies of a human hand interacting with objects
(ActionOBS), which were previously placed on a table (e.g. pouring wine into a glass). The 39 control
movies displayed the same objects but the hand moved over the surface of the table without any
meaningful object interaction (CtrlOBS). Each of the 7-sec blocks contained a series of three actions
from the same condition. There were 13 blocks for each condition, which were separated by a centered
fixation cross with a random duration of 8 to 12 seconds. The order of blocks was randomized across
participants. The observation task was always acquired before the action execution task to avoid
biasing action observation towards motor execution regions.
Action execution task. Participants performed three of the actions presented in the observation task:
stirring a spoon in a bowl, lifting a coffee cup as if to drink, and swirling a wine glass (ActionEXE).
The plastic objects were placed on a t-shaped table secured above the waist of the participants. During
scanning, participants performed actions in 13 blocks, with each block including the execution (in a
pseudo-randomized order) of all three actions. Each action started and ended with the dominant hand
being placed in a resting position at the edge of the t-shaped table. The appearance of a green circle
displayed on a grey t-shaped background indicated the time at which to initiate the action. The circle
position indicated which object to interact with (and therefore selected which of the three action to
perform), and its duration paced the duration of the manipulation. When the circle turned red
participants had to follow the motion of the circle with their eyes only (CtrlEXE).
For each participant, the MRI session included one anatomical scan (structural 3D spoiled gradient
image of 170 slices; scan resolution = 256 × 256; field of view = 232 mm; voxel size: 1 × 1 × 1 mm)
and two functional runs of 345 EPI volumes (one run for the observation, and one for the execution
task) acquired in a Philips Intera 3T scanner, using a 32-channel coil. Functional images were acquired
using an echo planar T2*-weighted gradient sequence covering 41 sequential axial slices (echo time =
28 ms; slice thickness = 3.5 mm; flip angle = 70°; repetition time = 2000 ms; scan resolution = 64 × 62;
field of view = 224 mm; voxel size: 3.5 × 3.5 × 3.5 mm).
All analyses were run in SPM8 (Wellcome Trust Centre for Neuroimaging, UCL, UK) using Matlab
7.14 (The MathWorks Inc., Natick, USA). Data preprocessing included slice time correction,
realignment and coregistration of functional and anatomical images to the mean functional image,
normalization to MNI template through normalization parameters obtained by the segmentation of the
anatomical image, and a 6x6x6 FMHW Gaussian kernel smoothing.
Separate general linear models were computed on the observation and execution data, each containing
two boxcar predictors modeling the experimental conditions (ActionOBS, CtrlOBS or ActionEXE,
CtrlEXE) and six predictors of no interest including the head movements determined during the
realignment. The contrasts ActionOBS-CtrlOBS and ActionEXE-CtrlEXE were then computed at the
subject-level. At the second, group level, we then performed a conjunction (of the
conjunction-conjunction type) between two t-tests (ActionOBS-CtrlOBS>0, and ActionEXE-CtrlEXE>0) using a
voxel-wise fdr correction that set a threshold of minimum t > 3.32. Only cluster of at least 20 voxels
were retained in the AOEN mask.
Supplementary Methods S2. Motor localizer.
Data acquisition and task for motor execution: Participants were the same as in the main fMRI experiment and
data was acquired using the same fMRI acquisition methods on the same day after the main experiment. The
participants were given toys of scale 3 cm to be held in both left and right hands comfortably during the scan.
Instructions appeared as green crosses either on the left or right half of the screen signaling the participants to
jostle the toy only in the respective hand of the cross for the duration of the appearance of the cross which was
either two or three seconds. The inter-stimulus interval was randomly selected between 8 and 12 seconds. A total
of 12 left and 12 right hand instructions were given during the scan. The entire task took 6 minutes to perform.
In past experiment we found this simple localizer to robustly activate the motor and somatosensory system, but
because of time constrains we were unable to include control conditions that would disentangle attentional and
executive control related activations from motor processes proper, and results should thus be interpreted in the
light of this lack of specificity. Preprocessing was performed as in the GLM analysis of the main experiment.
Statistical analysis for motor localizer task
:
To investigate which of the ISC ROIs were significantly activated
while participants themselves manipulated observed, after determining the 10 ROIs of interest for the ISC (I-S)
condition as described in the main text, we extracted the Eigen time course of these ROIs using Marsbar. These
time courses were placed into a GLM design with motion parameters (determined during realignment of the EPI
volume) introduced as confounds. The motor execution was modelled as a boxcar regressor convolved with the
canonical haemodynamic response function. Beta coefficients, reflecting the co-activation of the ROIs to the
motor execution task, were tested for being different from zero. All ROIs that survived an FDR corrected t-value
are highlighted with an asterisk against the ROI in figure 3 of the main text. Both the preprocessing and the
statistical analysis was carried out using SPM12, Marsbar and in-house MATLAB routines.
Supplementary Figure
Supplementary Figure S1. Correlation between ISC-ROIs The Eigen timecourse of the each ROI
(Figure 4) was extracted using Marsbar and the cross-correlation between them was calculated. The
matrix of the correlation is plotted after spectral reordering. The ROI numbers correspond to Figure. 4
and are shown next to the rows. We can qualitatively see the three different clusters of ROIs. These
were quantitatively established using the multi-dimensional scaling and k-means clustering procedure
described in the main text, and evidenced by the black outline in the cross-correlation matrix.
Supplementary Bibliography
Oldfield, R. (1971). The assessment and analysis of handedness: the Edinburgh inventory.
Neuropsychologia , 9 (1), 97-113.
Arnstein, D., Cui, F., Keysers, C., Maurits, N. M., & Valeria, Gazzola. (2011). µ-Suppression during
Action Observation and Execution Correlates with BOLD in Dorsal Premotor, Inferior Parietal, and SI
Cortices. Journal of Neuroscience , 31 (40) 14243-14249.
