Abstract
The world around us consists of typical settings manifested as statistical regularities and stored as associations. These associations are beneficial for performance, and we rely on them as a source of stability in our perception of a coherent surrounding. What happens when such associativity is not apparent? We presented pairs of associated images and pairs of non-associated images and compared their corresponding effect on subsequent performance in three different visual perception paradigms: contrast-sensitivity, global vs. local perception, and critical-flicker-fusion. In all three experiments, performance was significantly inferior when preceded by images with no clear associative connection. We propose that these results reflect the need to find coherence in our environment. When such coherence is not easily detected, we seem to persist in seeking for it, which in turn poses a lingering cognitive load that taxes performance even in low-level perception.
Similar content being viewed by others
Introduction
The associations of what happens with what, what happens after what, and other regularities found in everyday contexts, provide the platform for our stable world model. Those learned associations help us predict what to expect, how to plan, what to approach and what to avoid (Bar, 2004). The associative nature of our world is also reflected in the associative nature of our thought.
A thinking pattern that is associative advances from one concept to an associated concept regularly, coherently, and seamlessly can significantly affect cognitive performance. For example, there is a strong link between associative abilities and creativity (Benedek et al., 2012; Levin, 1978). Furthermore, associative thinking contributes to problem-solving and critical thinking skills (Rowe, 1991). Additionally, associative information can serve as a platform for generating predictions (Bar, 2007), which may be why associations are found to be intrinsically attractive (Trapp et al., 2015).
The effect of associations, especially contextual, on recognition of scenes and objects has also been examined extensively (Bar, 2004; Biederman, 1972). Thus, the facilitatory involvement of associations in memory encoding, retrieval, and in the generation of predictions is already widely acknowledged. What is not yet explored, however, is the possible effect of associative coherence also on lower-level perception. In other words, is associative processing exclusively a high-level faculty (which might explain why higher cortical areas have been termed association areas), or can associative processing influence the earliest stages of perception as well?
To fill in this gap in our understanding of the global importance of associations, we induce either associative or non-associative thinking and test the subsequent effect this induction has on perceptual performance. We define associations as a relation between items that co-occur, co-activated, and tend to be relevant together in the same context. For example, while a German Shepherd and a Poodle are semantically related, they rarely, if ever, appear together and thus are not considered associatively related. German Shepherd and a bone, on the other hand, are associatively related. We aimed to test the hypothesis that the search for association is so persistent as to pose a cognitive “load” that will tax even low-level perceptual tasks. Specifically, we measure the effect of associative and non-associative processing on subsequent performance, where any associative information precedes but is not directly relevant to performing the task. Hence, the use of associations here is more for inducing a state of associative thinking rather than eliciting stimulus-specific facilitation.
Given how much we rely on associations, it is reasonable to suspect that we actively look for them in our environment. To do that, we presented pairs of associated images (e.g., monkey–banana) and pairs of non-associated images (e.g., grapes–flag), and compared their respective influence on subsequent performance in three experiments using three different visual paradigms. The three paradigms were selected as three representatives of perceptual processing that are also sufficiently different from each other: 1. Contrast sensitivity, 2. Global vs. local perception and 3. Critical flicker fusion. These three separate experiments for testing the effect of associative activation on low-level perception will be discussed next. Of course, it is difficult to claim that pairs of images, associative or not, by themselves are sufficient to change the entire thought pattern to be associative or not, even though the block design makes this a reasonable possibility, but rather that we take it as a relative induction. Indeed, associative thinking has been successfully induced in the past with a similar approach (e.g., Mason and Bar, 2012). In any event, we focus on the effect of the presence of a coherent everyday association, or its lack thereof, on perception.
The search for an associative link could extend for longer than previously appreciated, even when such a link is not readily apparent. If visual perception is superior following associative pairs compared with non-associative pairs, such difference could stem from one of two sources. One possible source is associative priming, where the first image serves as an associative prime for the second. As a result, the second image of the associative pair was processed more fluently or faster due to the priming effect, and participants had more time to switch and process the target, thereby improving subsequent performance. Alternatively, the non-associated pairs trigger a sustained attempt to nevertheless seek an associative link, thereby presumably diminishing the resources available for the subsequent task. The associative and non-associative conditions were compared with a control condition that was meant to help distinguish the source of any difference in subsequent performance.
Shared materials and methods
We used a list of word associations (Rubinsten et al., 2005). The associative strength list was created by presenting participants with a target word and asking them to name the first word that comes to their mind. The response consensus of participants who gave the second word of the pair as the first response to the first word across participants was used to compute associative strength. We used only word pairs that represented concrete nouns that could be translated into images (e.g., cow and pen). We translated each word to picture and presented image pairs instead of word pairs. The strength of the association was determined by the integrator’s consistency (consensus).
For non-associated image pairs, using the associated word pairs list, we presented two images that did not appear as an oppositional option of any individual. All the stimuli were in color and taken from Internet sources. The image luminance and contrast levels were digitally equated using Photoshop CS6. The stimuli were cut from their original background and inserted into a white (RGB: 255, 255, 255) background.
To make sure that image pairs have an associative relation as words (or non-relation), a separate group of participants (20 Bar-Ilan University students, 15 females, age range 22–29, mean age = 23.84) were asked to rate, in their opinion, to what extent the images are related to each other. The rating range was a number between 0 and 10 (highest). Image pairs that received an average of 8.5 points and above were set as associated image pairs (the mean score was 8.9). In contrast, image pairs that received an average of 1.5 points and below were assigned as non-associated image pairs (the mean score was 1.2). Image pairs with a rating in between were discarded from the experiment. The images were neutral (as verified by two independent raters). In all three experiments, the pictures were chosen for participation in the experiment randomly for each subject, out of a larger collection, further diminishing any possibly consistent difference between the properties of the stimuli in the different conditions. The Bar-Ilan Brain Research Ethics Committee approved all the studies reported. All participants provided informed written consent before starting the experiments. Different participants participated in the different experiments.
Experiment 1—Associations and contrast sensitivity
Contrast sensitivity (CS) measures the ability to detect differences between light and dark bands with no clear boundary (Kelly, 1977). To test the hypothesis that associative coherence might affect perception, in this experiment, we measured how associative processing may affect detection thresholds in a staircase CS task by comparing performance when CS task was preceded by associative pairs, non-associative pairs, and baseline control where no images preceded the CS task.
Participants
Forty-one Bar-Ilan University students with normal or corrected-to-normal visual acuity and with no ocular pathology (24 females, age range 19–32, mean age = 24.17) participated in the experiment for credit toward a course requirement [In all the experiments reported here, our target sample size was chosen to be above the sample sizes in other recent studies involving associative processing (Bar-Anan et al., 2006; Moores et al., 2003; Trapp et al., 2015)]. One participant was disqualified based on his incorrect responses during catch trials. Catch trials were used to verify the performance of the task.
Stimuli
Three hundred and ten pictures of objects, neutral in their emotional valence, were used in 148 image pairs and 14 individual images. All objects were daily items in our lives (e.g., chair, shoes, and umbrella). The target display was a Gabor patch. The Gabor profile had a spatial frequency of 2 cpd, and a circular Gaussian envelope of σ = 1°. The contrast increment was initially set to 50% of the contrast of the Gabor. The Gabor was slanted ±45° from the vertical.
Procedures
In all three experiments, stimuli were presented on a PC with a resolution of 1920 × 1080 pixels and were controlled by a custom program written in MatLab (MathWorks, Natick, MA) using Psychtoolbox (Brainard and Vision, 1997) and were run on a Dell computer. The head of each participant was stabilized with an adjustable padded fixture, 55 cm from the computer screen.
The experiment began with a practice phase that consisted of eight image pairs followed by a Gabor patch. During the practice phase, the image pairs were a mixture of associated and non-associated pairs (four image pairs for each condition). The experiment itself was divided into three blocks (baseline, associated, and non-associated block). Each block consisted of 70 trials (determined by the staircase performance as described in the literature (Sowden et al., 2002)). The associated and non-associated blocks also consisted of seven catch trials (a total of 77 trials each; 70 experimental trials, 7 catch trials). The baseline block did not consist of image pairs, but rather only the Gabor judgments. Participants participated in all three blocks, one after the other. Each pair was seen only once during the experiment.
Before the experiment began, participants were given instructions about the general nature of the task and were instructed to attend to the objects. No instructions were given about the nature of the images or the possible relations between them.
During the baseline block, using an adaptive staircase method (Quest procedure; explained in the next section, p. 10), a Gabor pattern was presented in the center of the screen for 150 ms (54 × 54 pixels). The participants required to determine the orientation of the Gabor pattern and respond as quickly as possible by pressing the “Right Arrow” if they thought the Gabor was slanted right, or by pressing the “Left Arrow” for a slanted left. The purpose of the task is for contrast changes.
During the associated and non-associated blocks, two images were presented consecutively in the center of the screen (54 × 54 pixels). A Gabor pattern, using an adaptive staircase method, was then presented also in the center of the screen (54 × 54 pixels, 2 cpd). Each trial consisted of seven presentations (Fig. 1): a fixation cross (500 ms), an object image (300 ms), another fixation cross (250 ms), a second object image (300 ms), a fixation cross (250 ms), a Gabor image (150 ms), and a question mark for a response. The pairs of objects could be either associated (e.g., bow-arrow) or non-associated (e.g., flower-phone) according to the characteristics of the block. The Gabor was slanted ±45° from the vertical. The participants required to determine the orientation of the Gabor pattern, and respond as quickly as possible by pressing the “Right Arrow” if they thought the Gabor was slanted right, or by pressing the “Left Arrow” for a slanted left.
To ensure that participants attend the object pairs, we added seven-catch trials in each block. In catch trials, two identical images presented consecutively in the center of the screen. After the Gabor pattern was presented, participants required to ignore the orientation of the Gabor and press the “Down Arrow”. This task presumably increased attention equally in both blocks.
All stimuli were presented randomly. The order of the blocks (baseline, associated, and non-associated) was randomized across participants. The time elapsed from stimulus onset to response was computed on-line for each trial and stored as reaction time (RT) for that contrast. If the response was incorrect, the participant’s response was disqualified from the RT analysis. If a participant had more than 50% errors in the catch trials, the participant was omitted from the analysis.
An adaptive psychophysical staircase procedure (QUEST) was used in all three blocks to estimate individual sensitivity thresholds. The staircase procedure was identical to the experimental procedure described by Watson and Pelli (1983). Thresholds were measured using the Quest toolbox from MatLab. The performance level of the estimated threshold was set at 75% of detected stimuli. In QUEST, the algorithm determines the probability density function (pdf) of a correct discrimination response of the participant as well as the next stimulus intensity parameter to be presented, based on the response to previous trials (Farell and Pelli, 1999; Watson and Pelli, 1983). The estimated parameters of this distribution are updated after each trial according to the participant’s performance, and a new intensity parameter is set up for the next trial. If the participant had recognized the stimulus, the new intensity parameter moved one step down (i.e., made harder). If, however, the participant had failed to recognize the stimulus, the new intensity parameter moved one step up (i.e., made easier). At the end of the trials, Quest provided a final log threshold estimate, which was the mean of the pdf in intensity scale (corresponds to log10 contrast), and it set as the CS threshold of the participant (Farell and Pelli, 1999; Watson and Pelli, 1983). Feedback was given for both correct and for incorrect responses.
Results
The data from the experiment were analyzed to determine whether there were differences in the mean CS threshold between the blocks (baseline, associated, and non-associated). Behavioral statistical analyses for all experiments were carried out using Statistical Package for the Social Sciences (SPSS). The Bayes factor algorithm was implemented with JASP statistical software using a default Cauchy prior of 0.707.
To test the mean differences in scores between blocks, we conducted a repeated measurement ANOVA with baseline, associated, and non-associated blocks as the independent variable. This analysis revealed a main effect in the mean CS threshold between conditions (baseline block = 0.00903 log intensity; associated block = 0.01090 log intensity; non-associated block = 0.01494 log intensity; F(2,78) = 23.019, p < 0.001, η2 = 0.371, observed power = 1, Bayes factor (BF10) = 1.628e+6). The mean CS threshold was plotted as a function of the blocks (Fig. 2a). Pairwise comparisons analysis (using Bonferroni correction) revealed significant difference between the baseline and the non-associated block (p < 0.001, Cohen’s d = 1.013, 95% confidence interval (CI) for mean difference [0.004, 0.008], BF10 = 106781.1). Also, a significant difference between the associated and the non-associated block was found (p < 0.001, Cohen’s d = 0.782, CI [0.002, 0.006], BF10 = 1403.42). However, there was no significant difference between the baseline and the associated block (p = 0.153, Cohen’s d = 0.318, CI [−0.0042, 0.00045], BF10 = 1.054), and therefore our subsequent analyses included only the associated and the non-associated blocks. These showed that the mean CS threshold in the non-associated block was higher (implying poorer visual performance; results in log intensity units) than in the associated block (Fig. 2a). Additionally, we conducted a paired t-test for analysis of RT between the associated and the non-associated block. The analysis revealed that the RT was significantly longer in the non-associated block than for the associated block (associated block = 850.725 ms; non-associated block = 868.192 ms; two-tailed t(39) = 2.134, p < 0.05, Cohen’s d = 0.337, CI [0.911, 34.023], BF10 = 1.302, Fig. 2b).
We further tested whether the order of the blocks affected the results, with the intention to see whether the first block induced a state of mind (e.g., associative) that was then carried to the subsequent blocks. To do that, we calculated the differences between the thresholds of each block for each participant. We contrasted the results based on whether the starting block was the associated or the non-associated block. A paired t-test revealed no significant difference in the difference of threshold between the blocks (starting block: associated block = 0.0028 log intensity; non-associated block = 0.0052 log intensity; two-tailed t(19) = 1.95, p = 0.066, Cohen’s d = 0.436, CI [−0.0051, 0.00018], BF10 = 1.119, Fig. 2c), meaning, the starting block did not affect the results.
CS defines the threshold for detection of the minimum perceptible contrast, and here we tested whether this threshold is influenced by associative coherence or its absence. The results support this notion in that the lack of associative coherence reduced contrast sensitivity while associative processing did not affect contrast sensitivity beyond that of baseline. These results favor the explanation that the lack of associative coherence elicited a lasting attempt to still find a link, which continued into and hampered the Gabor judgment, rather than the explanation that associated pairs increased attentional allocation because then the associated blocks would have shown sensitivity that is higher than baseline. In the next two experiments, we tested the same hypothesis for two other representative aspects of visual perception.
Experiment 2—Associations and hierarchical perception
As mentioned earlier, the three perceptual tasks were chosen as three representatives of low-level perceptual processing. But the task in Experiment 2, of looking for a possible effect of associative processing on hierarchical global–local processing, had a secondary rationale. Specifically, in another line of research, it has been suggested that there is a reciprocal link between associations and mood (Bar, 2009). Indeed, studies have found that increasing the breadth of associative processing can positively influence mood (Brunyé et al., 2013; Mason and Bar, 2012). Furthermore, it was found that positive mood was directly associated with global bias in perception, and inversely related to local bias (Basso et al., 1996; Gasper and Clore, 2002). Taken together, although we do not study mood here, given that associative processing affects mood, and mood affects global and local perception, we examine in Experiment 2 the effect of associativity directly on global and local perceptions.
The development of object recognition is widely believed to be a hierarchical process, progressing from global to local properties (Kimchi, 1992; Navon, 1977). Operationally, local processing is based on selective attention to individual elements of an object or a scene. In contrast, global processing involves integrating spatial-local elements by linking them together into a larger form of a global structure (Kimchi, 1992). That processing of the global form typically precedes the local form (Navon, 1977) was dubbed the global precedence effect. Similarly, it is argued that the global properties, conveyed mainly by low spatial frequencies, trigger top-down facilitation predictions in visual recognition (Bar et al., 2006).
In this experiment, we evaluated how associative processing (or its lack thereof) can affect global vs. local perception. It has been shown that cognitive load, operationally defined, diminishes the precedence of global information (Hoar and Linnell, 2013). Therefore, if the search for an associative link even for the non-associated pairs continues into the visual task (Global vs. Local in this case), we would expect to see less of a global precedence effect in the non-associative condition.
Materials and methods
Participants
Forty Bar-Ilan University students with normal or corrected-to-normal visual acuity and with no ocular pathology (27 females, age range 18–32, mean age = 24.05) participated in the experiment for credit toward a course requirement.
Stimuli
Five hundred ninety-four pictures of objects, neutral in their emotional valence, were used in 276 image pairs and 42 individual images. All objects were daily items in our lives (e.g., glass, hat, and telephone). The target display was a ‘Navon’ stimulus. The inconsistent Navon set of stimuli consisted of compound letters consisting of several numbers of lower case Ss or Hs (14 lower case Ss, 12 lower case Hs; local letters) configured to form a global H or S (‘Navon’ stimuli), respectively. The consistent Navon set of stimuli consisted of a global H formed by lower case Hs and a global S formed by lower case Hs. The global letters subtended 3 × 2 degrees of visual angle, and the smaller local letters were 0.4 × 0.35 degrees of visual angle. Each letter was displayed 54 times per block.
Procedures
The experiment began with a practice phase that consisted of 12 image pairs followed by Navon stimuli. During the practice phase, the image pairs were a mixture of associated and non-associated pairs (six image pairs for each condition). The experiment was divided into three blocks (baseline, associated, and non-associated block). Each block consisted of 216 trials (determined by the performance described in the literature (Navon, 1977)). The associated and non-associated blocks also consisted of 21 catch trials which were used to verify the performance of the task (a total of 237 trials each; 216 experimental trials, 21catch trials). The baseline block did not consist of image pairs, but rather only a Navon Stimulus. Participants participated in all three blocks, one after the other. Each pair was seen no more than twice during the experiment.
Before the experiment began, participants were given instructions about the general nature of the task and were instructed to attend to the objects. No instructions were given about the nature of the images or the possible relations between them.
During the baseline block, a Navon stimulus was presented in the center of the screen for 40 ms. Participants had to judge which letter they perceived first and respond to it as quickly as possible by pressing “S” if the perception was the letter s or by pressing “H” if the perception was the letter h.
During the associated and non-associated blocks, two images were presented consecutively in the center of the screen (54 × 54 pixels). A Navon stimulus was subsequently also presented in the center of the screen. Each trial consisted of seven presentations (Fig. 3): a fixation cross (500 ms), an object image (300 ms), another fixation cross (250 ms), a second object image (300 ms), a fixation cross (250 ms), a Navon stimulus (40 ms), and a question mark for a response. The pairs of objects could be either associated or non-associated according to the characteristics of the block. Navon stimuli (Navon, 1977) have consisted of a global letter formed by the configuration of local letters (e.g., a global S composed of lower case Hs or a global H composed of lower case Hs). Participants had to judge, in their opinion, which letter they perceived first and respond to it as quickly as possible by pressing “S” if the perception was the letter s (global or local) or by pressing “H” if the perception was the letter h (global or local).
To ensure participants attend to the objects, we added 21 catch trials in each block. In catch trials, two identical images presented consecutively in the center of the screen. After the Navon stimuli were presented, participants were required to ignore it and to press the “Space”. All stimuli were presented randomly. The order of the blocks (baseline, associated, and non-associated) was randomized and counterbalanced across participants. No feedback was given because there was no correct or incorrect response in this experiment. The time elapsed from the stimulus onset to response was computed on-line for each trial and stored as the RT and response. If a participant committed more than 50% errors in the catch trials, the participant was omitted from the analysis.
Results
The data from the experiment were analyzed to determine whether there were differences in the number of times that the participant chose the global property between the blocks (baseline, associated, and non-associated).
The test score was calculated by the number of times that the participant chose the global property. Processing precedence was calculated by the number of times the participant chose the global property relative to the total number of attempts. To test the mean differences in scores between blocks, we conducted a repeated measurement ANOVA with baseline, associated and non-associated blocks as the independent variable. This analysis revealed a main effect in the number of times that the participant chose the global property between conditions (baseline block = 79.14%; associated block = 80.88%; non-associated blocks = 69.86%; F(2, 78) = 7.811, p < 0.001, η2 = 0.167, observed power = 0.944, BF10 = 34.92). The mean numbers of times that the participant chose the global property are plotted as a function of the blocks (Fig. 4a). Pairwise comparisons analysis (using Bonferroni correction) revealed a significant difference between the baseline and the non-associated block (p < 0.05, Cohen’s d = 0.398, CI [0.0655, 18.499], BF10 = 2.742). Also, a significant difference between the associated and the non-associated block was found (p < 0.005, Cohen’s d = 0.547, CI [3.046, 18.990], BF10 = 23.674). However, like in the previous experiment, there was no significant difference between the baseline and the associated block (p = 1, Cohen’s d = 0.153, CI [−6.234, 2.762], BF10 = 0.263), and therefore our subsequent analyses included only the associated and the non-associated blocks. The results showed that the number of times that participants chose the global property in the non-associated block was lower than in the associated block (Fig. 4a). Additionally, we conducted a paired t-test for analysis of RT between the associated and the non-associated block. The analysis revealed that the RT was significantly longer for a global property in the non-associated block than for the associated block (associated block = 447.13 ms; non-associated block = 500.50 ms; two-tailed t(39) = 2.234, p < 0.05, Cohen’s d = 0.535, CI [5.037, 101.70], BF10 = 1.564, Fig. 4b).
Like in the previous experiment, and following the same reason, we tested whether the order of the blocks affected the results. We calculated the differences in choosing the global property in each block for each participant and contrasted the results based on whether the starting block was the associated or the non-associated block. A paired t-test revealed no significant difference in choosing the global property between the blocks (starting block: associated block =12.40%; non-associated block = 9.63%; two-tailed t(19) = 0.411, p = 0.685, Cohen’s d = 0.092, CI [−11.35, 16.91], BF10 = 0.251, Fig. 4c), meaning, like we showed in the previous experiment, the starting block did not affect the results.
These results are similar in vein to what we found in the previous experiment, whereby a lack of an associative link results in subsequently degraded performance, presumably because of the cognitive load that a continued search for an associative link pose. In the third experiment, we tested for a possible effect of lack of associativity on yet another aspect of low-level visual perception.
Experiment 3—Associations and critical flicker fusion
The visual system processes visual information in both spatial and temporal domains. In Experiment 1, we addressed spatial resolution when we examined the influence of association on contrast sensitivity, which is defined as the ability to discriminate, in space, between two adjacent objects. In this experiment, we test temporal resolution through the ability to discern luminance changes over time. Critical flickering fusion (CFF), the lowest frequency rate (measured in Hz) at which intermittently presented light stimuli appear to be steady and continuous for the average human observer, is widely used for assessing temporal processing in the visual system (Simonson and Brozek, 1952). When light is flickering at a higher or equal value of the CFF threshold, the flashes cannot be distinguished from a steady projection, through visual persistence (Kalloniatis and Luu, 2007; Simonson and Brozek, 1952). Conversely, below the CFF threshold, individual flashes may be discriminated from steady lights (Kalloniatis and Luu, 2007; Simonson and Brozek, 1952). In this experiment, we tested how associativity might interact with low-level CFF perception.
Materials and methods
Participants
Forty Bar-Ilan University students with normal or corrected-to-normal visual acuity and with no ocular pathology (25 females, age range 18–33, mean age = 23.40) participated in the experiment for credit toward a course requirement.
Stimuli
Five hundred and twenty pictures of objects, neutral in their emotional valence, were used in 248 image pairs and 24 individual images. All objects were daily items in our lives (e.g., bed, radio, and table). The target display was a flashing white light-emitting diode (LED).
Procedures
In the flicker experiment, the participant observes a flashing light. Exposure to glare can cause discomfort to the participant. Also, multiple exposures may cause insensitivity to participants’ reactions. Thus, to obtain a reliable response and to accommodate the participants, we decided to minimize the duration of the experiment as much as possible. Therefore, because of the lack of significant differences between the baseline block and the associated block in the two previous experiments, we decided in this experiment to focus only on the associated and the non-associated blocks, and not to include a baseline block.
The experiment began with a practice phase that consisted of eight image pairs followed by a flashed light. During the practice phase, the image pairs were a mixture of associated and non-associated pairs (four image pairs for each condition). The experiments were divided into two blocks (associated and non-associated) of 132 trials each (60 experimental trials, 60 fillers, and 12 catch trials), determined by the staircase performance described in the literature (Sowden et al., 2002). Participants participated in both blocks, one after the other. Each pair was seen only once during the experiment.
Before the experiment began, participants were given instructions about the general nature of the task and were instructed to attend to the objects. No instructions were given about the nature of the images or the possible relations between them.
In this experiment, two images were presented in the center of the screen (54 × 54 pixels) separately. Using an adaptive staircase method (explained below), a LED (5 mm, current 20 mA) was then flashed in the center of the screen. An external Arduino microcontroller controlled the flashed light. Each trial consisted of seven presentations (Fig. 5): a fixation cross (500 ms), an object image (300 ms), another fixation cross (250 ms), a second object image (300 ms), a fixation cross (250 ms), a flickering light stimulus (100 ms), and a question mark for a response. The pairs of objects could be either associated or non-associated according to the characteristics of the block. The participants had to determine whether the flickering light was continuous or flashing and respond as quickly as possible by pressing “yes” if the light was continuous or by pressing “no” if it was flashing.
To ensure that participants attend the objects, we added 12 catch trials in each block. In catch trials, two identical images presented consecutively in the center of the screen. After the flickering light was presented, participants were required to ignore it and to press the “Space”. All stimuli were presented randomly. The order of the associated and non-associated blocks was randomized across participants. The time that elapsed from the stimulus onset to response was computed on-line for each trial and stored as RT and flashing rate. If a participant had more than 50% errors in the catch trials, the participant was omitted from the analysis.
Functional adaptive sequential testing (FAST) was used in both blocks to estimate the measurement of the CFF. FAST is a Matlab toolbox for efficiently estimating thresholds in behavioral experiments. A single threshold estimated to be between 0 and 60 Hz-units, with a detection task using a logistic function (default) with slope estimated to be between 0.1 and 1 unit. FAST method estimated the full psychophysical function utilizing all data points, and, for each trial, selects the stimulus variable that maximizes the certainty about the function parameter values based on fit parameters (threshold and slope) from all preceding trials (Vul et al., 2010). When the participant responded that the light was continuous, the subsequent frequency decreased, and vice versa. This process is repeated until the end of the experiment. At the end of the trials, FAST provided a final CFF threshold. In each block, 60 trials were used to estimate the final CFF threshold. However, because this function is gradual, the participant is expected to press the same response for several consecutive steps. Therefore, to blur the function, each block included 60 additional trials (fillers) in which the flickering light that displayed was random. The order of all trials was randomized (experimental, fillers, and catch trials). No feedback was given because there were no correct or incorrect responses in this experiment.
Results
The data from the experiment were analyzed to determine whether there were differences in the mean CFF threshold between the blocks (associated vs. non-associated). Analyses were conducted only on the experimental trials.
To test the mean differences in scores between blocks, we conducted a paired t-test between the associated and the non-associated blocks. The analysis revealed a significant difference in the mean CFF threshold between the blocks. The mean CFF thresholds are plotted as a function of the blocks. The mean CFF threshold in the non-associated block was lower than in the associated block (associated block = 50.04 Hz; non-associated block = 47.65 Hz; two-tailed t(39) = −2.390, p < 0.05, Cohen’s d = 0.378, CI [0.369, 4.428], BF10 = 2.114, Fig. 6a). That means, for example, that after non-associated pairs, participants tend to see 49 Hz as a continuous light, whereas after associated pairs, 49 Hz were perceived as flickering. We found no significant difference between the conditions regarding the RT (associated block = 343.85 ms; non-associated block = 356.90 ms; two-tailed t(39) = 0.746, p = 0.459, Cohen’s d = 0.118, CI [−22.32, 48.43], BF10 = 0.221, Fig. 6b). We can explain these results by the reason that the flickering light was activated continuously for 100 ms. Participants could not reply before the flickering light was turned off, and therefore, it is possible that they already formulated a response and only waited to press it.
Like in the previous experiments, we tested whether the order of the blocks would affect the results. We calculated the differences in the mean CFF threshold in each block for each participant. We contrasted the results based on whether the starting block was the associated or the non-associated block. A paired t-test revealed no significant difference in the difference of the mean CFF threshold between the blocks (starting block: associated block = 0.91 Hz; non-associated block = 3.87 Hz; two-tailed t(19) = 1.465, p = 0.159, Cohen’s d = 0.327, CI [−1.269, 7.184], BF10 = 0.584, Fig. 6c), meaning, like we showed in the previous experiment, the starting block did not affect the results.
CFF defines the temporal threshold at which a flashing light is perceived as continuous light. The results show that following pairs of images that were not associated with each other, the CFF threshold was poorer than following associative pairs, in-line with the outcome of the other two experiments reported here. In other words, seeing two non-associated objects directly reduced subsequent sensitivity in detecting flicker, just like in detecting contrast. Our overarching proposal is that this effect is a result of the cognitive load that a sustained, inherent search for associative relations confers.
General discussion
In this study, we examined the effects of associative coherence on lower-level perception. We found that a lack of evident associative coherence significantly degrades subsequent perceptual performance relative to associative processing in the three representative visual aspects that were tested.
The first experiment revealed a significant increase in CS thresholds (i.e., decreased sensitivity) when it was tested following pairs of non-associated images, compared with pairs of associated images. The second experiment found decreased global precedence for pairs of non-associated images as compared to associated images. The third experiment showed a reduced CFF threshold (i.e., decreased in performance) for a pair of non-associated images. Moreover, in all three visual conditions, RTs were longer following the non-associated pairs (significant only in the first two experiments). In summary, rather than facilitation by association, we observed impairment by a lack of associations.
To explain our findings, we consider first the spreading activation theory for the organization of memory. According to this theory, concepts are represented in memory as nodes that are interconnected by associative links (Anderson, 1983; Collins and Loftus, 1975). When we experience an event, nodes that contain information about the event will lead to spreading activation across related nodes and concepts in memory networks. This spreading activation is proposed to occur automatically, quickly, and unconsciously (Barrett and Rugg, 1990; Neely, 1977; Posner et al., 1975). According to this account, during our experiments, the first image triggered the activation of representations that are related to this particular image and can follow it next. In the associated block, the image pairs were strongly connected; therefore, we can assume that the second image that was presented was one that was activated by the first image already. This associative match provided the associative coherence, which helped participants move on to the judgment without dwelling on trying to find a connection.
In the non-associated block, on the other hand, the image pairs were unrelated; the first image activated related representations, but the second image did not match any option anticipated based on the spreading activation triggered by the first image. We propose that in this case, when there was no apparent association between the first and the second image of the pair, participants continued to search for one. This persistent search for a link, which is indicative of our need for coherence, has transcended into the subsequent visual task, resulting in diminished resources available for the task at hand. In other words, when there is a clear associative link between the images, participants approach the visual task with less of a cognitive load (Zucker and Mudrik, 2019) and thus more resources for better performance (Gigerenzer, 2007). In contrast, in the non-associated condition, the participants continued to ruminate, or incubate, even if not consciously, on trying to find a link between two unrelated images.
Numerous studies have shown that visual perception is capacity-limited, and therefore perception relies heavily on the availability of resources (Carmel et al., 2007; Martens and Kiefer, 2009). For example, participants in a study by Martens and Kiefer (2009) performed either an easy or a difficult task prior to masked priming in a lexical decision task. The results revealed that no priming effect was found after a difficult task unless there was a long-time-interval between the primary and the secondary tasks. A study by Carmel and colleagues (2007) similarly found that the detection of temporal patterns also depends on the availability of resources. Their study showed that a high cognitive load might reduce the ability to discriminate between single events, which can lead to impairment in the CFF threshold. Thus, the amount of cognitive load determines the accuracy and the sensitivity of the CFF detection. Carmel and colleague’s (2007) study supports the results we observed in Experiment 3. Additionally, it was found (Baror and Bar, 2016) that in a free-association task under the manipulation of a simultaneous mental load, participants in high load conditions (e.g., keeping in mind a long string of digits) rely heavily on strong immediate associations, while participants in low load conditions (e.g., keeping in mind double-digit numbers) exhibited broader and more unique associations. The high cognitive load apparently captures the available resources and prevents participants from being creative and ‘open-minded’.
The cognitive load that we propose as taxing performance originates from working memory (Kanfer and Ackerman, 1989). Several studies have revealed a relationship between working memory, perceptual processing, and visual performance. For example, it has been found that working memory capacity modulated the functional visual field. A high capacity of working memory narrows the functional visual field to about 2° in diameter, while a low capacity of working memory yields about 4° in diameter (Williams, 1982). Furthermore, studies have demonstrated that pupil dilation can serve as an indirect measure of working memory in visual performance tasks. It has been found that an increase in working memory demands usually leads to increases in pupil dilation (Granholm et al., 1996; van der Wel and van Steenbergen, 2018). Additionally, manipulation on working memory capacity during a visual search task revealed several effects on perceptual processing. Working memory capacity influences RTs, fixation frequencies, fixation durations, eye movements and the accuracy of the report (He and McCarley, 2010; Moores et al., 2003). Therefore, working memory capacity is related not only to complex cognitive functions but also to low-level perceptual processes.
Although our findings are best explained by the account detailed above, of persistent load due to continued search for an associative link, as we inferred, other explanations could also be considered. For example, an alternative account of our findings involves varying the allocation of attention as a function of associations. Studies have shown the value of associative thinking in numerous cognitive and perceptual processes. For instance, it was found that associated objects affect the spread of attention and capture attentional resources (Moores et al., 2003; Summerfield et al., 2006). It was suggested that the activation of object representations in working memory triggers associated representations (Downing, 2000; Moores et al., 2003). These representations attract more attention by initiating top-down processes or cause rapid and efficient processing, which attracts attention (Downing, 2000; Sperling, 1960). Therefore, associated images may facilitate subsequent perception by a general increase of attention while non-associated images decrease it, which may be less likely given that baseline and associated conditions showed equivalent results. Nevertheless, in the three experiments, while performing the non-associated block, participants might have been less attentive because they had fewer resources available to manage and perform the task, per the account above, and hence performance significantly decreased.
Another finding that needs to be discussed is the comparison between the baseline and the associated block. The first two experiments included a control baseline block, and a comparison between the baseline and the associated block revealed no significant differences. Other behavioral studies also found fewer differences between control and associated condition (Drevets and Raichle, 1998; Rock, 1957; Rock and Heimer, 1959; Storbeck and Clore, 2008). This tendency for control groups to mimic the results of the associated groups presumably reflects the fact that most people are associative by nature (Diener and Diener, 1996). Also, examining the current literature indicates that the natural tendency of people is to be exploratory and gravitate to novelty (Baror and Bar, 2016). In other words, when resources are available, the brain has a basic bias to seek unique associations. It was also found that people are inherently creative in the way they solve problems in daily life (Sternberg, 1999). Also, in studies that estimated the rates of depression and life satisfaction by questions related to subjective well-being found that the majority of people, regardless of nationality, avow positive levels of happiness and well-being (Diener and Diener, 1996). Furthermore, exploration, creativity, and happiness were found to be an integral part of associated thinking (Baror and Bar, 2016; Mednick et al., 1964). Associations are considered as a spontaneous, natural, and even default process (Bar, 2007; Baror and Bar, 2016; Nelson et al., 1985; Raaijmakers and Shiffrin, 1981). Therefore, the induction of associative thinking in healthy people, who are already associative by nature, may not change or promote further associative thinking, which may be one reason why we did not find a difference between the blocks.
When anticipating the possible outcomes, we stated that a difference in performance following associative vs. non-associative pairs could stem from two possible sources: either from a lingering search for an associative link when there is none, or because of associative priming in the associative case that facilitated the recognition of the second image in the pair and thus left subjects with more time for the subsequent task. Our results support the former. Specifically, that there was no difference between the associative condition and the control condition indicates that our results could not be explained by priming but rather by the search for associative coherence.
In daily life, people rely on associations for most cognitive processes, and look for associative coherence, in the world around us. Associative coherence implies that the world behaves as we expect it to behave, which affirms the internal model of our environment. After all, associations are learned through statistical regularities of what tends to be relevant with what in our world. When we do not find it, we seem to continue to think and search for a link, as our three experiments suggest.
Conclusion
Perception is shaped and formed by the physical properties of the stimulus as well as, by factors such as state, attention, context, load, mood, thoughts, and beliefs (Balcetis and Dunning, 2006). This study suggested a novel influence on perception, which is not entirely intuitive, that load imposed by the need to seek coherence even in, and perhaps especially in, non-associative information degrades performance at least on three low-level visual perception tasks. Although the underlying mechanism remains to be elucidated, these findings help advance our understanding of non-physical influences on perception and the power of associative processing to shape our experiences of the world around us.
Data availability
The datasets generated and analyzed are available from the authors upon request.
References
Anderson JR (1983) A spreading activation theory of memory. J Verbal Learn Verbal Behav 22(3):261–295
Balcetis E, Dunning D (2006) See what you want to see: motivational influences on visual perception. J Personal Soc Psychol 91(4):612
Bar-Anan Y, Liberman N, Trope Y (2006) The association between psychological distance and construal level: evidence from an implicit association test. J Exp Psychol: Gen 135(4):609
Bar M (2004) Visual objects in context. Nat Rev Neurosci 5:617
Bar M (2007) The proactive brain: using analogies and associations to generate predictions. Trends Cogn Sci 11(7):280–289
Bar M (2009) A cognitive neuroscience hypothesis of mood and depression. Trends Cogn Sci 13(11):456–463
Bar M, Kassam KS, Ghuman AS, Boshyan J, Schmid AM, Dale AM, Rosen BR (2006) Top-down facilitation of visual recognition. Proc Natl Acad Sci USA 103(2):449–454
Baror S, Bar M (2016) Associative activation and its relation to exploration and exploitation in the brain. Psychol Sci 27(6):776–789
Barrett SE, Rugg MD (1990) Event-related potentials and the semantic matching of pictures. Brain Cogn 14(2):201–212
Basso MR, Schefft BK, Ris MD, Dember WN (1996) Mood and global–local visual processing. J Int Neuropsychol Soc 2(3):249–255
Benedek M, Könen T, Neubauer AC (2012) Associative abilities underlying creativity. Psychol Aesthet Creat Arts 6(3):273
Biederman I (1972) Perceiving real-world scenes. Science 177(4043):77–80
Brainard DH, Vision S (1997) The psychophysics toolbox. Spat Vis 10:433–436
Brunyé TT, Gagnon SA, Paczynski M, Shenhav A, Mahoney CR, Taylor HA (2013) Happiness by association: breadth of free association influences affective states. Cognition 127(1):93–98
Carmel D, Saker P, Rees G, Lavie N (2007) Perceptual load modulates conscious flicker perception. J Vis 7(14):14
Collins AM, Loftus EF (1975) A spreading-activation theory of semantic processing. Psychol Rev 82(6):407
Diener E, Diener C (1996) Most people are happy. Psychol Sci 7(3):181–185
Downing PE (2000) Interactions between visual working memory and selective attention. Psychol Sci 11(6):467–473
Drevets WC, Raichle ME (1998) Reciprocal suppression of regional cerebral blood flow during emotional versus higher cognitive processes: Implications for interactions between emotion and cognition. Cognit Emotion 12(3):353–385
Farell B, Pelli DG (1999) Psychophysical methods, or how to measure a threshold and why. Vis Res 5:129–136
Gasper K, Clore GL (2002) Attending to the big picture: Mood and global versus local processing of visual information. Psychol Sci 13(1):34–40
Gigerenzer G (2007) Gut feelings: The intelligence of the unconscious. Penguin
Granholm E, Asarnow RF, Sarkin AJ, Dykes KL (1996) Pupillary responses index cognitive resource limitations. Psychophysiology 33(4):457–461
He J, McCarley JS (2010) Executive working memory load does not compromise perceptual processing during visual search: evidence from additive factors analysis. Atten Percept Psychophys 72(2):308–316
Hoar S, Linnell KJ (2013) Cognitive load eliminates the global perceptual bias for unlimited exposure durations. Atten Percept Psychophys 75(2):210–215
Kalloniatis M, Luu C (2007) Temporal resolution. In Webvision: The Organization of the Retina and Visual System. University of Utah Health Sciences Center.
Kanfer R, Ackerman PL (1989) Motivation and cognitive abilities: an integrative/aptitude-treatment interaction approach to skill acquisition. J Appl Psychol 74(4):657
Kelly DH (1977) Visual contrast sensitivity. Opt Acta 24(2):107–129
Kimchi R (1992) Primacy of wholistic processing and global/local paradigm: a critical review. Psychol Bull 112(1):24
Levin I (1978) Creativity and two modes of associative fluency: chains and stars. J Personal 46(3):426–437
Martens U, Kiefer M (2009) Specifying attentional top-down influences on subsequent unconscious semantic processing. Adv Cogn Psychol 5:56
Mason MF, Bar M (2012) The effect of mental progression on mood. J Exp Psychol: General 141(2):217
Mednick MT, Mednick SA, Jung CC (1964) Continual association as a function of level of creativity and type of verbal stimulus. J Abnormal Soc Psychol 69(5):511
Moores E, Laiti L, Chelazzi L (2003) Associative knowledge controls deployment of visual selective attention. Nat Neurosci 6(2):182
Navon D (1977) Forest before trees: the precedence of global features in visual perception. Cogn Psychol 9(3):353–383
Neely JH (1977) Semantic priming and retrieval from lexical memory: roles of inhibitionless spreading activation and limited-capacity attention. J Exp Psychol: General 106(3):226
Nelson DL, Bajo MT, Casanueva D (1985) Prior knowledge and memory: the influence of natural category size as a function of intention and distraction. J Exp Psychol: Learn Mem Cogn 11(1):94
Posner MI, Snyder CRR (1975) Attention and cognitive control. In: Solso RL (ed), Information processing and cognition: the Loyola symposium. Lawrence Erlbaum
Raaijmakers JG, Shiffrin RM (1981) Search of associative memory. Psychol Rev 88(2):93
Rock I (1957) The role of repetition in associative learning. Am J Psychol 70(2):186–193
Rock I, Heimer W (1959) Further evidence of one-trial associative learning. Am J Psychol 72(1):1–16
Rowe PG (1991) Design thinking. MIT press
Rubinsten O, Anaki D, Henik A, Drori S, Faran Y (2005) Norms for free associations in the Hebrew language. In: Henik A, Rubinsten O, Anaki D (eds) Word norms for the Hebrew language [in Hebrew]. Ben-Gurion University of the Negev, Beer-Sheva, Israel, pp 17–34
Simonson E, Brozek J (1952) Flicker fusion frequency: background and applications. Physiol Rev 32(3):349–378
Sowden PT, Rose D, Davies IRL (2002) Perceptual learning of luminance contrast detection: specific for spatial frequency and retinal location but not orientation. Vision Res 42(10):1249–1258
Sperling G (1960) The information available in brief visual presentations. Psychol Monogr: General Appl 74(11):1
Sternberg RJ (1999) Handbook of creativity. Cambridge University Press
Storbeck J, Clore GL (2008) The affective regulation of cognitive priming. Emotion 8(2):208
Summerfield JJ, Lepsien J, Gitelman DR, Mesulam MM, Nobre AC (2006) Orienting attention based on long-term memory experience. Neuron 49(6):905–916
Trapp S, Shenhav A, Bitzer S, Bar M (2015) Human preferences are biased towards associative information. Cognit Emotion 29(6):1054–1068
van der Wel P, van Steenbergen H (2018) Pupil dilation as an index of effort in cognitive control tasks: a review. Psychon Bull Rev 25(6):2005–2015
Vul E, Bergsma J, MacLeod DIA (2010) Functional adaptive sequential testing. See Perceiv 23(5):483–515
Watson AB, Pelli DG (1983) QUEST: a Bayesian adaptive psychometric method. Percept Psychophys 33(2):113–120
Williams LJ (1982) Cognitive load and the functional field of view. Hum Factors 24(6):683–692
Zucker L, Mudrik L (2019) Understanding associative vs. abstract pictorial relations: an ERP study. Neuropsychologia 133:107127
Acknowledgements
This research was supported by The Israel Science Foundation (ISF) grant no. 673/17, and by the Sagol Family, both to MB.
Author information
Authors and Affiliations
Contributions
Both authors designed the research. YA carried out the experiments and analyzed the data. Both authors wrote and approved the final version of the manuscript before submission.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Afiki, Y., Bar, M. Our need for associative coherence. Humanit Soc Sci Commun 7, 80 (2020). https://doi.org/10.1057/s41599-020-00577-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1057/s41599-020-00577-w