Complex problem solving in science, engineering, and business has become a highly collaborative endeavor. Teams of scientists or engineers collaborate on projects using their social networks to gather new ideas and feedback. Here we bridge the literature on team performance and information networks by studying teams' problem solving abilities as a function of both their within-team networks and their members' extended networks. We show that, while an assigned team's performance is strongly correlated with its networks of expressive and instrumental ties, only the strongest ties in both networks have an effect on performance. Both networks of strong ties explain more of the variance than other factors, such as measured or self-evaluated technical competencies, or the personalities of the team members. In fact, the inclusion of the network of strong ties renders these factors non-significant in the statistical analysis. Our results have consequences for the organization of teams of scientists, engineers, and other knowledge workers tackling today's most complex problems.
Complex problems in science, engineering, or business are being solved by teams of people working closely with one another, each with the help of their network. In science, modern experiments require the collaboration and specialization of many individuals1. For example, a modern Nature paper can have more than 100 co-authors2 and the number of co-authors of PNAS papers has more than doubled over the last 20 years, reaching an average of 8.4 co-authors per paper3. In businesses, teams of knowledge workers have become the basic unit carrying out work4. Our ability to solve complex problems increasingly depends on teams of scientists, engineers, or knowledge workers and their extended information networks5,6.
Qualitative and quantitative study of high-performing teams–an interdependent collection of individuals working towards a common goal where members share individual and mutual responsibility for the outcome7–has been an ongoing effort in the social, management, and science of science8,9,10,11,12,13. Previous studies focused on how the personalities, technical or cognitive abilities, or the existence of previous collaborations of team members explain team performance. Recent quantitative studies investigated the determinants of high-performing teams by studying their structure or pattern of communications14,15,16,17,18,19.
Accessing to the right piece of information is central to solving complex problems. This information, however, often only exists in the form of advice, expertise, implicit knowledge, or experience and flows through social ties. Consequently, the structure of social interactions has been shown to enhance or hinder access to such resources. Building on advances in social network analysis, empirical research showed the impact of an individual's information or collaboration network on her performance20,21,22,23,24,25,26. Amongst others, the impact of an individual position in the information network has been investigated through measures of node degree, centrality, structural holes, closure, and social diversity27,28,29,30,31,32.
Both within-team and extended information networks are useful. Within-team networks allow for engagement, collaboration, and the higher level of information sharing needed for teams to perform15. Frequent interactions between team members have been shown to help them become familiar with one another and to positively impact their teamwork33. Extended networks of informal ties of team members have been shown to be the vector for key exchanges of information15. Information often flows through these ties despite the existence of formal coordination and communication mechanisms. These informal extended ties have been shown to be particularly important in competitive environments34. This work, at the intersection of information networks and team performance, studies the problem solving abilities of teams as a function of the within-team network structure and extended information network in a real working environment. We show that, for both within team and extended ties networks, only the strongest ties matter.
We examine the performance of 45 assigned teams of four students during one semester. Eighty participants worked in teams on three separate projects for one course. Teams changed for every project so that no one worked with the same person twice. Following the behavioral tradition of organizational learning, we measure performance by focusing on predefined objective outcomes35: the grades given by the lecturer to the team reports. Participants specifically mark their individual contribution, which motivates them to actively participate.
There has been considerable ambiguity about what constitutes a tie when studying social and information networks, as well as the structure of organizations36,37. In his definition of Phillos relationships, Karckhardt23 focuses on interaction, affection, and time as the basic characteristics of ties. This prompted Lincoln to propose to define ties as either instrumental or expressive17,38. We adopt this definition here.
Expressive ties reflect friendships and include an affective factor. They have been theorized to create incentives to treat others positively and fairly. We measured expressive ties using a questionnaire at the beginning of the experiment. Participants were asked to report their friendship levels () on a 0, 2, 4, 7, 10, 12 scale, following the standard local grading system, with zero being “I do not know this person,” four “an acquaintance,” and twelve “one of my best friends” [see Methods]. We take friendship as a school-related measure of closeness. Fig. 2A shows the directed network of expressive ties, as well as the teams we assigned participants to for the first project.
Instrumental ties usually arise in professional settings, between colleagues or collaborators interacting and spending time together. They have been shown in the performance literature to create opportunities for the exchange of information23, to develop an esprit de corps15, and to allow for colleagues or collaborators to gain interpersonal familiarity33. We consider time spent in physical proximity as a proxy for instrumental ties39,40. The logs of the university wifi system indicates the building in which participants' devices were. Using this information, we construct a weighted undirected network of time spent together over the course of the semester () on a 0 to 100 scale [see Methods]. Fig. 2B shows the undirected network of instrumental ties.
Finally, the impact of tie strength on information propagation and knowledge transfer has been discussed in the social network, sociology, and science of science literature. It has however been considered in the form of either strong or weak ties, with research showing benefits for both21. In his seminal article on job searches, Granovetter showed that opportunities such as information about jobs usually flow through weak ties22. Subsequent work showed these distant and infrequent weak ties to be useful in the diffusion of information, advice, and ideas41,42,43. However, because they are more accessible or willing to help, strong ties have been shown to be essential to the transfer of complex information and tacit knowledge23,24,25,31. In organizational settings, strong ties have been shown to reduce conflicts44 and to be crucial in dealing with stressful or unusual situations23. While quantifying what constitutes a strong and weak tie might be difficult, the effect of the expected benefits as a function of tie strength can be quantified.
We show that, given a simple linear model, the impact of tie strength on performance is highly nonlinear; only the strongest ties matter. We compute various network measures considered in the social network, collaboration network, and team performance literature such as the mean team degree, maximum team in-degree, etc17. All these measures display a nonlinear performance gain with tie strength; only the strongest expressive and instrumental ties (resp. and ) explain part of the team performance variance [Fig. 1]. All the network measures for the strongest ties are furthermore highly consistent internally (α = .940)45. The correlation between team performance and mean team degree is r2 = .272 (p < .05) for strongest expressive ties and r2 = .214 (p < .05) for the strongest instrumental ties. In comparison, the correlation between team performance with the weakest expressive and instrumental ties is respectively r2 = .010 and r2 = .034 (both p > .05). This implies that (1) for both within-team and extended networks, only the strongest expressive and instrumental ties have an actual impact on the performance of the teams, and (2) the more expressive ties a team has, the better it performs.
Network measures of the strongest ties explain team performance better than other a priori measures, making them not significant most of the time. At the beginning of the experiment, participants took a 6-questions technical competencies test on the topic at hand, filled out a personality questionnaire, and were asked to self-evaluate how knowledgeable they were about the topic. The six technical questions were averaged as measured technical competency. The strongest ties in both the expressive and instrumental ties networks explain more of the variance than any of the team competencies considered: the mean or maximum of either the self-evaluated competencies, measured competencies, or personality [Fig. 1 and Methods]. The maximum self-evaluated and measured technical competencies, or personality, were systematically less explanatory than their mean values. None of the personality measures alone or combined as factors are significant. When taken as the only independent variable in a linear model, both mean self-evaluated (p = .004) and mean measured technical proficiency (p = .002) are significant. However, adding mean team degree of the strongest ties to both linear models makes both of them not significant (p > .05). Mean team degree for expressive ties has p-values of .009 when combined with mean self-evaluated competencies and .014 when combined with mean measured competencies (respectively .043 and .094 for instrumental ties).
Network measures of both expressive and instrumental ties explain performance better than self-evaluated and measured technical competencies, or personality. As a measure of comparison, participants were also asked to fill out a short questionnaire when handing in their projects. In this questionnaire, they were asked how they felt their team performed for this particular project. We expected this a posteriori measure to be the best indicator of team performance as self-assessment has been shown to be a reliable indicator of team performance46. It indeed was. However, while a posteriori self-assessed team performance explains nearly half of the variance (r2 = .462, p < .001), it is only two times what is explained by our a priori strong ties measures.
Temporal precedence has been often neglected in team performance, collaboration networks, and social network research19,47. Our experimental design allows us to answer the question of temporal precedence between expressive network structure and team performance. Does a dense network structure help a team to perform well or does a performing team create dense networks? In this study, we measured the network of expressive ties before the experiment started. We then assigned participants to teams, and we see a positive correlation between the strongest expressive ties and team performance.
Our results hold in both expressive and instrumental networks. Our expressive network is measured through traditional questionnaires, while our instrumental network is measured through sociometric means. We do not however expect the strength of a tie in the two networks to be independent as we are, for example, likely to spend more time with our friends. Fig. 3 shows that, while we indeed spend more time with our strongest expressive ties, the distribution of instrumental strength is still broad. This means that ties in both networks really help explain performance.
Tie strength, a variable often ignored, is in fact crucial for understanding teams' problem solving abilities. In our experiment, the project-based work completed by the participants can be characterized as non-routine and complex. Teams were presented with complex problems which focused on creative thinking and applying gained knowledge in a novel context.
To conclude, these results imply that weak ties between scientists, engineers, or other knowledge workers are unlikely to enhance access to information or to help performance. Very strong ties inside teams and between units or research teams are needed. The problem solving abilities of teams of scientists or knowledge workers tackling today's most complex problems could be greatly improved upon by creating very strong instrumental and expressive ties.
This experiment took place during a full semester course (13 weeks) at a large western university [See Fig. 4]48. The course was an advanced course, involving work with high-level programming, data modelling, and simple machine learning. At the beginning of the course, 80 out of the 95 students agreed to participate in the experiment and filled in an initial questionnaire. During the semester, participants successively worked on 3 projects in teams assigned by us. N = 45 teams containing only participants are analyzed in this paper. Participants also answered right after handing-in their project report how they felt their team performed on a 1 to 5 scale: “How do you think your team did.” Participants were informed that this self-assessed performance would not be seen by the lecturer, nor used in the grading process. The team projects were evaluated by the lecturer taking the difficulty of the assignment into account. The assignments focused on handling and visualizing social data, machine learning, and network analysis with students solving coding exercises, answering theoretical questions, and analyzing their results. At the university, students are encouraged to and commonly work and solve tasks in teams.
At the beginning of the experiment, we asked participants about their self-reported proficiency on a 1–5 scale (“Would you consider yourself a beginner (1) or an expert (5) for this course?”). We also presented them with 6 technical questions assessing their skills related to the course and their personality (BFI-10)49.
At the beginning of the experiment, we asked participants to rate how well they knew all the other participants. We used the standard grading scale (0–12), which all participants are familiar with: “0 - I do not know this person,” “2 - I recognize this person, but we never talked,” “4 - Acquaintance (we talk or hang out sometimes),” “7 - Friend,” “10 - Close friend,” “12 - One of my best friends”. The list of participants to rate was presented as a webpage that included the participants' full names and university profile pictures.
The graphs of expressive ties were created by removing all links weaker than a given value. For example, would be the network with only ties of strength at least 7. We calculated the in- and out-degrees of all nodes in the directed network, as well as their degree in the undirected network. The undirected network was created by considering only reciprocated ties after having removed the links weaker than a given value. Results are similar with all three measures [Fig. 1].
Participants have to login on their devices (smartphones, computers, etc) to use the university wifi system. This allows us to know which building a device was connected to with a resolution of 10 minutes. We infer instrumental ties from the observed co-occurrences using 10 minute time bins. The tie strength Si,j between participants i and j is given by50: where ci,j,t,b is 1 if participants were present in the same building b at the same time t and 0 if otherwise. Nt,b is number of participants in building b at time t. We created the graphs of the wifi-based co-occurences by percentiles. For example, would be the network with the 30% strongest ties.
We assigned the participants into teams of four, as required by the course lecturer. We assigned students to new teams for each of the three projects so that no student was with the same person in team more than once. To find a balance among within and between team ties, we optimized the entropy of the motifs and the number of edges within teams while adding a penalty for missing motifs using a greedy algorithm [see SM].
The effects of ties of all strength, self-evaluated, and measured technical competencies and self-assessed team performance on the performance of teams were evaluated by computing Pearson's product-moment coefficient between the team grade and the mean or the maximum of the measure of interest on a per team basis. The effect of personality was evaluated using both an average of the five personality traits of the team members as well as jointly modeled using a linear model with team grade as dependent variable. Finally, the effect of adding network measures to the self-evaluated and measured technical competencies and personalities of teams members were evaluated using a linear model.
We thank Piotr Sapiezynski for his help in data collection and insights regarding wifi data, Vedran Sekara for his help in data collection, and Luc Rocher for his help with the network visualizations. We also thank the students for participating in the experiment. Yves-Alexandre de Montjoye thanks the Belgian American Educational Foundation (B.A.E.F.) for its financial support. This research was partially sponsored by the Army Research Laboratory under Cooperative Agreement Number W911NF-09-2-0053. Views and conclusions in this document are those of the authors and should not be interpreted as representing the policies, either expressed or implied, of the Army Research Laboratory.
Supplementary Information for 'The Strength of the Strongest Ties in Collaborative Problem Solving'
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License. The images or other third party material in this article are included in the article's Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder in order to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-nd/4.0/