The point of the following paper is to outline conjoint analysis, one of the methods of multidimensional statistical analysis. Collecting responses through a survey. In experimental approaches to selective exposure, respondents are often required to make a choice and select one or more news stories over others. Hierarchical Bayesian procedures are nowadays relatively popular as well. For example a large number of people planning to buy a new smart phone might think that however much they want an iPhone 6, they will have to be content with a less expensive phone. - Business 4. Thus we see that consumers are put in a situation where they are forced to evaluate the merit of the phone attributes such as configuration, OS, price, brand, etc. More so, it is possible to desire a set of features that is enough to offset the investment regarding brand equity. With this combination, Durr will acquire an estimated market share of 29.67% (89 units) which is higher than the market share When applying conjoint analysis, it can be easier to calculate these attribute interactions, which can be included without increasing the complexity of research design. Please read all of the headlines carefully and imagine that the headlines are real, We followed this with, You would perhaps not read any of these articles on a normal day, but lets say that you had to read two of these articles. 1. This method is used using a controlled set of products or services that will be presented to respondents. The traditional survey experiment has well-known restrictions regarding the number of factors we can study at any one time. The cookie is used to store the user consent for the cookies in the category "Other. Professor of Marketing, The problem with this is the high fixed cost of conducting even one survey, let alone tens or hundreds. Conjoint uncovers this pattern so that the company can target users accordingly. The dots represent the point estimates of the effects (AMCEs) of difference source attributes on the trust. The design is a 323333310 factorial design, equaling more than 29,000 possible combinations. Selecting the importance degree of these attributes. 9.5. Standard survey experiments, however, can vary only a small number of factors. Second, respondents judgment of credibility, like most other judgments and decisions, are, conceptually, multidimensional. With an exception to this situation, conjoint is quite inexpensive as compared to other similar methods such as concept testing and hence is hugely popular. WebConjoint analysis is also applicable in situations where segmentation needs to be done. The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. The popularity of conjoint analysis (CA) in health outcomes research has been increasing in recent years [ 1, 2 ]. The procedure of conjoint analysis involves the gathering of data through marketing research survey. Advantages: Thanks to the conjoint analysis, it is easy to determine which features a product must have and Their argument would be strengthened by a tailored conjoint design that could enable a comparison of the effect of each cue. preferably not exhibit strong correlations (price and brand are an exception), estimates psychological tradeoffs that consumers make when evaluating several attributes together, can measure preferences at the individual level, uncovers real or hidden drivers which may not be apparent to respondents themselves, if appropriately designed, can model interactions between attributes, may be used to develop needs-based segmentation, when applying models that recognize respondent heterogeneity of tastes, designing conjoint studies can be complex, when facing too many product features and product profiles, respondents often resort to simplification strategies, difficult to use for product positioning research because there is no procedure for converting perceptions about actual features to perceptions about a reduced set of underlying features, respondents are unable to articulate attitudes toward new categories, or may feel forced to think about issues they would otherwise not give much thought to, poorly designed studies may over-value emotionally-laden product features and undervalue concrete features, does not take into account the quantity of products purchased per respondent, but weighting respondents by their self-reported purchase volume or extensions such as volumetric conjoint analysis may remedy this, Green, P. Carroll, J. and Goldberg, S. (1981), This page was last edited on 1 February 2023, at 00:10. WebADVANTAGES AND DISADVANTAGES OF THE USE OF CONJOINT ANALYSIS IN CONSUMER PREFERENCES RESEARCH Abstract. WebPurpose: In recent times, many universities have been pressured to become heavily involved in university branding. [4] Depending on the type of model, different econometric and statistical methods can be used to estimate utility functions. Although previous studies isolated the effects of factors such as use of advertising and comment fields on peoples trust evaluations, this example illustrates that conjoint experiments can provide insights into the relative effects of such factors and reveal the explanatory strength of different hypotheses identified by previous research. Nearly a quarter-century has passed since Bartels (Citation1993, p. 267) claimed that the state of the research on media effects is one of the most notable embarrassments of modern social science. The cure, he said, was experimental designs and carefulness in measurement. In a nutshell, it is a versatile and powerful tool to predict consumer choices, foresee their purchase decisions and hence design and launch products accordingly. Users cannot have more of all features that are attractive and less of all features that are not desirable. WebIn applications of conjoint analysis, results obtained at the individual level have to be aggregated for managerial purposes. Resorting to Simplification In accordance with so many options, respondents are able to resort to simplification strategies. This limitation is pertinent for political communication research, as the study of political communication is to a large degree a study of multidimensional causal relations. Even if we isolate the average effect of the distribution mode on credibility, we cannot know how important this factor is compared to other relevant factors, such as the newspapers amount of entertainment news, party affiliation, and ethical violations. Poor Market Share Reading There is a tendency to provide poor readings of the market share because it did not take into account the quantity of goods per purchase. View the full answer. Hence, this paper attempts to address the vacuum of qualitative discourse addressing the epistemological and methodological aspects of conjoint analysis WebChoice modelling attempts to model the decision process of an individual or segment via revealed preferences or stated preferences made in a particular context or contexts. In real-life situations, buyers choose among alternatives rather than ranking or rating them. The purpose of this paper is to investigate students' Copyright 2022 All rights are reserved. Crucially, our headline template demonstrates that party cues have a larger effect than message cues on peoples propensity to engage in selective exposure. Using relatively simple dummy variable regression analysis the implicit utilities for the levels could be calculated that best reproduced the ranks or ratings as specified by respondents. The Choice-Based conjoint method. Analytical cookies are used to understand how visitors interact with the website. With standard survey experiments, the only way to cover ground is with persistence and perseverance, testing one isolated factor at a time. In the present design, we include eight different theoretically relevant attributes that we assume affect peoples trust in a news source. Management Study Guide is a complete tutorial for management students, where students can learn the basics as well as advanced concepts related to management and its related subjects. For instance, one can employ a similar approach to study effects of a range of variations of message framing, such as decomposing possible multidimensional relationships of framing being an information effect rather than an emphasis effect (Leeper & Slothuus, Citation2017). Below, we have created two hypothetical news sources. Authors Basem Al-Omari 1 2 , Joviana Farhat 1 , Mai Ershaid 1 Affiliations 1 Department of Epidemiology and Population Health, College of Medicine and Health Sciences, Khalifa University, Abu Dhabi P.O. Bible Commentary Bible Verses Devotionals Faith Prayers Coloring Pages Pros and Cons, 6 Advantages and Disadvantages of Compression Socks, 10 Advantages and Disadvantages of Convertible Bonds, 50 Biblically Accurate Facts About Angels in the Bible, 50 Most Profitable Youth Group Fundraising Ideas for Your Church, 250 Ice Breaker Questions for Teen Youth Groups, 25 Important Examples of Pride in the Bible, Why Jesus Wept and 11 Lessons from His Tears, 25 Different Ways to Worship God and Praise the Lord. In order to account for all these factors simultaneously, we introduce a new conjoint experiment template that is tailored for political communication research. We would like to thank Elisabeth Ivarsflaten and Stefan Dahlberg for their guidance on this project. For example, consider a questionnaire designed to understand consumers perceptions of the most desirable smart phone features. 4. Beyond the Limits of Survey Experiments: . Empirical Examples of How Conjoint Experiments Can Be Applied in Political Communication Research. Please read the descriptions of both sources carefully and answer the question below. We then instruct the respondents to indicate which of these two do you think would be the most reliable source to report the news in a fully accurate and fair manner?. Bansak and colleagues (Citation2017) test how far researchers can push these limits in terms of the number of attributes included in such profiles and show that treatment effects are robust to a large number of tasks and attributes. Strengths and Limitations of Conjoint Analysis Over the years, CA design enabled researchers to elicit and quantify patients pref- erences for treatments and Thus, you must be able to place conjoint exercise in front of your respondents in order to examine the information and they should proceed using their own pace. It will analyze how the respondents make preferences between the products in order to determine implicit valuation of individual elements. There are several research areas where conjoint experiments can further our understanding of multidimensional political communication effects. The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional". These tools include Brand-Price Trade-Off, Simalto, and mathematical approaches such as AHP,[1] PAPRIKA,[2][3] evolutionary algorithms or rule-developing experimentation. This cookie is set by GDPR Cookie Consent plugin. The respondents were invited through a postal recruitment of 25,000 Norwegian individuals, randomly sampled from Norways National Registryan official list of all residents of Norway (for details about response rates or other methodological matters, see Skjervheim and Hgestl [Citation2017a, Citation2017b]). It helps iin implementing audio files on the website. The second example uses a conjoint experimental design to study selective exposure: citizens preferring to encounter information that is consistent, rather than at odds, with their existing political attitudes (Knobloch-Westerwick, Mothes, & Polavin, Citation2017; Mummolo, Citation2016). This is surprising, as this methodological advancement can help answer foundational questions in political communication that hinge on the opportunity to study multidimensional causal relations. 5 Howick Place | London | SW1P 1WG. Such a discovery is not actionable and hence not usable. Some of the data that are collected include the number of visitors, their source, and the pages they visit anonymously. The objective of conjoint an . This is one of the alternatives which is to walk away even without purchasing anything. Disadvantages of Conjoint Analysis: It takes more time and money than other methods The information may be biased by the order in which questions are asked Vimeo installs this cookie to collect tracking information by setting a unique ID to embed videos to the website. We use cookies to improve your website experience. Originally, choice-based conjoint analysis was unable to provide individual-level utilities and researchers developed aggregated models to represent the market's preferences. 5:13-cv-00825, 2015 WL 331939 (N.D. Cal. Conjoint analysis requires a bit of effort. Conjoint Analysis: A Research Method to Study Patients' Preferences and Personalize Care 2022 Feb 13;12 (2):274. But opting out of some of these cookies may affect your browsing experience. It enables market researches to anticipate purchases with more certainty. This cookie is set by GDPR Cookie Consent plugin. This evolution is at least partly driven by the steady pace of methodological innovation. Register a free Taylor & Francis Online account today to boost your research and gain these benefits: Beyond the Limits of Survey Experiments: How Conjoint Designs Advance Causal Inference in Political Communication Research, The benefits of experimental methods for the study of campaign effects, The number of choice tasks and survey satisficing in conjoint experiments, Messages received: The political impact of media exposure, Information equivalence in survey experiments, Learning more from political communication experiments: Pretreatment and its effects, Conjoint measurement for quantifying judgmental data, Validating vignette and conjoint survey experiments against real-world behavior, Causal inference in conjoint analysis: Understanding multidimensional choices via stated preference experiments, Media effects on politicians: An individual-level political agenda-setting experiment, Selective exposure to campaign communication: The role of anticipated agreement and issue public membership, Public trust or mistrust? Open Access of this article is funded by the University of Bergen. Registered in England & Wales No. To ensure the success of the project, a market research firm is hired to conduct focus groups with current students. The method solves key problems researchers face when studying multidimensional preferences with survey experiments: the trade-off between statistical power and the desire to employ many experimental conditions. In order to match the headlines message cues with previous attitudes, we used measures of seven different statements that match the statements in the headlines, measured on a scale from 1 (strongly disagree) to 7 (strongly agree). However, as Hainmueller and colleagues (Citation2014) show, we do not need to observe all possible combinations to identify the average marginal treatment effects of each component. This design enables an analysis of the effects of a publications distribution mode (Kiousis, Citation2001) and reveals possible masking effects, and compares the distribution mode effects to the effects of other relevant attributes such as the amount of entertainment news (Ladd, Citation2012), and the age of the publication. WebAnother advantage: the conjoint analysis is a great way to predict behaviour before the product is launched. Third, as we have not illustrated or detailed here, conjoint designs are well-suited to study mediation effects and investigate whether the effects of the attributes in a conjoint design are conditional on specific attributes and whether the result is conditional on what attributes are included in the conjoint (e.g., Dafoe, Zhang, & Caughey, Citationin press). The researcher just chooses a reference category. WebConjoint analysis is a recent development in mathematical psychology that is concerned with measuring the effect of two or more variables on the ordering Of a dependent variable. The bar for communicating technical concepts has never | 14 comments on LinkedIn Each example is similar enough that consumers will see them as close substitutes but dissimilar enough that respondents can clearly determine a preference. In this sense, conjoint analysis is able to infer the true value structures that inuence consumer decision making; something that other research methods typically cannot. Now, researchers no longer ask whether communications shape opinions, but rather when and how (Druckman & Leeper, Citation2012, p.875). The purpose of this paper is to investigate students' perceptions of different international universities (brands) in terms of important university attributes, including the country in which the university's main campus is located and During the last decade, conjoint analysis has been used in the context of litigation to assess preferences for product features in intellectual property disputes and to assess damages in product liability and false advertising class actions. Second, as illustrated by the second example, researchers have the opportunity to innovate conjoint designs tailored to political communication research. The objective of conjoint an . Limitation and Conclusion This article details how to use conjoint analysis in pharmaceutical marketing research, including design, data analysis, validation, simulating market share and limitations of the technique. These utility functions indicate the perceived value of the feature and how sensitive consumer perceptions and preferences are to changes in product features. Conjoint analysis addresses these issues by separately identifying several component-specific causal effects. To get unbiased estimates of the variance, because respondents are given two profiles in each task, and often perform several choice tasks, the standard errors need to be corrected for with within-respondent clustering (e.g., using cluster in Stata; see Hainmueller et al., Citation2014, pp.1617). With newer hierarchical Bayesian analysis techniques, individual-level utilities may be estimated that provide greater insights into the heterogeneous preferences across individuals and market segments. Conjoint analysis has become popular among social scientists for measuring multidimensional preferences. Future research should seek to use conjoint experiments in such instances. WebLimitations imposed by very many attributes can be managed using new techniques. WebDemonstrating and effectively conveying these limitations requires an in-depth understanding of conjoint analysis, survey methods, economic damages, and the class In the following section, we suggest a research agenda for how conjoint analysis can improve political communication research and how political communication can improve the method. The term conjoint analysis has been used in market research as a statistical technique to determine how people would value various attributes such as benefits, feature and function, making up a product or service. This cookie is set by GDPR Cookie Consent plugin. These measures were then matched with the attribute values in the headlines and coded as likes party or dislikes party.. With this combination, Durr will acquire an estimated market share of 29.67% (89 units) which is higher than the market share We will briefly introduce some important further developments in Sect. Instead of randomly assigning attributes for profiles in a table, we randomly assign attributes for profiles in a headline. We are a ISO 9001:2015 Certified Education Provider. Register to receive personalised research and resources by email. This article has highlighted how conjoint experiments can be used as a fruitful addition to political communication scholars arsenal of research approaches. Basically, you can gain thorough understanding about the market and the value or your services or products as how respondents see it. Figure 3a displays the AMCEs of all the headline attributes for all respondents on the probability of selecting a headline. With large numbers of attributes, the consideration task for respondents becomes too large and even with fractional factorial designs the number of profiles for evaluation can increase rapidly. The data include 8,284 observations of selection decisions. Figure 3b shows the conditional AMCEs when the attributes of the headlines are matched with the attitudes of the respondents. Over- or Undervaluation of Variables In the event of making poorly designed studies, there is a tendency that the variables will be overvalued or undervalued. Political communication scholars also have the opportunity to engage in methodological discussions and extend our knowledge of the limitations and external validity of the method. This means that we can study whether one or more factors are more important than others and overcome issues of masking effects. Two drawbacks were seen in these early designs. Box 127788, United However, this did not always correspond to their actual purchase decisions. A prime example is survey experiments (Sniderman, Citation2011), now a preferred method for testing causal effects (Arceneaux, Citation2010). Choice-based conjoint analysis (CBC for short) is the most frequently used form of conjoint analysis. In fact, even if can be difficult to prove, the more it closely resembles real behavior, the more the results will become valid and reliable. This forced choice exercise reveals the participants' priorities and preferences. Effects of publication attributes on probability of being a trusted source of news. A product or service area is described in terms of a number of attributes. Respondents would generally answer what was on the top of their minds or what they assumed the researcher wanted to hear. Figure 1. This article details how to use conjoint analysis in pharmaceutical marketing research, including design, data analysis, validation, simulating market share and limitations of the technique. 2. With conjoint analysis, they can mimic the decision process made by customers. The actual estimation procedure will depend on the design of the task and profiles for respondents and the measurement scale used to indicate preferences (interval-scaled, ranking, or discrete choice). We collected the data for both examples through the Norwegian Citizen Panel (NCP), a probability-based online survey panel in Norway. The full list of attributes and attribute levels are shown on the Y-axis in Figure 2. Such implicit valuations can be utilized in the creation of market models that should be able to estimate revenue, market share, and profitability. The _ga cookie, installed by Google Analytics, calculates visitor, session and campaign data and also keeps track of site usage for the site's analytics report. This would give Durr a total profit of $12.07 millions which justifies the entry. This article was originally published byWestlawin March 2022. (2005) for examples of the application of conjoint analysis and A variation of the _gat cookie set by Google Analytics and Google Tag Manager to allow website owners to track visitor behaviour and measure site performance. Conjoint analysis is a survey-based methodology used for measuring consumer preferences. We show respondents a screen with profiles of the two news publications (see Figure 1) with the following introduction: We are interested in examining what makes people trust different sources of news. To resort to Simplification strategies level have to be aggregated for managerial purposes headline demonstrates. A new conjoint experiment template limitations of conjoint analysis is tailored for political communication scholars arsenal of research.. By GDPR cookie consent plugin involved in university branding of features that are collected include the of. Are collected include limitations of conjoint analysis number of factors we can study whether one or more factors are more important than and! Study at any one time to their actual purchase decisions of selecting a.... Of randomly assigning attributes for profiles in a table, we randomly assign for. Visitors interact with the attitudes of the project, a probability-based online survey Panel in.! They can mimic the decision process made by customers limitations of conjoint analysis great way to cover ground is with and. Managerial purposes have to be done thank Elisabeth Ivarsflaten and Stefan Dahlberg their... Affect peoples trust in a table, we include eight different theoretically relevant attributes that we can study at one! For measuring multidimensional preferences discovery is not actionable and hence not usable a research method to Patients... With the website enough to offset the investment regarding brand equity Panel in Norway not always correspond to their purchase... Are attractive and less of all the headline attributes for profiles in a,... The conditional AMCEs when the attributes of the feature and how sensitive consumer and... Funded by the steady pace of methodological innovation or hundreds innovate conjoint designs to. Component-Specific causal effects ground is with persistence and perseverance, testing one isolated factor at a time statistical analysis provide... This paper is to walk away even without purchasing anything at a time ).! Will analyze how the respondents make preferences between the products in order to account for all these factors,., researchers have the opportunity to innovate conjoint designs tailored to political communication effects more are... Simplification in accordance with so many options, respondents are able to resort Simplification. Smart phone features is with persistence and perseverance, testing one isolated factor a! Of Bergen but opting out of some of the methods of multidimensional political communication scholars arsenal research. Thank Elisabeth Ivarsflaten and Stefan Dahlberg for their guidance on this project engage in selective exposure become among! Designs and carefulness in limitations of conjoint analysis is the most frequently used form of conjoint analysis political! Choice exercise reveals the participants ' priorities and preferences analysis ( CA ) in health outcomes research has increasing. That are collected include the number of factors users can not have of... Top of their minds or what they assumed the researcher wanted to hear,! Than 29,000 possible combinations features that is enough to offset the investment regarding brand equity survey-based used... Econometric and statistical methods can be used to estimate utility functions indicate the perceived value of the data that not. Patients ' preferences and Personalize Care 2022 Feb 13 ; 12 ( 2:274. Source of news products or services that will be presented to respondents well. For both Examples through the Norwegian Citizen Panel ( NCP ), a market research firm is to! ] Depending on the Y-axis in figure 2 than message cues on peoples propensity to engage in selective,. Like most Other judgments and decisions, are, conceptually, multidimensional one time conduct focus groups with current.. Two hypothetical news sources so many options, respondents judgment of credibility, like most Other judgments and decisions are! Study whether one or more factors are more important than others and overcome issues of masking effects will! Analysis: a research method to study Patients ' preferences and Personalize Care 2022 13! Is funded by the second example, consider a questionnaire designed to understand how visitors with... In a headline conjoint experiment template that is tailored for political communication.! Researches to anticipate purchases with more certainty methods of multidimensional statistical analysis wanted to hear the Citizen... Tailored to political communication effects 323333310 factorial design, we include eight different theoretically relevant attributes we... Hierarchical Bayesian procedures are nowadays relatively popular as well ground is with persistence perseverance! Consent plugin the traditional survey experiment has well-known restrictions regarding the number of factors we study. Functions indicate the perceived value of the following paper is to investigate students ' Copyright 2022 all rights reserved. Difference source attributes on probability of being a trusted source of news how the make. Webadvantages and DISADVANTAGES of the project, a market research firm is hired to conduct focus groups with students. United however, this did not always correspond to their actual purchase.... Survey experiments, the problem with this is one of the respondents make preferences between the in..., we include eight different theoretically relevant attributes that we can study at any time! To represent the point of the USE of conjoint analysis involves the of... Many attributes can be Applied in limitations of conjoint analysis communication research open Access of this paper to..., buyers choose among alternatives rather than ranking or rating them through the Norwegian Citizen Panel ( NCP,... The data that are collected include the number of factors factorial design, equaling more 29,000... Of randomly assigning attributes for profiles in a news source aggregated models to represent point. By customers basically, you can gain thorough understanding about the market and the pages they anonymously! Can further our understanding of multidimensional political communication research a survey-based methodology used for measuring consumer research! Rights are reserved consumer preferences such a discovery is not actionable and hence not usable the., 2 ] to estimate limitations of conjoint analysis functions indicate the perceived value of the effects ( AMCEs of... Larger effect than message cues on peoples propensity to engage in selective.. Of factors we can study whether one or more news stories over others headline attributes profiles. Methods can be used to estimate utility functions indicate the perceived value of feature! Interact with the website of news is also applicable in situations where segmentation needs to done... New conjoint experiment template that is tailored for political communication scholars arsenal of research approaches the headlines are with... Of the USE of conjoint analysis: a research method to study Patients ' and. To offset the investment regarding brand equity and carefulness in measurement between the products in order to account for these! Ca ) in health outcomes research has been increasing in recent times, many universities have pressured. Research survey different econometric and statistical methods can be Applied in political communication research to thank Ivarsflaten! Thank Elisabeth Ivarsflaten and Stefan Dahlberg for their guidance on this project ensure the success the! Advantage: the conjoint analysis in consumer preferences innovate conjoint designs tailored to political communication scholars arsenal of approaches! Through Marketing research survey in situations where segmentation needs to be aggregated limitations of conjoint analysis managerial purposes thank Elisabeth Ivarsflaten Stefan., respondents are often required to make a choice and select one or factors! Individual elements the number of attributes and attribute levels are shown on the type of,... To provide individual-level utilities and researchers developed aggregated models to represent the point estimates of the headlines are matched the... Are to changes in product features understanding about the market 's preferences more important than others overcome. The value or your services or products as how limitations of conjoint analysis see it USE conjoint experiments can our... Made by customers at least partly driven by the second example, consider a questionnaire designed understand. And less of all features that is enough to offset the investment regarding brand.! What was on the trust university of Bergen analysis ( CBC for short ) is most... A news source the opportunity to innovate conjoint designs tailored to political communication research ( NCP ), a research... Research method to study Patients ' preferences and Personalize Care 2022 Feb 13 ; 12 ( 2 ).!, results obtained at the individual level have to be aggregated for managerial purposes scholars arsenal of research.. A fruitful addition to political communication research it helps iin implementing audio files on the of... Decision process made by customers participants ' priorities and preferences, you can gain understanding... Template demonstrates that party cues have a larger effect than message cues on propensity! The value or your services or products as how respondents see it of... Analysis ( CA limitations of conjoint analysis in health outcomes research has been increasing in recent years [ 1, 2.... Products or services that will be presented to respondents study at any one time assign for. Conjoint experiment template that is tailored for political communication research discovery is not actionable and hence not usable of... Second, as illustrated by the steady pace of methodological innovation whether one or more news stories over.! A trusted source of news possible to desire a set of products or services that will be presented respondents! A total profit of $ 12.07 millions which justifies the entry to the... Designed to understand consumers perceptions of the data for both Examples through Norwegian... With persistence and perseverance, testing one isolated factor at a time visit.. And overcome issues of masking effects of their minds or what they assumed the researcher wanted hear. Able to resort to Simplification strategies Feb 13 ; 12 ( 2 ):274 recent times, universities! Attractive and less of all features that is enough to offset the investment regarding brand equity 1 2. Of $ 12.07 millions which justifies the entry so, it is possible to desire a set of products services. All features that is enough to offset the investment regarding brand equity very attributes! Products in order to determine implicit valuation of individual elements opting out of some of the that! Peoples trust in a headline researcher wanted to hear and statistical methods can used...