This summary is written in 2013-2014. 1.1 Introduction 1.2 What is research?
In order to systematically conduct research based on logical relationships, a researcher must provide an explanation of the methods used to collect data, prove why the results are meaningful and outline any limitations to the research. The goal of research is not only to explain, describe, criticize, understand or analyse something, but also to simply find a clear answer to a specific problem. 1.3 The nature of business and management research
Research that only emphasises Mode 1 ways of creating knowledge which only focuses on understanding business and management processes and their outcomes is called basic, fundamental or pure research. Another type of research is called applied research where the emphasis is more on Mode 2. In this case research is only being conducted direct relevance to managers and is presented in ways these managers can understand and act upon. Pure and applied research are two extremes, in order to successfully conduct business and management research there has to be a balance between the theoretical (Mode 1) and practical (Mode 2) part of research. The characteristics of pure/basic and applied science are summarised in figure 1.1 on page 11. 1.4 The research process 2.2 Characteristics of a good research topic 2.3 Generating and refining research ideas
…and those that are more based on creative thinking:
Most often it is a combinations of these two ways of thinking that leads to a good research idea. Refining Ideas Integrating Ideas 2.4 The transformation from research idea to research project
Do not make the research question too simple or too difficult to answer. The ‘Goldilocks test’ may be helpful to determine if a question is too big (when it demands too many resources), too small (provides insufficient data), too hot (when it is a sensitive subject) or ‘just right’. It is also essential for a research question to provide new insights. Writing research objectives What is theory and why is it important?Theory is concerned with causality. This means that it regards the cause and effect relationship between two or more variables. For example, theory explains why and how a promotion influences employee’s behaviour. Logical reasoning is essential here to explain in a clear way why this is the case. The role of theory is to explain the relationship between variables and to make predictions about possible new outcomes. Advising on how to take research in a certain way (Variable 1) is based on the theory that this will eventually create effective results (Yield B). By undertaking research it is possible to collect data with which new theories could be developed. A research project is designed to either test a theory or to develop a theory. When someone is taking a clear theoretical standpoint and wishes to test this through the collection of data one is using a deductive approach. An inductive approach is used when someone builds a theory from the collected and analysed data. There exist three kinds of theories:
2.5 Writing a research outline
Structure of a research proposal
3.1 What is a literature review? 3.2 Critical review The goal of a critical review
When a critical review is successful it will provide new insights about a subject area that no one has ever thought about. It is necessary to show how the new findings and developed theories relate to other literature about your subject to demonstrate that you are familiar with what has already been said about the subject. Adopting a critical view of your reading Previewing: Browsing the text to find out what its purposeAnnotating: Conducting an analogue with yourself, the author and the issues at stakeSummarising: Be able to explain/state the text in your own wordsComparing and contrasting: How has your thinking been altered by this reading? Use review questions: Questions which you ask yourself during reading which are linked to your research questions. Content of a critical review
How to be ‘critical’ The structure of the critical literature review
Every project report should refer to the key issues from the literature in the discussion and conclusions. Don’t let the review become an uncritical listing of previous research! It is easy to be critical when constantly tries to compare or contrast different authors and their ideas. The review should be a funnel in which you:
3.3 Available literature sources Primary literature First occurrence of a piece of work. Includes public sources as reports and documents, but also unpublished work such as letters and memo’s. Secondary literature Is aimed at a wider audience, easier to locate and better covered by tertiary literature. This includes books, journals and newspapers. Tertiary literature Also called search tools, to locate primary and secondary literature. They include online search tools, databases, and dictionaries. Especially journals are a essential literature source for virtually any research, since they provide a researcher with information which focussed on his subject area. Nowadays it is easy to access journals via online databases. Refereed academic journals only publish articles which are evaluated by academics before their publication. These articles are therefore characterised by their quality and suitability. Professional journals are made for their members by various organisations. Their articles are usually more of practical nature than those of refereed academic journals. 3.4 Planning a literature search strategy
Defining parametersOne way to start searching for parameters is to browse lecture notes and course textbooks and make notes for research question. Generating search terms It is important to read articles from key authors as well as recent review articles in the area of research. This will help generating key words. Recent review articles are sometimes also helpful to refine search terms, plus they will sometime refer to other work which may be relevant to your project. The identification of search terms is an essential part of planning a search for relevant literature. The definition of search terms is: basic terms that describe research questions and objectives and shall be used to search the tertiary literature. Different techniques for generating search terms are:
3.5 Conducting literature search While most it is very tempting to start a literature search with using a search engine such as Google, this must be handled with care, as the research project should be an academic piece of work and hence must utilise academic sources. Search should therefore be used to provide access to academic literature. Conducting literature search can be done by:
3.6 Obtaining and evaluating the literature 3.7 Recording literature It is important to make notes of the literature one has read, because it will help thinking though the ideas in the literature in relation to the research. When making notes there are three sets of information one needs to record:
4.1 Why is philosophy importantThe way one chooses to collect data belongs in the centre of the research ‘onion’, as displayed below. The research onion depicts the aspects underlying the choice of data collection techniques. 4.2 Why research philosophy is importantResearch philosophy is a term that describes the development of knowledge and the nature of that knowledge. Understanding research philosophy is important because the very purpose of research is also to develop new knowledge. It is not true that one philosophy is better than another, but they might be suited to achieve different things. Two major ways of thinking in philosophy are: ontology and epistemology (See table 4.1 on page 129). A pragmatist is someone who thinks that concepts are only relevant where they support action. He believes that one philosophical position could be more likely lead to the answer to his research question than another. In addition, a pragmatist also believes that it is possible to work with multiple philosophical positions. According to a pragmatist there is not one way of thinking. OntologyOntology is a philosophical position that refers to the nature of reality. One aspect of ontology is objectivism. This means that things exist with a purpose independent of those social actors concerned with their existence. Another aspect is subjectivism, which holds that social occurrences are created through the perceptions and consequent actions of the involved social actors. People who adopt a subjectivist way of thinking find it is necessary to explore the details of a situation to be able to understand what is going on. This is termed social constructionism. Objectivists think that the culture of an organisation is something that an organisation ‘has’ while subjectivist tend to view the culture as something an organisation ‘is’. Management theory is leaning towards the objectivist way of thinking. Epistemology Positivism
Realism
There is a difference between these two kinds of realism regarding the capacity of research to change the world. A direct realist would state that the world is relatively unchangeable whereas a critical realist would claim that the researcher’s understanding to that which is being studied could be changed. Many researchers claim that what we explore is just part of the bigger picture. Thus researchers usually adopt a critical realism point of view. Interpretivism
It is important for a researcher to understand the world of his research subjects and to understand the world from their point of view. AxiologyAxiology is a strand of philosophy that studies judgments about value. This includes values in the fields of ethics and aesthetics. One’s own values play a crucial role in all stages of the research process. Our values are the guiding line for all our actions (Heron 1996). Research Paradigms The term paradigm is frequently used in the social sciences, but it often leads to confusion because of its many meanings. Here we define paradigm as a way of examining social occurrences from which particular understandings of these phenomena can be gained and explanations attempted. In Figure 4.2 on page 141 there is an image of how the four paradigms can be arranged:
4.3 Research approaches
There exist four general characterizations for deduction
InductionWith inductive reasoning it is not true that when a set of premises are true that a clear conclusion can be formed. This is because the conclusion is based on observations made by humans, and humans make mistakes. A conclusion is therefore never guaranteed. Abduction A third approach, called abduction, starts with a conclusion: a surprise fact. With a set of premises one subsequently tries to prove the conclusion. An abductive approach does not move from theory to data (deduction) or from data to theory (induction), but rather moves back and forth between the two, combining deduction and induction. 5.1 Introduction 5.2 Choosing a research design
5.3 The research strategy : qualitative, quantattive or multiple methods
Qualitative research design
Multiple methods research design
Figure 5.2 on page 165 shows an image of the different methodolocial choices one could make:
5.4 Recognising the nature of a research design There exist three research designs one could adopt when conducting research:
2. Descriptive study 3. Explanatory study When performing this kind of study one wishes to determine causal relationships between certain variables. 5.5 Research strategies Generally, a strategy is a plan of approach to achieve a certain goal. A research strategy could therefore be defined as the various steps a researcher has to take to answer his research question. The choice of a research question should be guided by one’s research question(s) and objective(s), the cohesiveness with which these link to the research philosophy, research approach and purpose, and to more pragmatic concerns such as the extent to existing knowledge and access to participants and other sources of data. The following strategies will be discussed in this chapter (along with the research design that is linked to them):
Experiment
When performing an experiment, the null hypothesis is tested statistically. The null hypothesis will be accepted when the probability that there is no statistical difference is greater than a prescribed value (most of the times 0.05). In this case the alternative hypothesis will be rejected. There are various experimental designs:
Internal validity is the extent to which the findings of the experiment can be attributed to the interventions instead of any flaws in the research design (such is the case with a laboratory experiment. External validity is a lot more difficult to establish (when conducting field-based research). Survey Archival research An archival research strategy uses administrative records and documents as the main source of data. Not only historical but also recent data documents could be collected and analysed when adopting this strategy. With use of an archival research strategy (research) questions with focus upon the past could be answered. These questions may be exploratory, descriptive or explanatory. Case study A case study allows one to explore a research topic or phenomenon , within its context or within real-life contexts. With a case study there is no clear boundary between that which is being studied (the phenomenon or topic) and the context within which it is being studied (the real-life ‘case’). This approach is useful when one wishes to gain a better understanding of the research and a certain phenomenon , especially when one wishes to explore existing theory. Below are some characteristics of case studies:
Ethnography This approach is used to study particular groups of people. When conducting ethnographic research one wishes to explore and analyse people in groups who share the same space (this could be the same street, work group, organisation or even society) and who interact with each other. Cunliffe distinguishes three ethnographic strategies:
Action Research This type of research strategy designed to develop answers to real organisational problems by using a participative and collaborative approach which uses various forms of knowledge. Action research will influence the participants and the organisation beyond the research project. As Greenwood and Levin said: action research is a social process in which a researcher works with members of an organisation to enhance their situation and their organisation. This type of research has 5 themes:
Grounded theory Grounded theory is a theory developed from a set of data (using an inductive approach). It was developed as a way to analyse, interpret and explain the meanings that social actors construct to make sense of their daily experiences in particular situations. There are three stages:
During all these stages of coding the researcher is constantly comparing each item of data with others. Constantly coding involves moving between inductive (data to theory) and deductive (theory to data) thinking: while discovering relationships between codes and interpreting them the researcher is thinking inductively (he develops his own theory from the relationships between codes). This interpretation needs to be tested by collecting data from other cases, which means that the researcher is thinking deductively because he tests his ‘theory’(interpretation) with other data. This is known as the process of abduction. With the Grounded Theory strategy, sampling is not meant to achieve representativeness but rather to focus the research on a core theme, relationship or process. This approach is known as theoretical sampling which ends when theoretical saturation/conceptual destiny is reached. This happens when the data collection does not continue to reveal any new properties relevant to a category, where categories have become well developed and understood and relationships between categories have been verified (Straus and Corbin 2008). Narrative inquiry The term narrative means story or a personal account which interprets an event or sequence of events (Saunders 2012). Narrative inquiry refers to a research strategy where a researcher believes that the experiences of his participants can best be accessed by collecting and analysing these as stories. Narrative inquiry preserves any chronological connection and sequence of events as told by the participant. In this way the reader may find it more easy to understand the report and the researcher is able to provide his interpretation of the events. 5.6 A Time Horizon Longitudinal studies Is the research reported more like a ‘diary’ which represents the events over a specific period than it’s called longitudinal. The advantage of this time horizon is that it’s able to study change and development. 5.7 The ethics of Research 5.8 Quality of Research
Alternative criteria to asses quality of research 5.9 The role of the researcher Full-time students usually adopt the role of an external researcher. This is someone who needs to identify an organisation within which he conducts his research. The researcher is external to the organisation therefore he has to negotiate with its members to be able to access the organisation and to collect its data. An internal/practitioner researcher is one who works in an organisation. The advantage of this is that the researcher has easy access to the organisation. Plus, he is also likely to have knowledge of the organisation and therefore understands the complexity of what is happening in that organisation. This may also be a disadvantage since the external researcher’s assumptions and preconceptions may be different from reality. Before conducting research, a researcher need to be sure he will have access to the data he needs and he has to think carefully about the possible ethical difficulties he might face. Because business and management research will inevitably make use of human participants ethical concerns will almost always rise. 6.2 Gaining access
The levels of access may vary because the depend on the nature and depth of the access one wishes to achieve: physical, continuing and cognitive access. Physical access may be difficult because it not all organisations are prepared to engage in activities which are not necessary for them, since time and effort is required. Sometimes the gatekeeper (the person who keeps data and decides who may have access to it) does not allow people to undertake the research (because the organisation does not receive value from it or the topic is to sensitive). Many people see access to data as a continuing process and not just one single event. One of the two reasons for this is that access may be an iterative (herhalend) and incremental (stapsgewijs oplopend) process. After gaining access to one particular set of data one might seek further to achieve other data in order to conduct another part of the research. Another reason why access is a continuing process is because those people from whom one needs to collect data may be different to those who agreed to your request for access (gatekeepers). Physical access to data from of an organisation will be granted in a formal manner, though an organisations management. Therefore it is useful to gain trust from the organisational members. This type of access is named cognitive access. Negotiating access Negotiating access is likely to be an important if one wishes to gain personal entry to an organisation and to be able to have cognitive access to allow one to connect the necessary data. Therefore it is important to consider the project’s feasibility (determine whether it is practicable to negotiate access for a research project) and sufficiency (whether one is able to gain sufficient access to fulfil the research objectives). Issues of being an external researcherResearchers need to negotiate access at each level: physical, continuing and cognitive. Because an external researcher lacks status in an organisation or group in which he wishes to conduct research he will face difficulties at every level of access. Therefore external researchers rely on the goodwill of the organisational members. To be able to gain goodwill from members a researcher needs to be able to communicate his competence and integrity and explain the importance of his research project clearly and precisely. Issues of being an internal/participant researcher Even though an internal or participant researcher is familiar with the organisation and vice versa, he is still likely to face problems of access to data. The status of an internal/participant researcher who wishes to gain cognitive access could cause suspicions. This is because other organisational members may not know what the internal/participant researcher will do with the data. Here it is also important for the researcher to be able to communicate the purpose of his research. Familiarity with the group and sufficient timeBefore trying to obtain physical access it is very important for a researcher to familiarise himself with the organisation or group. It may take a lot of time (weeks or even months) before physical access could be gained (if access is even granted at all). This is the reason why a researcher needs to plan sufficient time for the data access part of a research project. One also needs to consider the time needed for a participant to respond to the request of participating in a research. Using existing contacts and/or developing new ones When a researcher is able to use existing contacts it is easier to gain access. Because these contacts have knowledge of the researcher means that they can trust him and his intentions and are therefore likely to gain access to the data.Providing clear account of requirements for participators Researchers need to be aware that they provide a clear report of their requirements to allow their participants to know what will be asked of them. Without clear requirements, participants may act cautious since the required amount of time they have to put in their participation may seem to be disruptive. This is why an introductory letter to the participants will have to provide them with an outline and goal of the research and what the participants will have to do.Overcoming organisational concerns Organisations may be concerned about:
Possible benefits to organisation granting access and using suitable language Facilitating replies, developing access, and establishing credibility 6.5 Research ethics Ethics refer to the standards of behaviour that guide your conduct in relation to the rights of those who become subject of your work, or are affected by it and usually accompanied by social norms(Saunders 2012). A social norm is an indicator of the type of behaviour an individual should adopt in a specific situation. Two conflicting philosophical positions have been identified with regard to ethics:
‘Codes of ethics’ were developed to overcome ethical dilemmas arising from various social norms. Codes of ethics are a list of principles which outlines the nature of ethical research and a statement of ethical standards. Ethical issues associated with internet-mediated research
The term netiquette refers to ‘net etiquette’, or in other words the social standards which one should use online. Netiquette concerns the use of emails and messaging since they may be poorly worded and may seem unfriendly or unclear to the receiver. 6.6 Ethical issues during the specific stages of the research processFigure 6.1 on page 236 sums up the different ethical issues that could rise at specific stages of the research process. Most ethical issues can be predetermined and dealt with during the design stage of a research process. One should be sure that the intended research is in line with the ethical principle of not causing any harm to participants. When seeking access a researcher should not put any pressure on the members of an organisation, since this might be unpleasant to them. When approval for access is given, one should ensure the participants that personal data will be handled anonymously and confidentially. There is of continuum for the range of approval that could be given.
Moreover, the participants need to be fully aware of the information that is asked from them. A researcher needs to inform them of this formally with the use of a participant information sheet. It has to include the requirements and implications of participating, the nature of research, how the data will be analysed, reported and stored and who to contact when any concerns rise. A more detailed written agreement could be established as a consent form, which both parties should sign. Consent forms help clarifying boundaries of consent. When using observational techniques one should avoid attempting to observe behaviour related to personal life (phone calls and etc.), because this will cause the relationship between researcher and participant to break down. Moreover, the issue of reactivity may raise here as well. Reactivity refers to the reaction of the participants to the researcher and their research instruments. The solution of this problem may be to undertake a covert study so that the participant are not aware of the fact that they are being observed. But the problem of reactivity may diminish when participants are becoming more and more accustomed to the researcher’s presence. This adaptation is referred to as habituation. After observation has taken place a researcher has to inform the participants about what has occurred and for what reason. This is called debriefing. Ethical issues during the analysis and reporting stages 6.8 Principles of data protection and data management
A further category of personal data, known as sensitive personal data, covers information about a participant’s racial or ethnic origin, political opinions, religious beliefs, physical/mental health, sexual life or any proceedings or sentence related to an alleged offence. 7.1 SamplingWhen conducting scientific research one should always consider the use of sampling. If it’s possible to obtain and analyse data from every possible case or group member it’s termed a ‘census’. However, this may not always be the case because one might face some restrictions: time, money and access. This is the reason why sampling is often used. A sample should always represent the full set of cases in a way that is meaningful and which we can justify (Becker 1998). The full set of cases from which the population is taken is called the population. The population does not necessarily signify people, it could also point to Chinese restaurants or electric cars in a specific region for example. There are a number of reasons why sampling is a better option than a census:
Researchers such as Barnett argue that using a sample leads to higher overall accuracy than a census. This is because the researcher focusses on a smaller number of cases to collect data from and therefore has more time to design and pilot the data collection methods. Moreover, data collected from fewer cases means that the information is more detailed. Sampling techniques
7.2 Probability sampling
The ‘sampling frame’ for a probability sample is a complete list of all the cases in the population from which the sample is drawn. It is not possible to select a probability sample without a sampling frame. When no suitable list exists and you still want to use a probability sampling technique, you will have to compose your own sampling frame and ensure that it’s valid. The way in which a researcher defines his sampling frame also raises implications to the extent to which he can generalise form his sample. If a sampling frame is a list of all customers of an organisation one can only generalise to that population. Thus, you should not generalise beyond your sampling frame. This is a mistake many researchers make; they don’t place clear limits on the generalizability of their findings. Suitable sample size
In order to ensure that faked results cannot be present, the analysed data must be normally distributed. The larger the absolute size of a certain sample, the closer its distribution will be to the normal distribution. This relationship is known as the ‘central limit theorem’ and it also occurs if the population from which the sample is drawn isn’t normally distributed. It is proven that any sample size larger than 30 will usually result in a sampling distribution for the mean that is very close to a normal distribution. This is the reason why Stutely (2003) advises to use sample with a minimum of 30 cases. Response rate
Reasons why people don’t respond may be because they refuse to participate to the research, they are ineligible (they don’t fit the requirements) or they may be unreachable. A research report should always include the response rate of the research. This could be calculated by the following formula: total response rate= total number of responsestotal number in sample-ineligible A more common way of calculating the response rate excludes ineligible respondents who were unreachable. This is the active response rate active response rate= total number of responsestotal number in sample-(ineligible+unreachable) It is important to estimate the likely response rate and increase the sample size accordingly to ensure that you will be able to undertake the analysis at the level of detail required. Once the estimated response rate and the minimum sample size are determined one could calculate the actual sample size with the following formula: na=n ×100re% na = actual sample size requiredn = minimum sample size re% = estimated response rate expressed as percentage One way to estimate the response rate is to analyse the response rates achieved for similar surveys that have already been undertaken and subsequently base the response rates on these. Sampling techniques
See figure 7.3 for a guideline for selecting the appropriate probability sampling technique. Simple random sampling Systematic random sampling sampling fraction= actual sample sizetotal population When the sampling fraction is ¼ one needs to select every fourth case from the sampling frame. Using this technique one needs to be sure that the list does not contain periodic patterns since this may disturb the results. Stratified random samplingThis is a modification of random sampling in which you split the population into two or more relevant and significant strata (lagen) based on one or more attributes. In other words, the sampling frame is divided into various subsets after which a random number is drawn from each of the strata. By dividing the population into a series of relevant strata the sample is more representative because one can ensure that each of the strata are represented proportionally within the sample. To do this a researcher chooses the stratification variable(s) and divides the sampling frame into the discrete strata. Then he numbers each of the cases within each strata with a unique number (starting with 0), after which he selects the sample using either simple random or systematic random sampling. Cluster sampling
This technique leads to a sample that represents the whole population less accurately than stratified random sampling. Multi-stage sampling 7.3 Non-Probability SamplingNon-probability sampling provides alternative techniques for selecting samples. There are no rules for deciding the sample size, but it is important to choose a size that represents the population adequately. Quota sampling Quota sampling is a non-random approach for sampling and is often used for structured interviews. This is a type of stratifies sample in which the selection of cases within strata is totally non-random. To select a quota sample one needs to divide the population into groups, calculate the quota of each group (based on relevant data), give each interviewer an ‘assignment’ (this states the number of cases in each quota from which to collect data) and combine the collected data from the interviews to provide the sample. Purposive sampling/judgemental sampling
Volunteer sampling Haphazard sampling 8.1 Secondary data 8.2 Types of secondary data
8.3 Finding secondary data - Establish the likely availability of secondary data (for example with the use of tertiary data) - Locating the data you require (for example via online databases or journals) 8.4 Good and bad sides of secondary data Another advantage is that secondary data may provide a good comparative and contextual background for a researcher’s findings. Reanalysing these data can result in unforeseen discoveries. Disadvantages 8.5 Evaluating sourcesWhen using secondary data one needs to be sure that the data enables one to answer the research questions and to meet objectives, the benefits of the data are greater than their costs and that it is possible to gain access to the data. To test the suitability of any data set is helpful test the measurement validity. Make sure that the data you use provide you with the information you need to answer the research questions and objectives. To ensure that the data collected is reliable and valid it is useful to have a clear explanation of the techniques that were used to collect the data. Another way to test the suitability of secondary data is to determine to what extent the data covers the population about which you need data. This is to be sure that unwanted data can be excluded and to ensure that sufficient data remain for analyses to be undertaken once those unwanted data have been excluded. When looking for data one needs to be sure that measurement bias is not present. Measurement bias may occur for two reasons:
9.1 Why observations matters
Other research approaches than observation usually focus on two distinct kinds of people that participate to the research: respondents (those who simply complete questionnaires) and participants ( those who take part in most types of qualitative research). These labels do not work with observation, since the researcher is actually participating in the environment of the people he observes. Thus, in observational research those who are being observed are called ‘informants’. 9.2 Participant observationWhen one conducts research through participant observation one attempts to participate fully in the lives and daily activities of informants and thus becomes a member of their organisation, group or community. This makes it possible for the researcher to share their experience not only by merely observing what is happening but also by feeling it. One of the purposes of participant observation is to discover the delicate nuances of meaning behind the respondent’s comment which are not likely to be found using questionnaires for example. By immersing himself in the research setting the researcher is able to achieve this goal. Participant observation finds some of its roots in symbolic interactionism where an individual derives a sense of identity from interaction and communication with others and through this process constantly adjusts his or her understanding of reality. Participant observation enables the researcher to get to the bottom of the processes by which individuals constantly construct and reconstruct their identities. Types of participant observation
Data analysis and collection
Data collection Robson (2011) argues that the process of data collection always starts with ‘descriptive observation’. This is when the researcher concentrates on observing and describing the physical setting, key informants and their activities, particular events and their sequence and finally the attendant processes and emotions involved. After stage the researcher is able to write a ‘narrative account’ in which he develops a framework of theory that will help him to understand and explain to other what is going on in the research setting. In order to do this it may be helpful to focus on particular events through ‘focused observation’. Data analysis Just like other qualitative data, those collected form participant observation will start to be analysed from the minute one collects them. In other words, data collection and analysis occur simultaneously.Reliability and validity Participant observation has high ‘ecological validity’ since it is concerned with studying informants and their activities in their natural settings. Still, this research method may lead to a number of issues related to reliability and validity: observer error, observer bias, observer effect.Observer error occurs when a researcher’s lack of understand of, or overfamiliarity with, the setting in which he is trying to operate as an observer may lead to unintentional misinterpretations of what is happening. Observer error does not occur intentionally or deliberately. Observer bias occurs when the observer uses his or her own subjective view or disposition to interpret happenings in the setting he or she observes. This may the case when the observer is already a member of the group he wishes to observe ( an employee in an organisation) and therefore fails to interpret the setting objectively. When using covert observation (when the purpose of research is not known to the informants) it is difficult to check with the informants whether your interpretations were valid. Using overt (informants are aware of the purpose of the research) observation enables the researcher to ask the informants to read some of the secondary observation that relate to them. This is referred to as ‘informant verification’. 9.3 Structured observationUnlike with participant observation, structured observation has a high level of predetermined structure. The researcher is concerned with quantifying behaviour. Therefore it is usually used as only a part of data collection because its purpose is to tell the researcher how often things happen rather than providing a reason for why things happen. When using this type of research method the researcher needs to determine whether he will use an ‘off-the-shelf ‘coding schedule (with this method you predetermined recording sheet) or designs his own. Validity and reliability 10.1 Research interviews 10.2 Interviews and their function in research and research strategy
Interviews may be conducted on a one-to-one basis, between a researcher and a participant, but they may also be conducted on a one-to-may basis, between a researcher and a group of people (see figure 10.1 on page 375). 10.3 Semi-structured and in-depth interviews The purpose of the research – when undertaking an exploratory or explanatory research it is likely that one includes in-depth or semi-structured research interviews in his design. Interpretivists are also likely to use these types of interviews since it allows them to let the interviewees explain their responses. The significance of establishing personal contact – sometimes participants wish to reflect on events without needing to write anything down (as with filling out a questionnaire). The nature of questions – the use of semi-structured and in depth interviews is most advantageous when there are a large number of questions to be answered, the questions are either complex or open-ended and where the order and logic of questioning may need be varied. Length of time required and the process’ completeness – some negotiation is always possible and the interview can take place at a time that pleases the interviewee. 10.4 Data quality issues Data qualitative issues with semi-structured and in-depth interviews could be related to reliability, forms of bias, generalizability and validity. The lack of standardisation in these kinds of interview may lead to reliability, because other researchers may not reveal similar information. It is not feasible to try to overcome this issue, since it will always be present. In-depth and semi-structured interviews will always be flexible and because different questions were used with different participants it would be difficult to repeat this. The next data quality issue is bias. There are three types of bias to consider:
The issue of generalizability refers to the extent to which the results of a research are applicable to other settings. This is an issue with semi-structured and in-depth interview based researches because they are often based on sample sized samples. 10.5 Preparing for semi-structured and in-depth interviews
10.6 Conducting in-depth or semi-structured interviews
10.7 Managing logistical and resource issues 10.8 Group interviews and focus groups Group interviews are in-depth or semi-structured interviews conducted with two or more people. When conducting this type interview be aware of the threat of the group effect, where a few interviewee’s may dominate the discussion while others may feel inhibited. Focus groups are group interviews where the topic is defined clearly and precisely. The purpose running the focus group is named the ‘moderator’ or ‘facilitator’, because he needs to keep the group within the boundaries of the topic being discussed and generate interest in the topic and encourage discussion. When using group interviews one should consider the fact that once a sample has been selected, participants should be grouped so as not to inhibit people’s contributions. It is helpful to make groups in which the participants have a similar status and similar work experiences. Also, a researcher should seek to reduce the contributions of people who tend to dominate the discussion. When conducting many group interviews and the fourth or fifth group interview is no longer providing the researcher with new information, he has reached saturation. 10.9 Telephone, Internet-mediated interviews and intranet-mediated interviews However, conducting interviews by telephone may lead to issues of reduced reliability, where participants are less willing to engage themselves in exploratory discussion. Also the interviewer is not allowed to witness the non-verbal behaviour of his interviewee, which may affect the way he interprets the interviewee’s answers. Internet-and intranet-mediated interviews 11.1 Questionnaires
11.2 Overview of questionnaires
Sometimes it might occur that the respondent’s answers reduce your data’s reliability simply because they have insufficient knowledge or experience and may purposefully guess at the answer. This is known as ‘uninformed response’. Respondents to self-completed questionnaires are sometimes likely to discuss their answers with others, and thereby contaminating their response. 11.3 Collecting the dataQuestionnaires offer you only one chance to return collect data, because it is often difficult to identify respondents or to return to them to collect additional information. This is the reason why one needs spend time planning precisely what data one needs to collect. Types of variables There are three types of data variables that can be collected with a questionnaire:
To be sure that the data collected will lead to answers on to the research questions and achievement of the objectives it could be helpful to create a data requirements table (see table 11.2 on page 425). Investigative questions are those that need to be answered in order to successfully address to each research question and to meet each objective. 11.4 Designing questionnaires Reliability testing
Designing questionsTo design individual questions for a questionnaire, researcher could adopt or adapt questions used in other questionnaires or they could develop their own questions. The first two options are helpful when the researcher wishes to compare his findings with another study. This method ensures the reliability of the questions since they have already been tested. Just like in other types of surveys, questionnaires may use open, closed or forced-choice questions (when the respondent has to choose from a given set of answers). Other kinds of questions are
Translating questions into other languages Explaining the goal of the questionnaireIn a covering letter or email the researcher can explain the purpose of the survey to the respondent. This is important, because the messages contained particularly in self-completed questionnaire’s covering letter will affect the response rate. At the beginning of the questionnaire the researcher needs to explain clearly and concisely why he wants the respondent to complete the questionnaire. This should be done on the first page of the questionnaire as well as in the covering letter. According to Dillman (2009) comments should include a clear unbiased banner or title, a subtitle and a neutral graphic illustration or logo to add interest. Pilot testing and validity assessing Prior to using the questionnaire for data collection it should be pilot tested. The goal of a pilot test is to refine the questionnaire to avoid problems for the respondents in answering the questions and to ensure that there will be no problems in recording the data. Sometimes a researcher does not have much time and finds that it is better to pilot test the questionnaire using friend or family than not at all. This will at least provide his research with face validity: whether the questionnaire appears to make sense (because even friends and family are able to determine this). 12.1 Quantitative data 12.2 Preparing, checking and inputting data
Alternatively, numerical data are those whose values are numerically measured or counted as quantities (Berman 2008). Numerical data are therefore more precise than categorical ones because one can assign each data value a position on a numerical scale. Numerical data can be subdivided in two ways: based on interval and ratio data: or based on continuous or discrete data. Interval data can state the difference (interval) between any two data values of a certain variable, whereas ratio data can calculate the relative difference (ratio) between any two data values of a certain variable. Continuous data are those whose values can take any value (given that you measure them accurately) while discrete data can be measured precisely (often whole numbers/integers). 12.3 Exploring and presenting the dataTurkey’s (1977) exploratory data analysis (EDA) is a useful approach to start the analysis of quantitative data. This approach focuses on the use of diagrams to explore and understand the data. Sometimes it might be possible that this approach enables you to look at other relationships in data, which your research was not designed to test. When looking at the collected data it is best to explore specific values, highest and lowest values, trends over time, proportions and distributions. Once these have been explored one can start to compare them and look for (causal) relationships between variables) Exploring variables
Shapes of diagramsIf a diagram shows a bunching to the left and a long tail to the right (figure 12.3 on page 291) then the data are ‘positively skewed’. If this is the other way around then the data are ‘negatively skewed’. When the data are equally distributed on each side of the highest frequency they are ‘symmetrically skewed’. A bell-shaped curve is called a normal distribution. With the indicator ‘kurtosis’ one can compare a diagrams pointedness or flatness with that of the normal distribution. When a distribution is flatter then it is called platykurtic and the kurtosis value is negative . When the distribution is more peaked, than it is leptokurtic and the kurtosis value is positive. Comparing variables
12.4 Describing data with use of statistics
The dispersion (how data are distributed around the central tendency) could be described by:
12.5 Explore relationships, differences and trends using statistics Testing for normal distribution Testing for significance Type 1 and 2 errorsA Type 1 error occurs when the null hypothesis has been wrongly rejected and the alternative hypothesis should not have been accepted. In other words, the researcher states that two variables are related when they are actually not. Statististical significance is the same as determining the probability of making a Type 1 error. A Type 2 error is when a researcher does not reject the null hypothesis when he should. Thus he states that two variable are not related when they actually are. When descriptive or numerical data are summarised as a two-way contingency table it is helpful to use a chi square test. A chi square test makes it possible to determine how likely it is that two variables are associated. In order to do this test two assumptions should be met:
Exploring the strength of a relationship
The correlation coefficient quantifies the strength of a linear relationship between two ranked or numerical variables between a number of +1 and -1. A value of +1 means positive correlation, which means that the two variables are exactly related and when one increases, the other one will increase as well. A value of -1 demonstrates a negative correlation, where the two variables are precisely related, but when one increases the other one decreases. 13.2 Qualitative data 13.3 Approach to analysisResearches begin from using either an inductive or a deductive approach. When using a deductive approach one seeks to use existing theory. On the other hand, an inductive approach requires one to build up a theory that is adequately grounded in the data. 13.4 Preparing for data analysis Qualitative research interviews are normally audio-recorded and then transcribed, which means that they are reproduced as written (usually with use of a word processor) account using the actual words. Along with the actual words, a researcher also has to note down the tone in which they were said as well as the non-verbal communication of the interviewee. The researcher should also make sure that the transcription is accurate by correcting for errors, this is known as data cleaning. 13.5 Tips for the analysis
13.6 Approaches to analysis
According to Miles and Huberman (1994) the process of analysis consist of three concurrent processes: data reduction, data display, and drawing conclusions. With data reduction they mean summarising and simplifying the collected data and/or selectively focusing on specific parts of these data. Data display focusses on organising and assembling the data into summary diagrams or other visual displays. All data that is not summarised or reduced is called ‘extended text’. Data displays allow the researcher to make comparisons between aspects of the data and to explore relationships, key themes, patterns and trends. 13.7 Inductive procedures
When conducting grounded theory research it could be helpful to use theoretical sampling to find a sample. Theoretical sampling is choosing samples following analysis of initial data to further develop analytical categories and concepts. In order to this one it is important to constantly compare the collected data with the categories and concepts being used. Theoretical sampling is used until theoretical saturation is reached. Template analysis Analytic Induction Narrative Analysis Using this approach, a researcher collects data through narratives such as experiences of the participants. Narratives cannot be easily fragmented since the essence of the story might be lost in the process. Instead, the narratives need to be either left intact, or they need to be ‘re-storied’, into new narratives in a more coherent form. Discourse Analysis 13.8 Deductive approaches Explanation building |