Discuss Potential Challenges to Validity and Reliability of Your Research Question, Data, and Analysis.

In: Business and Management

Submitted By Sherman1000
Words 261
Pages 2
Discuss potential challenges to validity and reliability of your research question, data, and analysis.

Validity and reliability are the backbone of what is accepted as scientific proof by researchers. Potential challenges to reliability of a research question, data, and analyses are any significant results must be repeatable. Anyone who wanted to perform the same experiment applying the same conditions should arrive at the same result. If this is successful this reinforces the results and makes a larger population accept hypothesis. Potential challenges to validity of a research question, data, and analysis is making sure whether research actually measures what it claims to measure. If someone else who looked at the research and questions if the research really measures what it supposed to, the research results are in danger of being null and void and research findings wouldn't carry weight. Potential challenges to validity and reliability of data and analysis is making sure data is reliable in the first place before any test is applied. Any misconstrue data or oversight from beginning will leave false data entered in the statistical hypothesis test that would not produce accurate results. Challenges to validity of data, and analyses are meeting requirements of the scientific research method. Following all requirements and proper procedures when gather information, chosen right population and sample sizes, and any other requirements when using method. Accurate interpretation of data is a potential challenge to reliability of data. If the research results are not interpreted correctly this leads to a cloudy analysis because data is not appropriately examined according to research…...

Similar Documents

Research Reliability

...Research Reliability Essay Applied Nursing Research Research Reliability Essay When conducting a research report, the researcher must provide quality and trustworthy data that is objective, precise, accurate, reliable, and valid (Norwood, 2010). These traits are important when conducting a qualitative or a quantitative research study. Despite researcher’s eagerness to prove the validity and reliability of research data, there are situations that interfere with the accuracy of the study producing measurement errors, such as contaminants and biases. The first study I chose is a qualitative study by researchers Shaw, Robertson, Pransky, and McClellan (2003). The purpose of the study was to analyze the employee’s perspective on the roles of supervisors to prevent workplace disability after injuries. As part of needs assessment for a supervisory training program, 30 employees from four companies were interviewed about the role of supervisors to prevent workplace disability after injuries. From interview notes, 305 employee statements were extracted for analysis. An affinity mapping process with an expert panel produced 11 common themes: accommodation, communicating with workers, responsiveness, concern for welfare, empathy/support, validation, fairness/respect, follow-up, shared decision-making, coordinating with medical providers, and obtaining coworker support of accommodation (Shaw, Robertson, Pransky, McClellan, 2003). In qualitative reports, the researcher needs...

Words: 852 - Pages: 4

Validity, Credibility & Reliability

...Validity, Credibility & Reliability Alicia Struck XBCOM/275 April 17, 2014 Daniel Anderson Validity, Credibility & Reliability Validity, credibility and reliability are key to any kind of data or information being used. Claims and their sources both need to be credible. Where the data came from needs to be taken into account. Do they have a vested interest in the outcome or the understanding to interpret said information? Reliability Having information be reliable means the data is dependable, accurate and honest. An example could be finding reliable websites. It is possible for anyone to make a website. There are certain things to look for when making the decision if it is reliable. A person could check the extension such as .gov (government), .edu (educational) or .mil (military). These are most likely reliable since they have to be applied for and their use is controlled (Sanger). Credibility When something is credible it must be believed or trustworthy. Credible loans are a big issue these days. When someone close to me received a loan, a few years ago, she was fooled. I say this because she ended up paying the wrong company back almost four thousand dollars. Apparently the company was posing as the original company she borrowed from. She was gullible and ended up calling Homeland Security because of the situation (Credibility, 2007). Validity. To be based on truth ot having a foundation is when you find information valid. An example could be in......

Words: 384 - Pages: 2

Validity, Credibility, and Reliability Paper

...When conducting research for an essay or research the researcher must have evidence that supports their writing from sources that can back up their ideas. If I can’t seem to find something creditable, resourceful I will not use the source. A couple of courses back that most reliable sources for the internet are .Gov .Edu. .Org .Mil. Com. Something’s you should look out for who is the author of the website and if the author doesn’t have credentials then the source is not reliable. I like to look a gossip columns about celebrities most of the time what they are saying is not true. Know if they say reliable sources then I might think it may be true. If a website seems old, it's probably best to steer clear. One way to check - look for a "last updated" date on the page or site. If a site looks poorly designed and inexperienced, chances are it was created by amateurs. This means the source is not reliable. But be careful - just because a website is professionally designed doesn't mean it's reliable. Many sources of information come from people or organizations that have a special interest in the information being presented. This can cause the information to be biased in a way that persuades the reader to believe the information being presented and form an opinion that shows favor to the reader or organization. Some drug companies tell you about all the benefits of their medication but not the side effects of the drug I think that why drug companies have a lot of people are......

Words: 394 - Pages: 2

Types of Reliability and Validity

...Reliability In the field of Human Services, especially in the creation of programs, projects and approach strategies, it is important to measure the reliability of approaches and results. The following approaches are more often than not used to test reliability and are therefore the embodiment 'types' of how reliable an approach or strategy tested with them is: 1. Test-retest reliability - The test-retest method estimates the reliability of the test and the results gathered from it by administering the test to the same group of people at least twice over a set period. The results are then correlated and with a high reliability mark, the tests are seen as reliable. 2. Alternate Forms - Two groups are given the test and their scores are correlated. They do not necessarily have to come from the same population (i.e. test in India & test in Bangladesh) as long as there is a certain relationship. The score correlation becomes the reliability guide. 3. Split Half reliability - In terms of tests, half the items relate to the other half and it is the correlation between them in the test results that matter (i.e. half of the test or interview is about health and welfare issues and the other is about the economic state of the interviewee). 4. Inter-rater Reliability - As in contests where there are multiple judges, tests, contests, experiments and research are tested and marked by a set of qualified people. Their average assessment is then seen as......

Words: 801 - Pages: 4

Validity and Reliability

...VALIDITY AND RELIABILITY For the statistical consultant working with social science researchers the estimation of reliability and validity is a task frequently encountered. Measurement issues differ in the social sciences in that they are related to the quantification of abstract, intangible and unobservable constructs. In many instances, then, the meaning of quantities is only inferred. Let us begin by a general description of the paradigm that we are dealing with. Most concepts in the behavioral sciences have meaning within the context of the theory that they are a part of. Each concept, thus, has an operational definition which is governed by the overarching theory. If a concept is involved in the testing of hypothesis to support the theory it has to be measured. So the first decision that the research is faced with is “how shall the concept be measured?” That is the type of measure. At a very broad level the type of measure can be observational, self-report, interview, etc. These types ultimately take shape of a more specific form like observation of ongoing activity, observing video-taped events, self-report measures like questionnaires that can be open-ended or close-ended, Likert-type scales, interviews that are structured, semi-structured or unstructured and open-ended or close-ended. Needless to say, each type of measure has specific types of issues that need to be addressed to make the measurement meaningful, accurate, and efficient. ......

Words: 1512 - Pages: 7

Validity Reliability

...Y METHODS IN EDUCATIONAL RESEARCH From Theory to Practice Marguerite G. Lodico, Dean T. Spaulding, Katherine H. Voegtle METHODS IN EDUCATIONAL RESEARCH Y METHODS IN EDUCATIONAL RESEARCH From Theory to Practice Marguerite G. Lodico, Dean T. Spaulding, Katherine H. Voegtle Copyright © 2006 by John Wiley & Sons, Inc. All rights reserved. Published by Jossey-Bass A Wiley Imprint 989 Market Street, San Francisco, CA 94103-1741 www.josseybass.com No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400, fax 978-646-8600, or on the Web at www.copyright.com. Requests to the publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, 201-748-6011, fax 201-748-6008, or online at http://www.wiley.com/go/permissions. Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this...

Words: 153398 - Pages: 614

Reliability and Validity in Personality Testing

...Reliability and Validity in Personality Testing 02-16-2015 Introduction Psychological tests are often used in the selection of projective personnel (Anastasia & Urbina, 1997). The idea is that by using the scientific approach to personality and emotional intelligence testing in hiring, the employers will be able to increase the number of successful employees (Beaz lll, 2013). “Personality refers to an individual’s unique constellation of consistent behavioral traits”, which in relationship to a person’s projected Emotional Intelligence (EI) may lead to matching the right person to the right job. Job proficiency tests are used to select candidates for employment and are the number one tool used to match the right person to the right position (ND.gov, 2015). However, there are quite a few complaints about the fairness of this process and due to many court cases challenging the validity of these tests, many organizations have chosen to drop the assessment. A plaintiff must establish adverse impact upon a protected group by the employment practice used, in order to force an employer to show content validity in terms of examined traits to be consistent with job relatedness. In a court case against Target, the court found that the questions relating to personality traits in terms of religion and sexual orientation did not have any bearing on the desired emotional stability of the projective employee who had applied for the security officer’s job (Schaffer &......

Words: 1685 - Pages: 7

How Triangulation Ensures Validity and Reliability in Social Science Research

...How triangulation Ensures Validity and Reliability in Social Science Research 1.0 Introduction Triangulation has been defined as the use of more than one approach to the investigation of a research question in order to augment confidence in the findings (Bryman, 2004). For Yeasmin & Rahman, (2012) triangulation is a process of verification that increases validity by incorporating several viewpoints and methods. When applied in the social sciences, it refers to the combination of two or more theories, data sources, methods or investigators in one study of a single phenomenon to converge on a single construct, and can be employed in both quantitative (validation) and qualitative (inquiry) studies. This paper provides a historical background and the development of triangulation as a concept and its application. The paper also presents an overview of various concepts linked to triangulation as applied in social research Finally the paper discusses the benefits and challenges of triangulation offering some relevant examples that guide in understanding the concept. 2.0 Background of Triangulation Originally triangulation was a method used to determine the location of a fixed point based on the laws of trigonometry. The laws state that if one side and two angles of a triangle are known, the other two sides and angle of that triangle can be calculated. Triangulation though not defined was used in the early civilizations of the ancient Egypt and......

Words: 2593 - Pages: 11

Reliability and Validity

...University of Phoenix Material Validity and Reliability Matrix For each of the tests of reliability and validity listed on the matrix, prepare a 50-100-word description of test’s application and under what conditions these types of reliability would be used as well as when it would be inappropriate. Then prepare a 50-100-word description of each test’s strengths and a 50-100-word description of each test’s weaknesses. |TEST of |Application and APPROPRIATENESS |Strengths |Weaknesses | |Reliability | | | | |Internal |“When you want to know if the item on a test assess one, and only one |The imbalance circulation of element correlation or |By using the degree of correlated items to measure,| |Consistency |dimension” (Salkind,N, pg.108). This test would be "used when you want|extreme values of correlations do not alter the |consistency internally is not a correct choice when| | |to know whether the items on a test are consistent with one another” |general factor. The internal arrangement of |the outcome of the test is not one-dimensional. | | |(Salkind,N. 2011 pg110). It would be appropriate to use......

Words: 1837 - Pages: 8

Validity and Reliability

...Validity and Reliability instruments are tools researchers use to collect data. They are also known as “tests.” In reference to instruments, validity is about the instrument itself, that is, “Is the test measuring what it is supposed to measure?” Reliability means, “Are the results of the test consistent over time?” Reliability and validity are often used in testing conditions. In order to compare students’ learning or the quality of teaching programs, tests are categorized by their validity (does the instrument measure what it claims to be measuring) as well as by their reliability (the same results yesterday, today and tomorrow). Reliability refers to the uniformity or stability of the test scores and validity refers to the precision of the assumptions or interpretations made from the resulting test scores. Both of these characteristics are important. However, in order to have validity you must begin with reliability. Reliability is possible without validity. In other words, you can make inferences from data which is solid (reliable), but just because the data is solid it does not mean that the inferences will be valid. Just because students in the same situation score reasonably the same no matter the conditions, does not mean that the tests are testing their learning capacities. I would be looking for the name of the test which gave the standardized data, when it was normed and if there is a more recent version of the test. It is necessary to know something about the......

Words: 389 - Pages: 2

Reliability and Validity Paper

...services research vast amounts of data are collected and analyzed to make decisions regarding the best interest in humans. Majority of data that is collected in human services research are based on tests. It is very important that these tests are reliable and valid. The following paragraphs will explore reliability, and validity. This paper will also explore data collection methods and data collection instruments that are used in human services research, and managerial research. Types of Reliability Reliability is defined as “the quality or state of being reliable; specifically: the extent to which an experiment, test, or measuring procedure yields the same result on repeated trials” ("Reliability," 2011). There are five types of reliability: alternate-form, internal-consistency, item-to-item, judge-to-judge, and test-retest reliability. Alternate-form reliability is the degree of relatedness of different forms of the same test (Rosnow & Rosenthal, 2008). Internal-consistency reliability is how reliable the test is as a whole or how judges score (Rosnow & Rosenthal, 2008). Item-to-item reliability and judge-to-judge reliability are almost the same. Item-to-item reliability is the reliability of any single item on average and judge-to-judge is the reliability of any singe judge on average (Rosnow & Rosenthal, 2008). Finally test-retest reliability is the degree of stability of a measuring instrument or test (Rosnow & Rosenthal, 2008). All types of......

Words: 775 - Pages: 4

As Psychology - Every Potential Essay Question & Answers

...just beat the boundary - I absolutely smashed it. How did I do it? It wasn’t easy and I am by no means some savant genius. I made great notes and essays that simplified things for me as I had no teachers and it is these notes I share with you now for Psya2 and the essay questions that can be asked for it. If your curious to know more about me you can visit my website at http://www.loopa.co.uk There it tells you more about me, how I self-taught myself as well as contact me directly for help and advice as well as get my other essay answers there instantly. Theres also great resources there too with more added on a weekly basis. You can also follow me on twitter to stay up to date on future resources and books. My username is: SajDevshi Again thank you for your support and I wish you the very best in your exams! Now - Lets get this show started.. Psya2 Overview as smaller questions ranging from 1-8 markers but if you’ve memorised full essay answers, answering the smaller ones should be a fairly easy to do. Lets look at the possible 12 mark questions: • The bodies response to stress, including the pituitary-adrenal system and the sympathomedullary pathway in outline (This wont be a 12 mark question as it states “In Outline” so is not included) • Stress-related illness and the immune system • Life changes and daily hassles as sources of stress • Workplace stress including the effects of workload and control • Personality factors including Type A and Type B......

Words: 21741 - Pages: 87

Validity and Reliability

...Validity and Reliability The principles of validity and reliability are fundamental cornerstones of the scientific method. Together, they are at the core of what is accepted as scientific proof, by scientist and philosopher alike. By following a few basic principles, any experimental design will stand up to rigorous questioning and skepticism. \ What is Reliability? The idea behind reliability is that any significant results must be more than a one-off finding and be inherently repeatable. Other researchers must be able to perform exactly the same experiment, under the same conditions and generate the same results. This will reinforce the findings and ensure that the wider scientific community will accept the hypothesis. Without this replication of statistically significant results, the experiment andresearch have not fulfilled all of the requirements of testability. This prerequisite is essential to a hypothesis establishing itself as an accepted scientific truth. For example, if you are performing a time critical experiment, you will be using some type of stopwatch. Generally, it is reasonable to assume that the instruments are reliable and will keep true and accurate time. However, diligent scientists take measurements many times, to minimize the chances of malfunction and maintain validity and reliability. At the other extreme, any experiment that uses human judgment is always going to come under question. For example, if observers rate certain......

Words: 548 - Pages: 3

Reliability and Validity

...Reliability and Validity Walter Boothe BSHS/382 April 23, 2012 Staci Lowe Reliability and Validity In human services, research and testing is conducted in order to provide the most effective program possible. Testing methods should have both reliability and validity. They should be both consistent and specific. This paper will discuss two types of reliability and two types of validity and provide examples of how each can be applied to human services research. Additionally, this paper will discuss methods of gathering data in human services, and why it is vital that these methods have reliability and validity. Reliability Reliability refers to the consistency of a measure. A test is considered reliable if we get the same result repeatedly (Cherry, 2010).Regardless of the reason for testing administering a test , in order for it to be reliable , the results should be approximately the same each time it is administered. Unfortunately, it is impossible to calculate reliability exactly, but it can be estimated in a number of different ways (Cherry, 2010). Two specific types of reliability are inter –rater reliability and internal consistency reliability. Inter –rater reliability is assessed by having two or more independent judges score the test (Cherry, 2010). The scores are compared to determine the consistency of the rater’s estimates. One way to test inter-rater reliability is to have each rater assign each test item a score (Cherry, 2010). Next, test......

Words: 1046 - Pages: 5

Reliability and Validity

...Reliability and Validity Carmen Kbeir BSHS/382 March 26, 2012 Edessa Jobli Reliability and Validity Researchers employ a wide range of data collection methods to obtain information. Some of these methods are quantitative, such as experiments. Others are qualitative, like field studies. Within each of these methods are specific procedures that lead the researcher to various outcomes. The tools, or instruments, used to measure observations or statistics throughout the process are very important. To understand how well the instruments work and the extent to which the outcomes will produce similar results in the future, researchers examine different types of validity and reliability. Reliability is the extent to which an instrument produces consistent results and the probability that others can achieve the same results when reproducing the study. There are several types of reliability, including alternate-form reliability, internal-consistency reliability, item-to-item or judge-to-judge reliability, and test-retest reliability (Rosnow & Rosenthal, 2008). Internal-consistency reliability measures the amount of correlation between items on a test (Darity, 2008). The average correlation between items is indicated by item-to-item reliability. These types of reliability let the researcher know how well the items on a test go together (Rosnow & Rosenthal, 2008). A questionnaire or survey is not of much use if the questions on them are......

Words: 1099 - Pages: 5