| 
  • If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

View
 

Credibility and Validity

Page history last edited by Steve Moss 9 years, 5 months ago

'Credibility and validity: nature & basis of/how this may be realistically achieved within research'

 

#phdchat tweet log - 28th March 2012

 

@NSRiazat - Welcome to #phdchat ~ topic tonight is credibility and validity: nature & basis of/how this may be realistically achieved within research.

@NSRiazat - Why is it important to you all that your research findings are credible? #phdchat

@srossmktg - @nsriazat The problem is, #phdchat is inherently qual skewed, so even if a quant topic polled, it won't poll high enough.

@NSRiazat - Guess the root of that is how we justify what is credible and what is not? And who it's credible to - participants or academics? #phdchat

@NSRiazat - @srossmktg ~ where are the quant. researchers? :-) #phdchat

@Rabourn - @NSRiazat My advisor for my (qualitative) dissertation proposal has suggested that I go with "trustworthiness" http://t.co/uGaBqUMa #phdchat

@NSRiazat - @srossmktg ~ that was a question to #phdchat by the way. :-)

@NSRiazat - Science is credible as it answers specific hypotheses - but how would you make qual. research credible? #phdchat

@DaeraCshikoe - #phdchat so is it the same topic as mentioned yesterday?

@srossmktg - @nsriazat Not transcribing and writing 300pg lit reviews or the likes at their computers... ;) #phdchat

@carinavr - Reliability & validity (reductivist speak), and credibility & trustworthiness (inductivist speak) are most ignore part of research. #phdchat

@planetchampion - @srossmktg @nsriazat So What sort of quants are you doing How are you establishing validity #phdchat

@lizith - @srossmktg do you know quant folk who might want to use #phdchat or are there topics rel to all like this one could be? @nsriazat

@MisaimedBrain - @NSRiazat As with much else in qual, isn't credibility about justifying your claims? #phdchat

@lizith - @NSRiazat: Science is credible as it answers specific hypotheses #phdchat Not sure about that - examples around of bad res - all types

@NSRiazat - @DaeraCshikoe ~ looking at credibility/reliability in a doctoral thesis tonight. #phdchat

@NSRiazat - @lizith @MisaimedBrain ~ yes like idea of evidence. Guess conceptual framework and methodology also help with credibility #phdchat

@NSRiazat - In Grounded theory I needed to look at whether my sample of participants was representative of the whole as part of credibility #phdchat

@qui_oui - . @NSRiazat Triangulation of sources is one way to build validity/credibility, in qualitative research. #PhDchat

@MisaimedBrain - @NSRiazat @lizith Ultimate aim - it should be clear why you did *this* and concluded *that.* #phdchat

@qui_oui - @NSRiazat I'm not doing a representative "sample" but in-depth interviews, so can't claim generalizability; important point I think #PhDchat

@strictlykaren - @NSRiazat @lizith cred enhanced by clear audit trail, can inc interview with comments & themes to show anal process #phdchat

@qui_oui - Exactly RT @MisaimedBrain: @NSRiazat @lizith Ultimate aim - it should be clear why you did *this* and concluded *that.* #phdchat

@lizith - one of probs is qual does not have measures some quant has like same results if repeat expt, etc, in diff lab, etc #phdchat

@qui_oui - @lizith Yes, so what I'm doing is linking my results to larger trends already identified by others, & same/similar policy elsewhere #PhDchat

@NSRiazat - How did people make their interviews/observations/data collection methods reliable? #phdchat

@MisaimedBrain - @qui_oui @NSRiazat Also in mixed methods. Can cover more angles, as it were. #phdchat

@strictlykaren - is anyone doing member checking to enhance credibility #phdchat

@srossmktg - @lizith It seemed like the generic types of doctoral student problems (ie, "down in the dumps") are pretty useful to all. #phdchat

@lizith - @srossmktg @nsriazat trouble is we start repeating ourselves so need new topics too #phdchat

@planetchampion - @lizith So liz are you adopting a 'social situations are continually constructed and reconstructed' philosophy? #phdchat

@NSRiazat - @CliveBuckley @lizith ~ good point re: good science being reproducible. #phdchat

@DaeraCshikoe - #phdchat but how to find out if the sources truly are reliable?

@carinavr - Biggest threat to validity I think is bias. In quan about internal & external (generalisable) validity. #phdchat

@NSRiazat - @DaeraCshikoe ~ don't think you can - it's down to good argument and evidence to back it up in your write up? #phdchat

@NSRiazat - @PatParslow ~ agreed. Can't be truly representative of sample but a good representation. #phdchat

@weeladybird1981 - vital to provide clear, detailed account of everything you did and why. and to acknowledge your own biases. #phdchat

@lizith - @planetchampion in part, yes, I'm clear that the systems I am interested in are constructed - & can be differently constructed #phdchat

@planetchampion - @srossmktg OK so how are you making sure people tell you the truth in your surveys? Not just what they want you to think they do #phdchat

@carinavr - In qual validity is about credibility & transferability. Establish credibility through different sources of info &different methods #phdchat

@Goannatree - Stampfl-ing all over it - http://t.co/lwWIx89w #phdchat #travel

@DaeraCshikoe - @NSRiazat #phdchat true but who will be checking the reliability n credibility? Supervisors??

@NSRiazat - Also talked about 'respondent validation' with my supervisor #phdchat

@planetchampion - @lizith So why are you worried about repeatability -if you don't believe in it? #phdchat

@NSRiazat - @DaeraCshikoe ~ yes as you progress and in end of first year report. Also viva checks for validity and credibility. #phdchat

@srossmktg - @planetchampion Thats where using measures to do things like partial out bias (eg, social desirability bias, Paulhus '91) comes in. #phdchat

@carinavr - @DaeraCshikoe @nsriazat Reader of your thesis / publication check for this based on info you should provide. #phdchat

@EwhurstKerry - 3rd of the way through data collection - I can officially see light at the end of the dark, dark tunnel. Bring on the Easter Eggs! #phdchat

@planetchampion - Try looking up 'recoverability' by Checkland and Holwell, 1998 -can e mail full ref if anyone interested. #phdchat

@MisaimedBrain - @LBA_OX12 Well, for one pilot may help you spot disaster before it happens! :) #phdchat

@carinavr - Data saturation another strategy to establish credibility. #phdchat

@beckyheaver - I do quant, so I guess I have to be clear that my measures measure what I say they do #phdchat

@DaeraCshikoe - @NSRiazat #phdchat so we will eventually be our own supervisors?

@NSRiazat - Clive Seale's book 'The Quality of Qualitative Research' (1999) is a good read for issues around tonight's topic. #phdchat

@lizith - @planetchampion my position is one of being transparent abt what I do and why, esp as I am a bit left field in what I'm doing #phdchat

@carinavr - @strictlykaren Have tried this, but very tricky if fieldwork site far, and you're doing proper analysis only when left field. #phdchat

@MisaimedBrain - There are always limitations. Would have liked more 'representative' samples in qualitative part, but can't force participation! #phdchat

@strictlykaren - @carinavr data sat may not est credibility is analysis is bias #phdchat

@MisaimedBrain - I do mixed methods. Combining perspectives from qual and quant on reliability can feel odd! #phdchat

@lizith - @planetchampion Is that "action research." or a diff one? #phdchat

@strictlykaren - @beckyheaver similar in qual, have we interpreted whatbthe particioant said or have we entered into congecture #phdchat

@amandalastoria - add 1 line to your CV per month and other great grad school advice http://t.co/oBEIjoTF @chronicle #phdchat

@planetchampion - @lizith Well the paper is about 'the validity of AR' but it could be applied to any qual method actually #phdchat

@lizith - @planetchampion just checking it out in google scholar #phdchat

@srossmktg - @planetchampion If you're trying to establish the superiority of qual research over quant, you're picking a moot/useless argument. #phdchat

@strictlykaren - @carinavr i didnt do it but lots of theory on qual analysis suggest you should. i have used independent researcher to check #phdchat

@carinavr - Little said so far about reliability or trustworthiness. Double-coding (any doing this?), reflexivity, documenting, being explicit #phdchat

@carinavr - @strictlykaren True, therefore also have to think of credibility of data analysis. #phdchat

@strictlykaren - INterpretive phenomenological analysis by smith, flowers, larkin lay out very clear step by step process for est credibility #phdchat

@strictlykaren - see also elliot et al 1999 paper on guidlines for publishing qual research, excellent #phdchat

@strictlykaren - i certainly wont get a phd for spelling tonight... sorry! #phdchat

@carinavr - @strictlykaren During fieldwork, while had early findings emerging, did ask during I interviews for reflections on some of finds. #phdchat

@strictlykaren - @srossmktg @planetchampion would agree, there is a need for all research appraoches in my discipline, health #phdchat

@lizith - @srossmktg @planetchampion surely it's not about quan vs qual, but what methods approp for RQ #phdchat

@strictlykaren - @carinavr i did follow up interviews which also allowed for checking out some themes from first interview #phdchat

@srossmktg - I've realized there's a difference between methodological debate and methodological superiority. Don't have time for the latter. #phdchat

@srossmktg - @lizith 100% concur. I'm not here though to discuss that a paradigm is superior because another is weaker. To each RQ, its method. #phdchat

@planetchampion - @lizith @srossmktg Neither qual or quants are superior. All depends on the quality of the researcher #phdchat

@carinavr - @strictlykaren Would have loved to be able to do this. Which makes me realize, establishing rapport important for credibility. #phdchat

@lizith - @planetchampion thanks - got Checkland & Howell now #phdchat

@ai1sa - @DaeraCshikoe reliabilty not a concern of my methodology, ANT accepts researcher as biased from the get go #phdchat

@strictlykaren - @carinavr agree re, rapport and this gives good fodder for reflexivity #phdchat

@lizith - @srossmktg @ai1sa I thought usually qual that got -ve comments for bias :) but guess anything with people prob has some bias #phdchat

@shaileshak - 'Naturalistic Inquiry' by Lincoln & Guba (1985) covers basic of confirmability, dependability, credibility, transferability, etc. #phdchat

@planetchampion - Was at #ukais PhD consortium on Monday. Whole session on being able to argue your case to create credibility with examiner #phdchat

@strictlykaren - @drdjwalker excellent! must have a peek at yout thesis! #phdchat

@NSRiazat - @CliveBuckley @lizith ~ if it's reprodicible then there is a tentative argument that it's not 'new' knowledge? #phdchat

@ai1sa - @srossmktg totally pointless. My method says everyhting is biased no point hitting anyone :) #phdchat

@carinavr - @ai1sa Not sure I agree. Even though use ANT still have to show why I should believe what you say & that it is not made up story. #PhDchat

@strictlykaren - @planetchampion do you have a blog? you could blog the top tips from this session? #phdchat

@ai1sa - @lizith @srossmktg but bias nonetheless has to b explained & if method expects it can b limited then requires strategies implemntd #phdchat

@EmmaBurnettx - Catching tail end of tonights chat - shame as just written lots about confirmability, dependability, credibility & transferability #phdchat

@lizith - @NSRiazat @CliveBuckley but isn't being able to reproduce test of some results - thinking LHC and Einstein that's been in press #phdchat

@ai1sa - @carinavr ok, but my story is still as impt as ur story...and what i hear, attend to and ask, still biased #phdchat.

@phdchats - My Paper towards Academia 13 http://t.co/0DAPcP13 #phdchat Pressure, pressure!

@EmmaBurnettx - Lots of good stuff about this in Clive Seale's Researching Society & Culture (2012). Excellent book! #phdchat

@lizith - @ai1sa @carinavr I confess to having a collection of refs justifying standpoint #phdchat

@bronwynah - @mtmarySLP if all else fails, use twitterweb as sounding board on topics #PhDchat is chat at all stages (even design) read on interest area.

@ai1sa - @carinavr Ant really isnt about transferabilty #phdchat ohh 140 characters is sooo short

@lizith - @ai1sa @carinavr LOL! the way we have to cover our backs! but so important we do & know why we do #phdchat

@strictlykaren - @planetchampion why not do it online via elluminate or something, a kind of phdchat webinar? #phdchat

@lizith - @strictlykaren @planetchampion that would be interesting - esp for those of us who tend to find travel difficult #phdchat

@LBA_OX12 - @strictlykaren Excellent idea #phdchat #phdchat

@planetchampion - @strictlykaren Absolutely no chance of me doing that online! Some things are sacred! I do one for the Phd students here its unique! #phdchat

@lizith - @LBA_OX12 @strictlykaren @planetchampion there was some talk last year of trying to do a #phdchat online event

@ai1sa - @lizith @LBA_OX12 @strictlykaren @planetchampion and there some attempts via ggogle+ #phdchat

@EmmaBurnettx - @lizith @LBA_OX12 @strictlykaren @planetchampion could have it as a topic one Wed & explore interest & ways of making it happen? #phdchat

@lizith - @planetchampion @emmaburnettx @lba_ox12 @strictlykaren LOL! have you any idea how diff to get PGRs to talk to each other f-t-f? #phdchat

@ai1sa - xtremely challngng week. Wkplace juggling serious wobbles & then dislocatd shoulder yesterday. but full draft 2 supervsr last sun. #phdchat

@lizith - @planetchampion @emmaburnettx @lba_ox12 @strictlykaren one of my roles this year is supporting collar activities/discussions #phdchat

@strictlykaren - @EmmaBurnettx @lizith @LBA_OX12 certainly up for exploring this to see if it could happen even just once in a while #phdchat

@LBA_OX12 - @EmmaBurnettx @lizith@strictlykaren @planetchampion Would be good 4 those of us based some distance from their iuni #phdchat #phdchat

@EmmaBurnettx - @planetchampion @lizith @lba_ox12 @strictlykaren we do, but this is so much more fun! #phdchat

@EmmaBurnettx - @planetchampion @lizith @lba_ox12 @strictlykaren oh yes! #phdchat

@lizith - @planetchampion @emmaburnettx @lba_ox12 @strictlykaren would depend on focus and accessibility #phdchat

@strictlykaren - agree > "@EmmaBurnettx: @planetchampion @lizith @LBA_OX12 @strictlykaren we do, but this is so much more fun! #phdchat"

@strictlykaren - @planetchampion @lizith @EmmaBurnettx @LBA_OX12 definately #phdchat

@strictlykaren - @lizith somwould your role be setting this up then? #phdchat or exlporing further

@EmmaBurnettx - @sarahthesheepu brilliant! @planetchampion @lizith @lba_ox12 @strictlykaren #phdchat

@strictlykaren - @sarahthesheepu @planetchampion @lizith @EmmaBurnett great - we could have a list of guest experts, maybe even share our own work #phdchat

@lizith - @planetchampion @sarahthesheepu @emmaburnettx @lba_ox12 @strictlykaren no pressure then :) #phdchat

@NSRiazat - Thanks to all colleagues for your valued input into #phdchat tonight - a great discussion as always. Have agreat week everyone! #phdchat

@lizith - I'm logging off now - want to see what happens on The Apprentice! #phdchat

@Lemness - @NSRiazat nice. I lurked #phdchat.

@LBA_OX12 - @strictlykaren @sarahthesheepu @planetchampion @lizith @EmmaBurnett great Count me in Logging off now #phdchat #phdchat

@strictlykaren - @lizith me too, good night #phdchat #apprentice

@EmmaBurnettx - @strictlykaren @lizith @planetchampion @sarahthesheepu @lba_ox12 @nsriazat will be great! #phdchat

@lauracowen - Oo, I'm going to a Bright Club Guildford training session after Easter: http://t.co/xMeUGQ2o #phdchat #phd

@NSRiazat - @Lemness - :-) #phdchat

@SteveCooke - Hurrah. Thesis corrections accepted. Job done. On to the next stage of my life. #phdchat

@strictlykaren - @SteveCooke fantastic! well done ! #phdchat

@NSRiazat - @SteveCooke ~ congratulations Dr Cooke - hope you will still pop into #phdchat. :-)

@SteveCooke - @NSRiazat I will - I think the community probably benefits from having people who've done it to bounce off. #phdchat

@NSRiazat - @SteveCooke - Absolutely, the more the merrier. :-) #phdchat

@strictlykaren - @SteveCooke best wishes for that, take some time to pop the chamagne first #phdchat

@SteveCooke - @strictlykaren Good plan, although in abscence of a job, I may have to settle for Asti Spumante instead! #phdchat

@XarahC - Okay, here for #phdchat, just 2 hours late!! Will enjoy catching up @NSRiazat ps Pups had their silver dog training exam tonight - was hard!

@SueFolley - @SteveCooke congratulations!! #phdchat

@JanetFulton - Hurrah! Must really be post-doctoral now. Just received the dodgy email re publishing thesis as a book #phdchat

@XarahC - @SteveCooke Yay, great news, again :) Now for the next grueling task of finding a job! #phdchat

@XarahC - @SueFolley how's it going Sue? Did I see yesterday that you're submitting by July? #phdchat

@SueFolley - @XarahC I am hoping to - but very slow progress at the moment - writing up - trying to make more theoretical and conceptual :) #phdchat

@SueFolley - @XarahC What about you? How's your's coming along? #phdchat

@SteveCooke - @JanetFulton that's great. Are you going to go for it? #phdchat

@unicornsoup - Yes! everyone should do this RT @DigiVictorianMy PhD thesis in image form! #drawyourthesis #phdchat http://t.co/bKxYFXJx

@JanetFulton - @SteveCooke No, this dodgy company sends out emails hoping to lure new doctors into paying to have thesis published. It's a scam #phdchat

@XarahC - Love this @unicornsoup Yes!everyone should do this @DigiVictorian My PhD thesis in image form! #drawyourthesis #phdchat http://t.co/3aiIffQZ

@Janshs - missed #phdchat again - did you have fun?

@SteveCooke - @JanetFulton Ah. Alas. Well, best of luck getting a real deal. I'll watch out for the scam. #phdchat

@debrockstroh - another great blog post by @explorstyle New blog post on editorial resolve: Letting Go http://t.co/kusE0zxo #phdchat

@evaeuropa - "How to write like a scientist": http://t.co/gVKMKCT7 /via @ThinkWrite @MakeLearn @AlenkaN #PhDchat

@XarahC - @Janshs I missed it too Jan, just trying to make sense of #phdchat I think there might be a group activity being arranged?

@Janshs - @XarahC sounds rather exciting #phdchat

@XarahC - @SteveCooke @JanetFulton you could both publish on your blogs anyway with creative commons licensing and look for a book chapter :) #phdchat

@DaeraCshikoe - @XarahC @stevecooke @janetfulton #phdchat hey all, can I join in? What is the topic of discussion?

@XarahC - @DaeraCshikoe @stevecooke @janetfulton tbh I don't know what the official #phdchat topic was this eve, I'm just catching up!

@lygidakis - Indeed fascinating! MT @dlschermd: Crowdsourced clinical trials is the biggest untapped area of research. #mhealth #phdchat #hcsm

@LitProfSuz - #phdchat Lots of ppl talked @ an online thing.U of Michigan does a nice Virt Con http://t.co/Fjr6mgTZ What @ virt con for PhDs by PhDs?

@busi_B - READ THIS...if email is your default means of communication. http://t.co/KtWpmuLq #gradgrind #college #phdchat

@NSRiazat - @XarahC - great to see you on #phdchat - topic was validity/credibility in research! :)

@NSRiazat - @Lemness - am I right in thinking it's morning in San Diego during #phdchat timeslot?

@NSRiazat - @JanetFulton - also received dodgy email re publishing thesis as book. Very strange. #phdchat

@NSRiazat - If anyone has a topic they want to see included in the next #phdchat poll then please let me know. :)

@PleagleTrainer - Off to 'prepare for colloquium' class today; my confirmation of candidature 'test' is a year away but I like to plan ahead ;) #phdchat

@RhythmicDeets - So sick today... and only 1 hour + 20 minutes to finish grant application. Just want to climb into bed and curl up into a ball. :( #PhDChat

@lindathestar - I'm excited about going to Chicago for #IARR conf & Vancouver for UBC visit mid year, but funds would have helped #phdchat

@EvaAlisic - We'll start with the #traumaresearch chat on inspiring papers in 5 min. Interesting for #hcsm #mhsm and #phdchat people?

@klbz - Good video on formatting new Word 2010 document in APA 6: http://t.co/tjRJJT11 #phdchat

@JanetFulton - Sorry all for that distraction :( #phdchat

 

Comments (0)

You don't have permission to comment on this page.