'Credibility and validity: nature & basis of/how this may be realistically achieved within research'

 

#phdchat tweet log - 28th March 2012

 

@NSRiazat - Welcome to #phdchat ~ topic tonight is credibility and validity: nature & basis of/how this may be realistically achieved within research.

@NSRiazat - Why is it important to you all that your research findings are credible? #phdchat

@srossmktg - @nsriazat The problem is, #phdchat is inherently qual skewed, so even if a quant topic polled, it won't poll high enough.

@NSRiazat - Guess the root of that is how we justify what is credible and what is not? And who it's credible to - participants or academics? #phdchat

@NSRiazat - @srossmktg ~ where are the quant. researchers? :-) #phdchat

@Rabourn - @NSRiazat My advisor for my (qualitative) dissertation proposal has suggested that I go with "trustworthiness" http://t.co/uGaBqUMa #phdchat

@NSRiazat - @srossmktg ~ that was a question to #phdchat by the way. :-)

@NSRiazat - Science is credible as it answers specific hypotheses - but how would you make qual. research credible? #phdchat

@DaeraCshikoe - #phdchat so is it the same topic as mentioned yesterday?

@srossmktg - @nsriazat Not transcribing and writing 300pg lit reviews or the likes at their computers... ;) #phdchat

@carinavr - Reliability & validity (reductivist speak), and credibility & trustworthiness (inductivist speak) are most ignore part of research. #phdchat

@planetchampion - @srossmktg @nsriazat So What sort of quants are you doing How are you establishing validity #phdchat

@lizith - @srossmktg do you know quant folk who might want to use #phdchat or are there topics rel to all like this one could be? @nsriazat

@MisaimedBrain - @NSRiazat As with much else in qual, isn't credibility about justifying your claims? #phdchat

@lizith - @NSRiazat: Science is credible as it answers specific hypotheses #phdchat Not sure about that - examples around of bad res - all types

@NSRiazat - @DaeraCshikoe ~ looking at credibility/reliability in a doctoral thesis tonight. #phdchat

@NSRiazat - @lizith @MisaimedBrain ~ yes like idea of evidence. Guess conceptual framework and methodology also help with credibility #phdchat

@NSRiazat - In Grounded theory I needed to look at whether my sample of participants was representative of the whole as part of credibility #phdchat

@qui_oui - . @NSRiazat Triangulation of sources is one way to build validity/credibility, in qualitative research. #PhDchat

@MisaimedBrain - @NSRiazat @lizith Ultimate aim - it should be clear why you did *this* and concluded *that.* #phdchat

@qui_oui - @NSRiazat I'm not doing a representative "sample" but in-depth interviews, so can't claim generalizability; important point I think #PhDchat

@strictlykaren - @NSRiazat @lizith cred enhanced by clear audit trail, can inc interview with comments & themes to show anal process #phdchat

@qui_oui - Exactly RT @MisaimedBrain: @NSRiazat @lizith Ultimate aim - it should be clear why you did *this* and concluded *that.* #phdchat

@lizith - one of probs is qual does not have measures some quant has like same results if repeat expt, etc, in diff lab, etc #phdchat

@qui_oui - @lizith Yes, so what I'm doing is linking my results to larger trends already identified by others, & same/similar policy elsewhere #PhDchat

@NSRiazat - How did people make their interviews/observations/data collection methods reliable? #phdchat

@MisaimedBrain - @qui_oui @NSRiazat Also in mixed methods. Can cover more angles, as it were. #phdchat

@strictlykaren - is anyone doing member checking to enhance credibility #phdchat

@srossmktg - @lizith It seemed like the generic types of doctoral student problems (ie, "down in the dumps") are pretty useful to all. #phdchat

@lizith - @srossmktg @nsriazat trouble is we start repeating ourselves so need new topics too #phdchat

@planetchampion - @lizith So liz are you adopting a 'social situations are continually constructed and reconstructed' philosophy? #phdchat

@NSRiazat - @CliveBuckley @lizith ~ good point re: good science being reproducible. #phdchat

@DaeraCshikoe - #phdchat but how to find out if the sources truly are reliable?

@carinavr - Biggest threat to validity I think is bias. In quan about internal & external (generalisable) validity. #phdchat

@NSRiazat - @DaeraCshikoe ~ don't think you can - it's down to good argument and evidence to back it up in your write up? #phdchat

@NSRiazat - @PatParslow ~ agreed. Can't be truly representative of sample but a good representation. #phdchat

@weeladybird1981 - vital to provide clear, detailed account of everything you did and why. and to acknowledge your own biases. #phdchat

@lizith - @planetchampion in part, yes, I'm clear that the systems I am interested in are constructed - & can be differently constructed #phdchat

@planetchampion - @srossmktg OK so how are you making sure people tell you the truth in your surveys? Not just what they want you to think they do #phdchat

@carinavr - In qual validity is about credibility & transferability. Establish credibility through different sources of info &different methods #phdchat

@Goannatree - Stampfl-ing all over it - http://t.co/lwWIx89w #phdchat #travel

@DaeraCshikoe - @NSRiazat #phdchat true but who will be checking the reliability n credibility? Supervisors??

@NSRiazat - Also talked about 'respondent validation' with my supervisor #phdchat

@planetchampion - @lizith So why are you worried about repeatability -if you don't believe in it? #phdchat

@NSRiazat - @DaeraCshikoe ~ yes as you progress and in end of first year report. Also viva checks for validity and credibility. #phdchat

@srossmktg - @planetchampion Thats where using measures to do things like partial out bias (eg, social desirability bias, Paulhus '91) comes in. #phdchat

@carinavr - @DaeraCshikoe @nsriazat Reader of your thesis / publication check for this based on info you should provide. #phdchat

@EwhurstKerry - 3rd of the way through data collection - I can officially see light at the end of the dark, dark tunnel. Bring on the Easter Eggs! #phdchat

@planetchampion - Try looking up 'recoverability' by Checkland and Holwell, 1998 -can e mail full ref if anyone interested. #phdchat

@MisaimedBrain - @LBA_OX12 Well, for one pilot may help you spot disaster before it happens! :) #phdchat

@carinavr - Data saturation another strategy to establish credibility. #phdchat

@beckyheaver - I do quant, so I guess I have to be clear that my measures measure what I say they do #phdchat

@DaeraCshikoe - @NSRiazat #phdchat so we will eventually be our own supervisors?

@NSRiazat - Clive Seale's book 'The Quality of Qualitative Research' (1999) is a good read for issues around tonight's topic. #phdchat

@lizith - @planetchampion my position is one of being transparent abt what I do and why, esp as I am a bit left field in what I'm doing #phdchat

@carinavr - @strictlykaren Have tried this, but very tricky if fieldwork site far, and you're doing proper analysis only when left field. #phdchat

@MisaimedBrain - There are always limitations. Would have liked more 'representative' samples in qualitative part, but can't force participation! #phdchat

@strictlykaren - @carinavr data sat may not est credibility is analysis is bias #phdchat

@MisaimedBrain - I do mixed methods. Combining perspectives from qual and quant on reliability can feel odd! #phdchat

@lizith - @planetchampion Is that "action research." or a diff one? #phdchat

@strictlykaren - @beckyheaver similar in qual, have we interpreted whatbthe particioant said or have we entered into congecture #phdchat

@amandalastoria - add 1 line to your CV per month and other great grad school advice http://t.co/oBEIjoTF @chronicle #phdchat

@planetchampion - @lizith Well the paper is about 'the validity of AR' but it could be applied to any qual method actually #phdchat

@lizith - @planetchampion just checking it out in google scholar #phdchat

@srossmktg - @planetchampion If you're trying to establish the superiority of qual research over quant, you're picking a moot/useless argument. #phdchat

@strictlykaren - @carinavr i didnt do it but lots of theory on qual analysis suggest you should. i have used independent researcher to check #phdchat

@carinavr - Little said so far about reliability or trustworthiness. Double-coding (any doing this?), reflexivity, documenting, being explicit #phdchat

@carinavr - @strictlykaren True, therefore also have to think of credibility of data analysis. #phdchat

@strictlykaren - INterpretive phenomenological analysis by smith, flowers, larkin lay out very clear step by step process for est credibility #phdchat

@strictlykaren - see also elliot et al 1999 paper on guidlines for publishing qual research, excellent #phdchat

@strictlykaren - i certainly wont get a phd for spelling tonight... sorry! #phdchat

@carinavr - @strictlykaren During fieldwork, while had early findings emerging, did ask during I interviews for reflections on some of finds. #phdchat

@strictlykaren - @srossmktg @planetchampion would agree, there is a need for all research appraoches in my discipline, health #phdchat

@lizith - @srossmktg @planetchampion surely it's not about quan vs qual, but what methods approp for RQ #phdchat

@strictlykaren - @carinavr i did follow up interviews which also allowed for checking out some themes from first interview #phdchat

@srossmktg - I've realized there's a difference between methodological debate and methodological superiority. Don't have time for the latter. #phdchat

@srossmktg - @lizith 100% concur. I'm not here though to discuss that a paradigm is superior because another is weaker. To each RQ, its method. #phdchat

@planetchampion - @lizith @srossmktg Neither qual or quants are superior. All depends on the quality of the researcher #phdchat

@carinavr - @strictlykaren Would have loved to be able to do this. Which makes me realize, establishing rapport important for credibility. #phdchat

@lizith - @planetchampion thanks - got Checkland & Howell now #phdchat

@ai1sa - @DaeraCshikoe reliabilty not a concern of my methodology, ANT accepts researcher as biased from the get go #phdchat

@strictlykaren - @carinavr agree re, rapport and this gives good fodder for reflexivity #phdchat

@lizith - @srossmktg @ai1sa I thought usually qual that got -ve comments for bias :) but guess anything with people prob has some bias #phdchat

@shaileshak - 'Naturalistic Inquiry' by Lincoln & Guba (1985) covers basic of confirmability, dependability, credibility, transferability, etc. #phdchat

@planetchampion - Was at #ukais PhD consortium on Monday. Whole session on being able to argue your case to create credibility with examiner #phdchat

@strictlykaren - @drdjwalker excellent! must have a peek at yout thesis! #phdchat

@NSRiazat - @CliveBuckley @lizith ~ if it's reprodicible then there is a tentative argument that it's not 'new' knowledge? #phdchat

@ai1sa - @srossmktg totally pointless. My method says everyhting is biased no point hitting anyone :) #phdchat

@carinavr - @ai1sa Not sure I agree. Even though use ANT still have to show why I should believe what you say & that it is not made up story. #PhDchat

@strictlykaren - @planetchampion do you have a blog? you could blog the top tips from this session? #phdchat

@ai1sa - @lizith @srossmktg but bias nonetheless has to b explained & if method expects it can b limited then requires strategies implemntd #phdchat

@EmmaBurnettx - Catching tail end of tonights chat - shame as just written lots about confirmability, dependability, credibility & transferability #phdchat

@lizith - @NSRiazat @CliveBuckley but isn't being able to reproduce test of some results - thinking LHC and Einstein that's been in press #phdchat

@ai1sa - @carinavr ok, but my story is still as impt as ur story...and what i hear, attend to and ask, still biased #phdchat.

@phdchats - My Paper towards Academia 13 http://t.co/0DAPcP13 #phdchat Pressure, pressure!

@EmmaBurnettx - Lots of good stuff about this in Clive Seale's Researching Society & Culture (2012). Excellent book! #phdchat

@lizith - @ai1sa @carinavr I confess to having a collection of refs justifying standpoint #phdchat

@bronwynah - @mtmarySLP if all else fails, use twitterweb as sounding board on topics #PhDchat is chat at all stages (even design) read on interest area.

@ai1sa - @carinavr Ant really isnt about transferabilty #phdchat ohh 140 characters is sooo short

@lizith - @ai1sa @carinavr LOL! the way we have to cover our backs! but so important we do & know why we do #phdchat

@strictlykaren - @planetchampion why not do it online via elluminate or something, a kind of phdchat webinar? #phdchat

@lizith - @strictlykaren @planetchampion that would be interesting - esp for those of us who tend to find travel difficult #phdchat

@LBA_OX12 - @strictlykaren Excellent idea #phdchat #phdchat

@planetchampion - @strictlykaren Absolutely no chance of me doing that online! Some things are sacred! I do one for the Phd students here its unique! #phdchat

@lizith - @LBA_OX12 @strictlykaren @planetchampion there was some talk last year of trying to do a #phdchat online event

@ai1sa - @lizith @LBA_OX12 @strictlykaren @planetchampion and there some attempts via ggogle+ #phdchat

@EmmaBurnettx - @lizith @LBA_OX12 @strictlykaren @planetchampion could have it as a topic one Wed & explore interest & ways of making it happen? #phdchat

@lizith - @planetchampion @emmaburnettx @lba_ox12 @strictlykaren LOL! have you any idea how diff to get PGRs to talk to each other f-t-f? #phdchat

@ai1sa - xtremely challngng week. Wkplace juggling serious wobbles & then dislocatd shoulder yesterday. but full draft 2 supervsr last sun. #phdchat

@lizith - @planetchampion @emmaburnettx @lba_ox12 @strictlykaren one of my roles this year is supporting collar activities/discussions #phdchat

@strictlykaren - @EmmaBurnettx @lizith @LBA_OX12 certainly up for exploring this to see if it could happen even just once in a while #phdchat

@LBA_OX12 - @EmmaBurnettx @lizith@strictlykaren @planetchampion Would be good 4 those of us based some distance from their iuni #phdchat #phdchat

@EmmaBurnettx - @planetchampion @lizith @lba_ox12 @strictlykaren we do, but this is so much more fun! #phdchat

@EmmaBurnettx - @planetchampion @lizith @lba_ox12 @strictlykaren oh yes! #phdchat

@lizith - @planetchampion @emmaburnettx @lba_ox12 @strictlykaren would depend on focus and accessibility #phdchat

@strictlykaren - agree > "@EmmaBurnettx: @planetchampion @lizith @LBA_OX12 @strictlykaren we do, but this is so much more fun! #phdchat"

@strictlykaren - @planetchampion @lizith @EmmaBurnettx @LBA_OX12 definately #phdchat

@strictlykaren - @lizith somwould your role be setting this up then? #phdchat or exlporing further

@EmmaBurnettx - @sarahthesheepu brilliant! @planetchampion @lizith @lba_ox12 @strictlykaren #phdchat

@strictlykaren - @sarahthesheepu @planetchampion @lizith @EmmaBurnett great - we could have a list of guest experts, maybe even share our own work #phdchat

@lizith - @planetchampion @sarahthesheepu @emmaburnettx @lba_ox12 @strictlykaren no pressure then :) #phdchat

@NSRiazat - Thanks to all colleagues for your valued input into #phdchat tonight - a great discussion as always. Have agreat week everyone! #phdchat

@lizith - I'm logging off now - want to see what happens on The Apprentice! #phdchat

@Lemness - @NSRiazat nice. I lurked #phdchat.

@LBA_OX12 - @strictlykaren @sarahthesheepu @planetchampion @lizith @EmmaBurnett great Count me in Logging off now #phdchat #phdchat

@strictlykaren - @lizith me too, good night #phdchat #apprentice

@EmmaBurnettx - @strictlykaren @lizith @planetchampion @sarahthesheepu @lba_ox12 @nsriazat will be great! #phdchat

@lauracowen - Oo, I'm going to a Bright Club Guildford training session after Easter: http://t.co/xMeUGQ2o #phdchat #phd

@NSRiazat - @Lemness - :-) #phdchat

@SteveCooke - Hurrah. Thesis corrections accepted. Job done. On to the next stage of my life. #phdchat

@strictlykaren - @SteveCooke fantastic! well done ! #phdchat

@NSRiazat - @SteveCooke ~ congratulations Dr Cooke - hope you will still pop into #phdchat. :-)

@SteveCooke - @NSRiazat I will - I think the community probably benefits from having people who've done it to bounce off. #phdchat

@NSRiazat - @SteveCooke - Absolutely, the more the merrier. :-) #phdchat

@strictlykaren - @SteveCooke best wishes for that, take some time to pop the chamagne first #phdchat

@SteveCooke - @strictlykaren Good plan, although in abscence of a job, I may have to settle for Asti Spumante instead! #phdchat

@XarahC - Okay, here for #phdchat, just 2 hours late!! Will enjoy catching up @NSRiazat ps Pups had their silver dog training exam tonight - was hard!

@SueFolley - @SteveCooke congratulations!! #phdchat

@JanetFulton - Hurrah! Must really be post-doctoral now. Just received the dodgy email re publishing thesis as a book #phdchat

@XarahC - @SteveCooke Yay, great news, again :) Now for the next grueling task of finding a job! #phdchat

@XarahC - @SueFolley how's it going Sue? Did I see yesterday that you're submitting by July? #phdchat

@SueFolley - @XarahC I am hoping to - but very slow progress at the moment - writing up - trying to make more theoretical and conceptual :) #phdchat

@SueFolley - @XarahC What about you? How's your's coming along? #phdchat

@SteveCooke - @JanetFulton that's great. Are you going to go for it? #phdchat

@unicornsoup - Yes! everyone should do this RT @DigiVictorianMy PhD thesis in image form! #drawyourthesis #phdchat http://t.co/bKxYFXJx

@JanetFulton - @SteveCooke No, this dodgy company sends out emails hoping to lure new doctors into paying to have thesis published. It's a scam #phdchat

@XarahC - Love this @unicornsoup Yes!everyone should do this @DigiVictorian My PhD thesis in image form! #drawyourthesis #phdchat http://t.co/3aiIffQZ

@Janshs - missed #phdchat again - did you have fun?

@SteveCooke - @JanetFulton Ah. Alas. Well, best of luck getting a real deal. I'll watch out for the scam. #phdchat

@debrockstroh - another great blog post by @explorstyle New blog post on editorial resolve: Letting Go http://t.co/kusE0zxo #phdchat

@evaeuropa - "How to write like a scientist": http://t.co/gVKMKCT7 /via @ThinkWrite @MakeLearn @AlenkaN #PhDchat

@XarahC - @Janshs I missed it too Jan, just trying to make sense of #phdchat I think there might be a group activity being arranged?

@Janshs - @XarahC sounds rather exciting #phdchat

@XarahC - @SteveCooke @JanetFulton you could both publish on your blogs anyway with creative commons licensing and look for a book chapter :) #phdchat

@DaeraCshikoe - @XarahC @stevecooke @janetfulton #phdchat hey all, can I join in? What is the topic of discussion?

@XarahC - @DaeraCshikoe @stevecooke @janetfulton tbh I don't know what the official #phdchat topic was this eve, I'm just catching up!

@lygidakis - Indeed fascinating! MT @dlschermd: Crowdsourced clinical trials is the biggest untapped area of research. #mhealth #phdchat #hcsm

@LitProfSuz - #phdchat Lots of ppl talked @ an online thing.U of Michigan does a nice Virt Con http://t.co/Fjr6mgTZ What @ virt con for PhDs by PhDs?

@busi_B - READ THIS...if email is your default means of communication. http://t.co/KtWpmuLq #gradgrind #college #phdchat

@NSRiazat - @XarahC - great to see you on #phdchat - topic was validity/credibility in research! :)

@NSRiazat - @Lemness - am I right in thinking it's morning in San Diego during #phdchat timeslot?

@NSRiazat - @JanetFulton - also received dodgy email re publishing thesis as book. Very strange. #phdchat

@NSRiazat - If anyone has a topic they want to see included in the next #phdchat poll then please let me know. :)

@PleagleTrainer - Off to 'prepare for colloquium' class today; my confirmation of candidature 'test' is a year away but I like to plan ahead ;) #phdchat

@RhythmicDeets - So sick today... and only 1 hour + 20 minutes to finish grant application. Just want to climb into bed and curl up into a ball. :( #PhDChat

@lindathestar - I'm excited about going to Chicago for #IARR conf & Vancouver for UBC visit mid year, but funds would have helped #phdchat

@EvaAlisic - We'll start with the #traumaresearch chat on inspiring papers in 5 min. Interesting for #hcsm #mhsm and #phdchat people?

@klbz - Good video on formatting new Word 2010 document in APA 6: http://t.co/tjRJJT11 #phdchat

@JanetFulton - Sorry all for that distraction :( #phdchat