Analyzing Collaborative Learning

Assessing the quality of collaborative argumentation present and discuss range of ways evaluative criteria insights into both: -group -individual illuminates both" -function -structure -content provides both: -quant info -qual pic Transcript of class discussion provided coding speech acts typical cats are: positions argument debate Diagram speech acts Evaluating speech act analysis based on the previous criteria Individual | yes Group | partly etc. An Argument Network/diagram/flow chart with arrows shown broad but shallow argumentation found illuminated by shallow chart deep argumentation has richer diagram/chart applying charting to this research showed fairly rich chart Analysis of Reason Types Examples methodology sample size study duration presence of comparison... Evaluation analyses of reason types Chart with criteria Example: Masked observation Goal of strategy | To evaluate whether observations are valid underlying mechanism or explanation | scientists are objective, fair, and unbiased...Scientists don't care about outcome Causal factors | biases might arise if scientists did care about outcome ''' Evaluating reason schema... Implications and conclusions no one method of assessment meets all criteria use comb of methods explore new methods use methods to link processes to learning explore other methods to link to discourse... Representations for anlayzing tool-mediated collaborative larning -sociocultural theory as theoretical framework -analyzing complex learning environments -representations for dealing with complex data ... Conceptual Framework -learning embedded in sociocultural context and activity system (cole & engstrom, 1993) -cultural artifacts help mediate thinking and interactions (kozulin, 1998) --material objects, such as computers --symbolic tools such as language --help org and constrain activity -knowledge constructed through social interaction (palincsar, 1998) -need to study using multiple perspectives and analytic techniques (hmelo-silver, 2003) Studying Collaboration Reps for understanding complex collaborative learning environments -diagram )larkin & simon, 1987) -sna (martinez, dimitriadis, rubis, gomez, adn de la Fuente (2003) in CSCL environment -directed graphs (strom, kemeny, lehrer, forman (2001) -CORDFU -CORDTRA STELLAR online learning environment for pre-service teachers with screenshot -knowledge web -library of videocases and problems -PBL online student module -online tools - notebook, group whiteboard, commenting collaborative space, discussion forum Understanding Learning in STELLAR Contrasting cases of a successful and unsuccessful group (how determine success?) group 1, 5 studs Group 2, ? studs ... Frequencies charts: Tool Use, Discourse Codes HIstograms CORDTRA Diagrams looking at collaborative phase of the activity multiple methods needed to understand CORDTRA pros and cons successful use to correlate relationship between discourse and tools use... A perpsective on collaborative learning informed by peers learning from each other vygotskian: scaffolding by a more skilled learner Piaget cognitive Tther conceptualizations fo peer learning distributed cognitions excessive sharing of common knowledge is prob co-construction of knowledge conceptual change The goal of this study was to examine if and how influence is accomplished within a group Specific questions do peers influence one another during group discussions in such a way that input from others is recalled later? does peer interction increase... 76 3-person groups given case material f2f discussion, consensus plan Automatic Coding of Communication in Collaboration Protocols CSCL CSCL environments offer tools to facilitate… Analysis of collab dialogue protocols Qual – necessary but subject and biased Development of systematic coding system -problem of unit coding, segmentation prob -reliability and validity probs Automatic coding happiness :) Use of discourse markers - limited set of them, such as "oh, by the way, well, however..." MEPA, Multiple .... email them and you can use it Segmentation Filter: 300 Production rules punctuation connectives starting discourse markers exception/restriction rules splitting messages Dialogue Act Coding (DAC Filter): 1250 production rules Coding messages argumentativeness responsives informatives elicitations imperatives RQs Reliable? Valid? Tests they ran say it is ran it on VCRI groupware environment ... Brigid Barron from Stanford referenced Resnick Used Case Studies Studied distribution of scores used videotapes compared written work to conversations groups as "ensembles" use of workbook as center broadcast of work individual and group work going on at the same time conversational metrics - joint attention ... Lots of phenomena to investigate gestures strategies intention and motivation to co-regulate, collaborate, dominate, etc. both speakers and listeners haver consequential roles to play questions peer -idea generators? -groups develop own participation methods cordtra -relations between contributions ... argumentation -metrics for argument quality agreement would be helpful ... MEPA - Multiple Episode Protocol Analysis -how and when to use it? -compare with cordtra? -combine this with qual case approach would be powerful... key question to consider is how between person phenomena are being represented... what do we mean by term quality, this was my question about success...