About Me

Research Interests
My research interests all in the intersection of Artificial Intelligence, Education, and Narrative. I have over a decade of experience building novel educational experiences based in artificial intelligence for both K-12 and Higher Ed classrooms.
Research History
I received my Ph.D in 2014 from North Carolina State University, where I studied under Dr. James Lester. During the course of my studies, I worked on several projects to support middle school students in both science and creative writing classrooms. Within these projects, I participated in all phases of the research, including initial software development, ai capability design & development, in-class observational studies, data extraction and curation, and final inferential data analysis and evaluation.

After finishing my Ph.D, I started a post-doctoral position at the Learning Research and Development Center, at the University of Pittsburgh. The focus of my post-doctoral research was research and development for the SWoRD Peer-Review writing support system. We developed a revision planning intervention which allowed students to collect the feedback they were receiving and make concrete decisions about how to incorporate the feedback into their drafts. As with my graduate work, I developed softwware, participated in in-class observational studies, extracted and curated data, and performed the final inferential data analysis and evaluation. I received a second post-doctoral research associate positiont with the Center for Instructional Design and Distance Education. This second project was focused on behavioral analysis of student interactions within PITT Online and Coursera courses.

I am currently a Principal Data Scientist at Pearson. The focus of my work has been on nlp techniques for writing and language instruction. I lead a multi-disciplinary team of software engineers, data scientists, and UX designers to develop protoypes and capabilities which can be used in Pearson products to enable novel learning experiences.

Research Projects

Active Learning in Essay Scoring

An essay scoring prototype which collaborates with an instructor to build an essay scoring model over the course of a semester using online active learning. Contributions include an active learning algorithm for suggesting the order in which the instructor should grade the essays and a UX framework for communicating online learning flow and status to a non-ML fluent user.

UIBK 2019, LAS 2019

Pending

MOOC Data Analytics

An analysis of student interactions, including video interactions, in-class quiz interactions, offline assignments completed, and forum posts.

ILS 2018, EDM 2016

Revision in Peer Review

A revision planning intervention that allows students to consider how to respond to the feedback received and lessons learned from their reviewing tasks.

IS 2107, EDM Workshops 2016, EDM2015

Goal Recognition in Narrative Games

Modeling student problem solving processes within an intelligent game-based learning environment for middle-grade science education.

AIIDE 2016, UMAP2014, INT 2013, INT 2012, CMN 2012

JavaTutor

A system for selecting dialogue utterances based on features of the problem progress and task for an intelligent tutorial dialogue system for introductory Java concepts.

Narrative Theatre
Describe stuff

An intelligent creativity-enhancement environment for 6th grade writing education. Students are guided through the process of planning and writing a fable, which is then visualized in a storyboard to aid in the creative revision process.

SIGDIAL 2010, SEMEVAL 2010, CL&W 2010

Action Representation in Description Logics

Developed a description logic framework for representing hierarchical actions for both recognition and planning.

Publications & Patents

Capstones & Dissertations

  • Ph.D Dissertation Discovery-Based Goal Recognition in Interactive Narrative Environments, Department of Computer Science, NC State University

    Advisor: Dr. James Lester

  • Senior Thesis Partial Recognition and Reasoning about Actions, Department of Computer Science, University of Illinois

    Advisor: Dr. Eyal Amir

Journal Articles

  • , Carrie Demmans Epp, and Christian D. Schunn. (2018) Participating by activity or by week in MOOCs. Information and Learning Science 119(9/10), 572-585.

  • Fuhui Zhang, Christian D. Schunn, and . (2017) Charting the routes to revision: An interplay of writing goals, peer comments, and self-reflections from peer reviews. Instructional Science 45(5), 679-707.

Conference Publications

  • Scott Hellman, Mark Rosenstein, Andrew Gorman, William Murray, Lee Becker, , Jill Budden, Peter W. Foltz. Scaling Up Writing in the Curricilum: Batch Mode Active Learning for Automated Essay Scoring. Sixth Conference on Learning @ Scale, Chicago, IL. 2019

  • Wookhee Min, , Bradford Mott, Jonathan Rowe, Barry Liu, Eun Ha and James Lester. A Generalized Multidimensional Evaluation Framework for Player Goal Recognition. To Appear In Proceedings of the Twelfth Annual AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Burlingame, California. 2016.

  • ,Christian Schunn, Carrie Demmans-Epp and Yanjin Long. Redifining “What” In Analyses of Who Does What in MOOCs. In Proceedings of the Ninth International Conference on Educational Data Mining, Raleigh, NC. pp. 569-570. 2016

  • , Christian Schunn and Kevin Ashley. Understanding Revision Planning in Peer-Reviewed Writing. In Proceedings of the Eight International Conference on Educational Data Mining, Madrid, Spain. pp. 544 – 548. 2015

  • , Jonathan Rowe, Bradford Mott and James Lester. Generalizability of Goal Recognition Models in Narrative-Centered Learning Environments. In Proceedings of the Twenty First International Conference on User Modeling, Adaptation and Personalization, Aalborg, Denmark. pp. 278 – 289. 2014

  • Eun Young Ha, , Carlyle J. Licata, Bradford W. Mott and James C. Lester. Exploring the Effectiveness of Lexical Ontologies for Modeling Temporal Relations with Markov Logic. In Proceedings of the Eleventh Annual SIGDIAL Meeting on Discourse and Dialogue, Tokyo, Japan. pp. 75–79. 2010

Conference Presentations

  • Loretto, A., Godley2, A. . (2015, December) A think-aloud study of adolescent writers’ peer review and revision strategies. Paper presented at the 2015 Literacy Research Association Annual Conference, Carlsbad, CA.

Workshop Publications

  • , Lee Becker, Jill Budden, Peter Foltz, Andrew Gorman, Scott Hellman, William Murray, Mark Rosentstein. An apprenticeship model for human and AI collaborative essay grading The First Workshop on User Interactions for Building Knowledge (UIBK), Los Angeles, CA. 2019.

  • , Christian Schunn, and Kevin Ashley. Impact of Revision Planning in Peer-Reviewed Writing. To Appear In Proceedings of the Second Workshop on Computer-Supported Peer Review in Education, Raleigh, NC. 2016.

  • , Jonathan P. Rowe, Bradford W. Mott, and James C. Lester. Improving Goal Recognition in Interactive Narratives with Models of Narrative Discovery Events. In Proceedings of the Sixth Workshop on Intelligent Narrative Technologies, Boston, MA, pp. 2-8, 2013

  • , Jonathan P. Rowe, Bradford W. Mott, and James C. Lester. Toward Narrative Schema-Based Goal Recognition Models for Interactive Narrative Environments. In Proceedings of the Fifth Workshop on Intelligent Narrative Technologies, Stanford, CA, pp. 2-7, 2012.

  • and Rogelio E. Cardona-Rivera. Towards finding the fundamental unit of narrative: A Proposal for the Narreme. In Proceedings of the 2012 Workshop on Computational Models of Narrative, Istanbul, Turkey, pp. 44-46, 2012.

  • , Julius Goth, Christopher M. Mitchel, Eun Young Ha, Bradford W. Mott, and James C. Lester. Towards a Computational Model of Narrative Visualization. In Proceedings of the Fourth Workshop on Intelligent Narrative Technologies, Stanford, California, pp. 2-9, 2011.

  • Eun Young Ha, , Carlyle Licata, and James C. Lester. NCSU: Modeling Temporal Relations with Markov Logic and Lexical Ontology. In Proceedings of the Fifth International Workshop on Semantic Evaluation, Uppsala, Sweden, pp. 341-344. 2010.

  • Julius Goth, , Eun Young Ha, Jonathan Rowe, Bradford Mott, and James Lester. Exploring Individual Differences in Student Writing with a Narrative Composition Support Environment. In Proceedings of the First NAACL HLT Workshop on Computational Linguistics & Writing (CL&W), Los Angeles, California, pp. 56-64, 2010.

Issued Patents

  • US Patent 10860940, "System and method for automated sequencing database generation," December 8, 2020.

    Inventors: Murray; William (Lone Tree, CO), Baikadi; Alok (Boulder, CO)

  • US Patent 10783185, "System and method for automated hybrid sequencing database generation," September 22, 2020

    Inventors: Murray; William (Lone Tree, CO), Baikadi; Alok (Boulder, CO)

  • US Patent 10754899, "System and method for sequencing database-based content recommendation," August 25, 2020

    Inventors: Murray; William (Lone Tree, CO), Baikadi; Alok (Boulder, CO)

Work & Education History

Work History

  • Pearson - AI Products & Solutions
    2017 - Present
    Principal Data Scientist
    2019 - Present
    Sr Data Scientist
    2017-2019

    Lead a team of researchers and developers in developing multi-disciplinary approaches to novel AI-enhanced educational experiences. Worked with internal and external stakeholders to develop requirements and communicate results. Designed a research agenda to evaluate the efficacy of the techniques. Applied machine learning and natural language techniques to designing, developing and deploying novel educational experiences. Evaluated the efficacy of novel AI techniques in product experiences. Developed technology that resulted in products, patents, and peer-reviewed publications.

  • University of Pittsburgh
    2014 - 2017
    Post-Doctoral Research Associate
    2016-2017

    Analyzed student and discussion forum data from PITT Online courses and Coursera courses. Joint appointment with the Learning Research and Development Center and the Center for Instructional Development and Distance Education

    Post-Doctoral Research Assisstant
    2014-2016

    Designed peer-reviewed writing instruction and support experiences. Designed a research agenda to evaluate the effectiveness of the writing support experience in the classroom. Developed software to enable executiont and monitoring of the experience. Appointment within the Learning Research and Devolpment Center. Research and development performed in collaboration with Dr. Christian Schunn and Dr. Kevin Ashley.

  • North Carolina State University
    2007-2013
    Research Assisstant
    2009-2013

    Applied Machine Learning techniques to design novel classroom experiences. Designed research studies evalauate the effectiveness of AI in enabling classroom experiences. Developed software to enable execution and monitoring of AI-enabled experiences. Research performed under the direction of Dr. James Lester.

    Teaching Assisstant
    2007-2009

    Graded assignments and held office hours for graduate level Artificial Intelligence, Machine Learning, and Algorithms courses. Instructor of Record for undergraduate Artificial Intelligence course.

  • Grammatech - Summer Intern
    Summer 2007

    Developed software for the Codesurfer/Codesonar product.

  • Intel - Summer Intern
    Summer 2005

    Developed software for the Automation group.

Education

  • Ph.D - Computer Science
    2007-2013

    North Carolina State University

  • B.S. - Computer Science
    2003-2007

    University of Illinois at Urbana-Champaign