Learning Analytics Community of Practice - Resources

The Learning Analytics Community of Practice (CoP) is an informal place to share what you’re interested in, what you’re working on, and explore topics that may be of interest.

We meet virtually (throughout the academic year) on the 2nd Friday of each month from 12:00 - 1:00 (CT) in the LA Community of Practice Meetings channel. (Join the UW-Madison Learning Analytics team for more info and to receive calendar invitations.)

More about the LA CoP & where to participate

    The Learning Analytics CoP is designed to connect colleagues across campus in sharing learning analytics experiences. You are invited to share what you’ve learned and learn from your peers. These informal sessions provide an opportunity to discuss strategies using LA in educational practices, and focus on various questions and topics.

    • We meet virtually (throughout the academic year) usually on the 2nd Friday of each month from 12:00 - 1:00 (CT) in the LA Community of Practice Meetings channel. (Join the UW-Madison Learning Analytics team for more info and to receive calendar invitations. Dates will occasionally be modified due to the academic calendar or presenter availability)
    • We are always open to idea for topics! If you would like to suggest a topic or share about work you are doing, please email kari.jordahl@wisc.edu 

    You do not have to be an expert to participate! Students, staff, instructors, leadership, and others in educational roles are all welcome to attend; whether you are just starting to explore using learning analytics or have experience using learning analytics in your teaching, learning or advising practice. 

    Background

    The LA CoP has been meeting virtually in Teams since fall 2020, after meeting in person since 2018. Topics have been recorded for the past few years; slides or other meeting resources are provided for earlier sessions that were not recorded. (Note: You must have UW-Madison credentials to access slides and recordings.)

    Some earlier sessions were offered as part of the Learning Analytics Speakers Series. The LA CoP and the LA Speaker Series merged together, and sessions listed below include both event types.

    Topics by Academic Year (high-level list)

    More details and links to resources are available below (in the calendar year sections).

    Key to acronyms: CTLM - Center for Teaching, Learning & Mentoring | CUE - Center for User Experience | DAPIR -Data, Academic Planning & Institutional Research | LACE - Learning Analytics Center of Excellence | OUA - Office of Undergraduate Advising | SLA - Student Learning Assessment

    2024-2025

    • Sept. 13, 2024 - Getting started with learning analytics - LA CoP fall semester kickoff meeting [Kari Jordahl, LACE]
    • Sept. 20, 2024 - Data governance - why it matters and what it means for you [Data stewards: Dan Voeks, LACE & Mary K. Thompson, SLA] 
    • Oct. 11, 2024 - Exploratory and explanatory data processes: from developing insights to data stories - [Cid Freitag, CTLM]
    • Nov. 8, 2024 - Teaching & Learning Data/Data Practices Topic Hop - [Chad Shorter (SMPH), Mary K. Thompson (SLA), James McKay, Andrew Jason Turner, Andrew Reinke (Learn@UW); Lisa Jong, John Martin (CTLM), Sarah Zurawski (School of Education/OT), Christa Wille (Engineering) Dariane Drake, Chris Lalande (LACE)]
    • Dec. 13, 2024 - 5 Things for Improved Teaching & Learning Data (course organization and design)
    • Jan. 10, 2025 - TBD
    • Feb. 14, 2025 - TBD
    • Mar. 14, 2025 - TBD
    • Apr. 11, 2025 - TBD
    • May 2, 2025 (first Friday due to graduation)

    2023-2024

    • Oct. 13, 2023 - Data governance - why it matters and what it means for you [Data stewards: Dan Voeks, LACE & Mary K. Thompson, SLA] 
    • Nov. 10, 2023 -  Data collected from various tools in the Learn@UW suite of tools [James McKay, Andrew Reinke, Keegan Shaw, all with Learn@UW]
    • Dec. 8, 2023 - Explore Curricular Data with Tableau Visualizations (5 workbooks) [Clare Huhn, DAPIR]
    • Jan. 12, 2024 - Questions & Data [Cid Freitag, CTLM & Kari Jordahl, LACE]
    • Feb. 9, 2024 - What Can Learning Analytics and the Scholarship of Teaching and Learning (SoTL) Teach Us About Teaching? [Jonathan Gallimore, Psychology] 
    • March 8, 2024 - How can data support inclusive teaching? DEEP Microgrants for DEIB - we heard about 5 projects from the first 2 years of the program [Liza Chang & Diana Frantz Anderson, CALS; Sarah Zurawski, Occupational Therapy; Christa Wille, Engineering; Amanda Margolis, Pharmacy & Beth Janetski, Pharmacy]
    • April 12, 2024 - Empowering students - engagement & participatory design (My Learning Analytics "MyLA" pilot)
    • May 10, 2024 - Learning Analytics Now & Future [Cid Freitag, CTLM & Kari Jordahl, LACE]

    2022-2023

    • Sep. 9, 2022 - Getting Started with LA at the Start of Semester [team presentation]
    • Oct. 14, 2022 - Learning analytics for students - what do students want? [Chad Shorter, LACE & Maria Dahman, CUE]
    • Nov. 11, 2022 - Kaltura Analytics [Andrew Reinke, Learn@UW]
    • Dec. 9, 2022 - Leveraging the Review - Amend - Apply Framework [Cid Freitag, CTLM & Kari Jordahl, LACE]
    • Feb. 10, 2023: Data Empowered Educational Practices (DEEP) Overview [Kim Arnold, LACE, Jeff Shokler, OUA,  Mary K. Thompson, SLA]
    • March 10, 2023 - What do biases have to do with learning analytics? [Dariane Drake, LACE]
    • April 14, 2023- Student Perspectives/Capstone Projects from Educational Psychology MS in Learning Analytics program [Diana M. McFarland & Janae Winston, Educational Psychology MS-Learning Analytics Program]
    • May 12, 2023 - Emerging Themes and Topics from Spring Conferences [group discussion]

    2021-2022

    • Learner Engagement Analytics Dashboard Demo & Discussion - sessions were offered regularly [James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIt Academic Technology] 
    • Oct. 8, 2021 - Canvas Analytics & New Analytics [James McKay, Learn@UW; Kari Jordahl, LACE & Cid Freitag, CTLM]
    • Nov. 11, 2021 - Are you using LA? What data do you use in your teaching? FAQs about LA  [Kari Jordahl, Chad Shorter, Shannon Harris - all with LACE] 
    • Dec. 10, 2021 - Kaltura Analytics [Andrew Reinke, Learn@UW & David Macasaet, L&S Learning Support Solutions]
    • Jan. 14, 2022 - Course Design & Learning Analytics [Cid Freitag, CTLM & Kari Jordahl, LACE]
    • Feb. 11, 2022 - Identify Struggling Students [Cid Freitag, CTLM] 
    • March 11, 2022 - Direct Evidence of Student Learning (DESL) [Mary K. Thompson & Regina Lowery, SLA; Saundy Solum, Learn@UW]
    • April 8, 2022 - Reading data visualizations (that someone else created) [Cid Freitag, CTLM]
    • May 13, 2022 - Emerging Themes & Topics from Spring Conferences [group discussion]

    2020-2021

    Due to the pandemic and the launch of the Learner Engagement Analytics Dashboard (LEAD) -- which was offered enterprise-wide for instructors beginning fall semester 2020 -- the LA Community of Practice programming shifted to accommodate frequent online LEAD demos.  Additionally, the Learning Analytics Speaker Series was paused. (LEAD is currently not available due to significant changes in our local data infrastructure.
    • Learner Engagement Analytics Dashboard (LEAD) Demo & Discussion - sessions were offered frequently throughout the year [James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIT Academic Technology] 
    • Nov. 19, 2020 - Kaltura Analytics [Dan LaValley, Learn@UW]
    • Feb. 9, 2021 - Struggling Students [Cid Frietag, James McKay, Kim Arnold, Kari Jordahl, all with DoIT Academic Technology]
    • March 9, 2021 - How are you using learning analytics? FAQs about the Learner Engagement Analytics Dashboard (LEAD) [James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIT Academic Technology]
    • April 13, 2021 - Course review, reflection, planning for next time [Cid Freitag, Shannon Harris, Kari Jordahl, James McKay all with DoIT Academic Technology]
    • May 11, 2021 - Spring Conference Recaps [Sara Hagen, Engineering & Cid Freitag, Shannon Harris, Kim Arnold, Kari Jordahl all with DoIT Academic Technology] 
    • June 18, 2021 - Learning Analytics & Course Design (for Learning Design Community of Practice) [Kari Jordahl & Cid Freitag, DoIT Academic Technology]

    2019-2020 - Learning Analytics Speaker Series & LA CoP Events 

    • Sept. 18, 2019 - Game-Based Learning and Data Analytics (LA Speaker Series) [Mike Beall & Greg Vaughan, Gear Learning/Wisconsin Center for Educational Research]
    • Oct. 16, 2019 - Learner Engagement Analytics Dashboard (LEAD) [James McKay, Kari Jordahl, Shannon Harris, Cid Freitag, all with DoIT Academic Technology; pilot instructors]
    • Oct. 22, 2019 - Learning Analytics Guiding Principles: Supporting Students while Ethically Leveraging Data (LA Speaker Series) [Beth Martin, Pharmacy & Brian Yandell, CALS and Data Institute]   
    • Oct. 22, 2019 - Conversation with Dragan Gasevic [impromptu conversation with small group]  
    • Nov. 13, 2019 - Direct Evidence of Student Learning (DESL) (LA Speaker Series) [Mo Bischof & Regina Lowery, SLA & Saundy Solum, Learn@UW]
    • Nov. 21, 2019 - Kaltura MediaSpace  [Dan LaValley, Learn@UW ] 
    • Jan 28, 2020 - Canvas Analytics [Lynn Prost, Biochemistry & Lindy Stoll, Chemistry] 
    • Feb. 18, 2020 and Feb. 26, 2020 - Learner Engagement Analytics Dashboard (LEAD) [James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIt Academic Technology] 
    • March 12, 2020 - Data Doubles: What do students think about their privacy on campus? (LA Speaker Series) Recorded due to pandemic onset. [Dorothea Salo, the Information School]  

    2018 - Learning Analytics Speaker Series 

    The LA Speaker Series was initiated in spring semester, 2018.
    • Feb. 21, 2018 - Using Pattern to Log Course Activities [Miguel Garcia-Gosalvez, WI School of Business; Heather Kirkorian, School of Human Ecology, Kim Arnold & James McKay, DoIT Academic Technology]
    • March 20, 2018 - Data Visualizations & Infographics (it looks cool, but what is it telling you?)  [Cid Freitag, DoIT Academic Technology]
    • April 26, 2018 - Canvas Analytics: Instructor Perspectives on Course Analytics [Mark Millard, Engineering Professional Development; Catherine Arnott Smith, the Information School; Amanda Margolis, School of Pharmacy]
    • Sept. 18, 2018 - 6 ways to use Learning Analytics: a Functional Taxonomy [Sara Hagen, Engineering & Sarah Traynor, Anatomy]
    • Oct. 16, 2018 - The Importance of Meaning… Going Beyond Big Data (video) [David Williamson Shaffer, Educational Psychology]
    • Nov. 13, 2018 - Course-Level Dashboard & Analytics Beta [Garrett Smith, Kari Jordahl, James McKay from DoIT Academic Technology; Xizhou “Canoe” Xie, WI School of Business]

    Topics & Resources - by Calendar Year

    Scroll down or jump to resources from recent years. Topics are organized by calendar year, in date order (vs. by academic year). Resources and links will continue to be added. 

    2024  2023  2022  2021  2020 2019  2018 

    2024 LA CoP

    Jan. 12, 2024 | Questions & Data

    Facilitators: Cid Freitag, Center for Teaching, Learning & Mentoring (CTLM) | Kari Jordahl, Learning Analytics Center of Excellence (LACE)

    What questions do you have about the student experience? What data or information would help answer those questions, and are there strategies you can incorporate into your course to help you find answers? 

    Slides  |  Recording

    Feb. 9, 2024 | What Can Learning Analytics & the Scholarship of Teaching & Learning (SoTL) Teach Us About Teaching?

    Presenter: Jonathan Gallimore, Psychology 

    Jonathan shared his analysis and facilitated a conversation from considering questions in his course; for example, does attendance predict exam grades? Can students' access of course materials predict exam scores? How do late or missing assignments impact overall grades? 

    Slides  |  Recording 

    Mar. 8, 2024: How can data support inclusive teaching? DEEP Microgrants for DEIB

    Participants from both years of the program discussed their action research projects, and shared some of the lessons learned and impacts. They spoke about the questions they explored, the data they accessed, and the actions they took or are planning to take.

    • Liza Chang and Diana Frantz Anderson with CALS
    • Sarah Ann Zurawski with School of Education/OT
    • Christa Wille with Engineering (in collaboration with Kate Fu)
    • Amanda Margolis with Pharmacy (in collaboration with Andrea Porter)
    • Beth Janetski with Pharmacy (in collaboration with Casey Gallimore)

    Slides | Recording

    Apr. 12, 2024 | Empowering students - engagement & participatory design (My Learning Analytics "MyLA" pilot)

    Presenters: Kari Jordahl, Dan Voeks & Kim Arnold; Learning Analytics Center of Excellence (LACE)

    We have done numerous rounds of student engagement to find out what kinds of data might be useful for students. Find out more about what students have asked for, what types of approaches, tools and visualizations that students are interested in. We also discussed My Learning Analytics (MyLA), a student-facing tool that was created by the University of Michigan and that we're planning to pilot during fall semester.  

    Slides | Recording

    May 10, 2024 | Learning Analytics Now & Future

    Presenters:  Cid Freitag, CTLM & Kari Jordahl, LACE

    What resource, event or article has been impactful for you recently? We looked at a Big Ten Academic Alliance report about learning analytics efforts across numerous institutions, and briefly discussed several Unizin Summit sessions. Then we shifted towards thinking about AI and analytics, and looked at an example of a Tableau tool that uses AI.

    Here's some interesting questions and resources to explore: 

    • What are our peer institutions doing with learning analytics? UW-Madison is part of the Unizin Consortium and is also a member of the Big Ten Academic Alliance. 
    • Envisioning the future - AI is everywhere already- how do you see that intersecting more with learning analytics? Are you running into AI additions in the tools you use? 
      • The Instructure Community (Canvas) has an Artificial Intelligence in Education group with some interesting posts.
      • One tool example - Tableau is promoting their Einstein tool - to help ask queries. 
      • Check out this Kaltura blog from 2022 “AI in Education - All you Need to Know” which makes some good points, and is also not going to be all you need to know….
      • 2024 EDUCAUSE Horizon Action Plan: Unified Data Models - What is a unified data model for learning analytics, and why does it matter for higher education? What opportunities does it offer?  “Unified data models for learning analytics have been identified as one of the key technologies and practices anticipated to have a significant impact on the future of higher education. The 2024 Action Plan envisions a future.” 

    Shared notes | Recording

    Sept. 13, 2024 | Getting Started with Learning Analytics @UW-Madison

    Presenter:  Kari Jordahl, LACE

    We started out the fall semester talking about strategies for getting started working with learning analytics.

    • We reviewed the campus definition and cultural change model for LA, and looked at some examples of questions, data to help answer those questions, and potential actions that could be taken.
    • We considered different stakeholder groups - instructors, students and advisors - and their specific questions and needs.
    • We reviewed a framework for using learning analytics throughout the semester in a typical Canvas course, and some examples of where to find data for various questions.
    • We used Canvas New Analytics as an example, to see where to find answers to some common questions that instructors often have.
    • We also discussed ethical guidance around using learning analytics and talked about caveats and potential limitations of using analytics.

    Slides | Recording

    Resources & Opportunities:

    Sept. 20, 2024 | Data governance - why it matters and what it means for you

    Presenters: Dan Voeks, LACE & Mary K. Thompson, SLA

    Data stewards Dan and Mary provided an overview of what data governance is, and how it's structured and managed across UW-Madison. We heard about our institutional data policy and considered different types of data - institutional data, teaching and learning data, and student record data. Then we discussed some real-life situations about accessing and using data - what do you need to know when you're using data to support teaching and learning? We considered these scenarios and discussed things to consider for each one:

    1. You often work with student data in your area and have access to student data including grades as part of your role on campus. A close, trusted colleague wants access to the data.
    2. You are a campus instructor, and you want to engage students in the classroom by trying out a new software tool you found online.
    3. You are working closely with an instructor over the course of a semester on belonging and what that looks like for students in a large course. The instructor has become interested in publishing the data collected with you as a research paper.
    4. You have been asked by leadership to collect teaching and learning data about student performance by demographic groups. What are some questions you might want to pose and what are some of the risks you should consider?

    Please check out the slides/recording to see and hear thoughtful responses and the discussion.

    Slides  | Recording

    Resources

    Training 

    Oct. 11, 2024 | Exploratory and explanatory data processes: from developing insights to data stories

    Presenter: Cid Freitag, CTLM

    Cid Freitag from the Center for Teaching, Learning and Mentoring facilitated a discussion about exploratory and explanatory data analysis methods, emphasizing the role of visualizations for both methods. Exploratory analysis is about making meaning - finding insights, using analysis to view trends and relationships. Explanatory analysis is about a selected, specific view of the data that provides a message for an anticipated audience. We reviewed many examples of visualizations, and considered how they complement statistical analytics, can reveal patterns and lead to new insights. 

    We explored a hypothetical research process that began as an initial exploration of a dataset, walking through numerous steps and considering the role of visualizations in exploring the data through multiple types of visualizations. Moving from exploration to insights, checking the hypothesis and communicating to specific audiences involved multiple iterations and different visualizations and tools. A data storytelling framework provided a structure for creating visual communication that met the project goal and the audiences’ need - focusing attention on key points. 

    Slides | Recording 

    Resources: 

    Nov. 8, 2024 | T&L Data/Data Practices Topic Hop

    The goal for this session is to allow you to connect and discuss topics of interest during the one-hour meeting in small breakout rooms. We’re hoping the small group format will be a comfortable way to meet some new folks, discuss several topics of interest and learn something new about using teaching and learning data. You will be able to choose 3 sessions that interest you

    We’re still finalizing some of the details and topic descriptions, but we’re planning to have 6 ten-minute breakout sessions over the one hour meeting. Potential discussion topics include:

    • Assessment and Evaluation - When are surveys helpful? What can surveys do well/not do well? 
    • Using Learn@UW Tools and T&L Data - What kinds of data can you get from X tool? What are common problems or questions instructors come to you for that X tool can help solve?
    • Active Learning and Classroom Observations - How can I structure classroom activities that facilitate learning and generate useful data? How does classroom observation work? Does it benefit students or instructors? 
    • Teaching and Learning Data Environment - What are common questions that our T&L data could help instructors answer? What are some challenges to answering certain questions due to our T&L data environment?
    • Measuring Student Team Dynamics - What is a challenge or a lesson learned while working with student teams? Some ideas for thinking about group work, how to iterate/improve on it, and measure its effectiveness.
    • T&L Project Iteration and Transparency - What is a challenge faced or a lesson learned while improving the T&L in class? How to iterate on a T&L project? How to continue to engage with students and be transparent about this work?

    Dec. 13, 2024 | 5 Things for Improved Teaching & Learning Data

    [More details will be provided soon]

     

    To the top

    2023 LA CoP

    Feb. 10, 2023 | Data Empowered Educational Practices (DEEP) Overview

    Presenters: Kim Arnold, Learning Analytics Center of Excellence (LACE) | Jeff Shokler, Office of Academic & Career Success (OACS) | Mary K. Thompson, Student Learning Assessment (SLA)

    We discussed the high-level organization and structure of the DEEP framework, and heard updates about a couple of the working groups and their projects.

    Slides | Recording

    Mar. 10, 2023 | What do biases have to do with learning analytics?

    Presenter: Dariane Drake, Learning Analytics Center of Excellence (LACE)

    Dariane talked about types of biases and helped us consider how we learn and reinforce them. We looked at case studies and examples, and reviewed tips for increasing awareness.

    Slides | Recording 

    Apr. 14, 2023 | Student perspectives/capstone project sharing from Educational Psychology MS in Learning Analytics

    Presenters: Diana M. McFarland & Janae Winston, Educational Psychology MS program in Learning Analytics

    We heard from two students in the first cohort of the Educational Psychology MS program on learning analytics: Diana Marie McFarland and Janae Winston. They shared their capstone projects and reflected on their unique perspectives with learning analytics.

    Slides | Recording

    May 12, 2024 | Emerging Themes and Topics from Spring Conferences 

    Group discussion 

    We created a google doc and shared notes, insights and links and heard about the microgrant program, the Unizin Spring meeting, several NYU LEARN recent events about subversive LA and equity oriented LA.

    Shared notes | Recording 

    Oct. 13, 2023 | Data Governance - why it matters and what it means for you

    Presenters: Dan Voeks, Learning Analytics Center of Excellence (LACE) |  Mary K. Thompson, Student Learning Assessment (SLA)

    Dan and Mary provided a brief review/introduction to our institutional data policy and data governance, and then we spent the rest of the session discussing and considering some real-life situations. For example: 

    • You often work with student data and have access to student data, including grades as part of your role on campus. A close, trusted colleague wants access to the data. What are some things to consider? 
    • You are a campus instructor and you want to engage students in the classroom by trying out a new software tool you found online. What are some things to consider?

    Slides | Recording

    Nov. 10, 2023 | Learning Analytics in our Learn@UW Tools - Quick Tour

    Presenters: James McKay, Learn@UW  | Andrew Reinke, Learn@UW |  Keegan Shaw, Learn@UW 

    James McKay showed us Piazza (for discussions); Canvas Analytics & New Analytics (which are no longer new but still branded that way); and TopHat (student response system).  

    •  Piazza starts at 8:45 mins
    •  Canvas Analytics/New Analytics - starts around 13.25 mins
    •  TopHat starts at 24 mins

    Andrew Reinke provided an overview about Kaltura Analytics, and showed us a couple of ways to access analytics which varies based on how you’ve embedded media into your course. He shared slides and a Kaltura terminology doc as additional resources.

    • Kaltura Analytics starts at 27:56 min

    Keegan Shaw discussed Atomic Assessments analytics, which integrates directly into Canvas and offers advanced quizzing functionality.

    • Atomic Assessments - starts at 41 mins

    Slides | Recording 

    Dec. 8, 2023 | Exploring Course-Level Data in Tableau Visualizations

    Presenter: Clare Huhn, Data, Academic Planning & Institutional Research (DAPIR)

    Clare reviewed the overall structure of Tableau and how to access UW-Madison workbooks. These institutional resources can answer a variety of questions, for example: how are curricular subjects related to departments? What are the learning outcomes for a course? Are there differences in average grades between terms? Are there gaps in D/F/drop rates by demographic groups? 

    You have access to the workbooks we explored with your UW-Madison credentials from either RADAR or the Tableau server web pages (you must use VPN if you are not on campus). Here's the workbooks we explored:

      • UW-Madison Academic Structure
      • UW-Madison Course Catalog 
      • Course Grade Distribution
      • Undergraduate Course D/F/Drop Rates
      • Courses Completed by Bachelor’s Degree Recipients
      • Course Demographics Profile

    Slides | Recording

    LEAD Demo & Discussion

    Presenters: James McKay (Learn@UW); Kari Jordahl & Shannon Harris (LACE)

    Sessions were offered periodically.

    We explored the three visualizations in the Learner Engagement Analytics Dashboard (LEAD), and how to filter data to answer questions about courses, teaching, and students' activity in a  course. LEAD aggregates data from Canvas, Kaltura and Unizin Engage eText and offers unique insights about for-credit courses.

    Slides (no recording)

     

    2022 LA CoP & LEAD Demos

    Jan. 14, 2022 | Course Design & LA

    Presenters: Kari Jordahl, Learning Analytics Center of Excellence | Cid Freitag, Center for Teaching, Learning & Mentoring

    How you design your course will affect what data you can see in various learning analytics tools. In this session we discussed tips for designing a course to help create useful data, including; 

    • Review and reflect; what is your question? What tools/data are available?
    • Identify a pivotal assignment or time in the course
    • Use logical naming conventions and clear navigation
    • Reminders about how to link to content (eg. Kaltura videos)

    We also discussed using course blueprints or instructional design frameworks (Horton’s Absorb - Do - Connect) when designing a course, to ensure learning analytics is part of the overall course design and strategy.

    Resources:

    Slides | Recording 

    Feb. 11, 2022 | Identify struggling students

    Presenter: Cid Freitag, Center for Teaching, Learning & Mentoring

    The Learner Engagement Analytics Dashboard (LEAD) can help identify students who may be struggling. Which visualization is most useful for you? Do you use other tools or methods to identify struggling students? 

    Cid facilitated a discussion about how to translate data into action - using a framework that discussed Canvas tools and achievable actions - before the course starts, at the beginning of the term, during the term, and after the end of the course.  (Muljana, Pauline Salim, and Greg Placencia. "Learning analytics: Translating data into “just-in-time” interventions." Scholarship of Teaching and Learning, Innovative Pedagogy 1.1 (2018): 6.)

    Slides| Recording

    Mar. 11, 2022 | Direct Evidence of Student Learning (DESL)

    Presenters: Mary K. Thompson, Student Learning Assessment  | Saundy Solum, DoIT Academic Technology | Regina Lowery, Student Learning Assessment

    Direct evidence of student learning (DESL) is an assessment approach that allows instructors to evaluate learning based on student performance on tasks directly connected to course learning outcomes. We learned how Canvas assignments can be linked to AEFIS Course Learning Outcomes, or CLOs and saw a demo of AEFIS. We also discussed the difference between grading and assessment, formative and summative assessment, the benefits of DESL, and how to get started using it. 

    Slides | Recording 

    Apr. 8, 2022 | Reading data visualizations (that someone else created)

    Presenter: Cid Freitag, Center for Teaching, Learning & Mentoring (CTLM)

    This session focused on one aspect of data literacy — being a consumer of data visualization products, such as those in the news, popular media, and data dashboards. By analyzing a visualization we focused on making meaning and thinking critically about the meaning and message it represents — preparing us to become a better consumers of visualizations. 

    Slides | Recording 

    May 13, 2022 | Spring Conferences; Reflections & Emerging Themes

    Group discussion 

    Spring conference season - what themes and new ideas were hot topics at events that you've attended (or that you wished you could attend)? Whether you had a chance to attend LAK'22 in March, the Unizin Summit in late April or the Indiana University LA Summit in mid-May (or other sessions we've missed) this conversation was open for all to share.

    Shared notes | Recording 

    Sept. 16, 2022 | Fall Semester Kickoff Meeting 

    Facilitators/presenters - team presentation facilitated by Kari Jordahl; Dan Voeks, Learning Analytics Center of Excellence | Shannon Harris, Learning Analytics Center of Excellence | Mary K. Thompson, Student Learning Assessment n

    At this session we spent a little time providing information and updates on the LA landscape at UW-Madison, including the DEEP framework and our institutional data policy, and transparency around using data. We learned about enhancements for the Learner Engagement Analytics Dashboard (LEAD) and heard about Direct Evidence of Student Learning (DESL). We shared information about the new microgrant program - for exploring data-empowered educational practices/learning analytics in support of diversity, equity, inclusion and belonging. We also discussed the schedule and planned topics for fall LA CoP, while soliciting ideas for later sessions. 

    Slides | Recording

    Oct. 14, 2022 | Learning Analytics for Students - what do students want? 

    Presenters: Chad Shorter, Learning Analytics Center of Excellence (LACE)  |  Maria Dahmen, Center for User Experience (CUE)

    What types of learning analytics do students want? How do we empower students to use data about them, to support their own learning? 

    We discussed what UW-Madison students think about learning analytics - what types of data and visualizations do they think are useful? How do they feel about data about them being used, when it’s used to support their learning? DoIT Academic Technology conducted several phases of student engagement over the past couple of years and this combined feedback from across those efforts.

    Slides  |  Recording 

    Nov. 11, 2022 | Understanding Kaltura Analytics

    Presenter: Andrew Reinke, Learn@UW 

    There are numerous ways to incorporate media into your course, and the analytics you can access will vary, based on your approach.  

    • Individual media analytics
    • Mediaspace My Analytics dashboard
    • Canvas embedding options for best analytics
    • Kaltura Gallery in Canvas Analytics
    • Interactive video quizzes (for self-check/not for gradebook integration) 

    Slides  |  Recording

    Dec. 9, 2022 | Leveraging the Review-Amend-Apply Framework for LA

    Presenters: Cid Freitag, Center for Teaching, Learning & Mentoring (CTLM) | Kari Jordahl, Learning Analytics Center of Excellence (LACE)

    We looked at a framework that can be used for learning analytics approaches. The Review-Amend-Apply framework (created at Indiana University) provides a useful and very approachable 3-step process. We discussed how it aligns (or doesn't align exactly) with the UW-Madison approach for learning analytics which focuses on a question that leads to data that leads to action.

    • Review the information available to you about your students' behavior, your course, your teaching
    • Amend the information you've gathered - are there other resources or sources of data? 
    • Apply what you've learned - what modification or change might help? Consider evidence-based teaching practices. 

    Slides | Recording

    LEAD Demos & Discussion

    Presenters: James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIT Academic Technology

    Sessions were offered frequently throughout the year.  

    We explored the three visualizations in the Learner Engagement Analytics Dashboard (LEAD), and how to filter data to answer questions about courses, teaching, and students' activity in a  course. LEAD aggregates data from Canvas, Kaltura and Unizin Engage eText and offers unique insights about for-credit courses.

    Slides (no recording)

     To the top 

    2021 LA CoP & LEAD Demos

    Due to the pandemic and the launch of the Learner Engagement Analytics Dashboard (LEAD) -- which was offered enterprise-wide for instructors beginning fall semester 2020 -- the LA Community of Practice programming shifted to accommodate frequent online LEAD demos.  Additionally, the Learning Analytics Speaker Series was paused. (LEAD is currently not available due to significant changes in our local data infrastructure.

    Learner Engagement Analytics Dashboard (LEAD) Demos & Discussion

    Presenters: James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIT Academic Technology

    Sessions were offered frequently throughout the year.  

    We explored the three visualizations in the Learner Engagement Analytics Dashboard (LEAD), and how to filter data to answer questions about courses, teaching, and students' activity in a  course. LEAD aggregates data from Canvas, Kaltura and Unizin Engage eText and offers unique insights about for-credit courses.

    Slides (no recording)

    Feb. 9, 2021 | Student engagement - identify struggling students

    Presenter: Cid Freitag, CTLM

    We focused on student engagement in a course, and identifying struggling students using LEAD visualizations. How can learning analytics help you identify students who may need more support? We also discussed actions you can take in Canvas throughout various times in the semester, to support students. 

    (Muljana, Pauline Salim, and Greg Placencia. "Learning analytics: Translating data into “just-in-time” interventions." Scholarship of Teaching and Learning, Innovative Pedagogy 1.1 (2018): 6.)

    Slides (no recording)

    March 9, 2021 | How are you using learning analytics? FAQs about LEAD

    Presenters: Cid Freitag, Kari Jordahl, James McKay, Shannon Harris, all with DoIT Academic Technology

    Do you use LEAD, Canvas New Analytics or Kaltura Analytics? Are you using Engage or other e-texts? We looked at some commonly asked questions about learning analytics and the Learner Engagement Analytics Dashboard (LEAD). 

    Slides (no recording)

    April 13, 2021 | Course review, reflection, planning for next time

    Presenters: Cid Freitag, Kari Jordahl, James McKay, Shannon Harris, all with DoIT Academic Technology

    What worked well this semester? Are there changes you’d like to consider making in your course? Do you have instructional design strategies that worked well to leverage learning analytics? Interrogate your course data to discover which resources were most/least used, what times students accessed course content and activities. What strategies might help support teaching and learning?

    Google doc (no recording)

    May 11, 2021 | Spring Conference Recaps

    Contributors: group discussion

    Many spring conferences have learning analytics tracks or areas of focus, and one pandemic upside is that we can attend more conferences. This group discussion includesd updates from the Learning Analytics & Knowledge (LAK) conference, and the Unizin Summit 2021

    Shared notes doc, links out to more resources (no recording)

    June 18, 2021 | Learning Analytics & Course Design (presented at Learning Design CoP)

    Presenters: Kari Jordahl, LACE & Cid Freitag, CTLM

    We facilitated a session at the Learning Design Community of Practice focusing on LA and course design. The learning analytics landscape and recent efforts at UW-Madison were discussed, and then we looked at analytics in tools that instructional designers typically have access to - eg. Canvas Analytics & New Analytics, Kaltura, etc. 

    Slides  | (no recording)

    Oct. 8, 2021 | Canvas Analytics & New Analytics - Explore your own course

    Presenters: James McKay, Learn@UW; Kari Jordahl, LACE & Cid Freitag, CTLM

    Have you explored learning analytics options available in Canvas? There are several locations in Canvas where you can access analytics, to answer questions you might have about your course and your students.

    Slides | (no recording)

    Nov. 11, 2021 | Are you using learning analytics? What data do you use in your teaching? FAQs about LA

    Presenters:  Kari Jordahl, Chad Shorter, Shannon Harris, all with Learning Analytics Center of Excellence (LACE)

    This was a more general discussion around the use of learning analytics broadly. We discussed various ways to use learning analytics and talked about how course design impacts analytics, how analytics can provide insights and help you answer some questions, while potentially leading to more questions.

    Slides  | Recording

    Dec. 10, 2021 | Kaltura Analytics

    Presenters: Andrew Reinke, Learn@UW & David Macasaet, L&S Learning Support Solutions 

    We looked at several ways to incorporate media into a course with Andrew Reinke, and then looked at the visualizations and analytics that result from various methods.

    David Macasaet discussed how he used Kaltura Analytics to review student engagement with video content in his course, and how student engagement improved after he made several modifications to the content.

    Slides  | Recording

    To the top 

    2020 - LA Speaker Series ~ LA CoP ~ LEAD Demos

    Programming changed during 2020. Due to the pandemic and the launch of the Learner Engagement Analytics Dashboard (LEAD), which was offered enterprise-wide for instructors beginning fall semester 2020 - LA Community of Practice programming shifted to accommodate frequent online LEAD demos.  Additionally, the Learning Analytics Speaker Series was paused. (LEAD is currently not available due to significant changes in our local data infrastructure.

     To the top 

    2019 - LA Speaker Series & LA CoP

     To the top 

    2018 - LA Speaker Series

     To the top 



    KeywordsLA CoP, resources   Doc ID132358
    OwnerKari J.GroupLearning Analytics
    Created2023-10-27 05:07:33Updated2024-11-01 12:47:44
    SitesLearn@UW-Madison, Learning Analytics
    Feedback  0   0