Learning Analytics Community of Practice - Resources
We meet virtually (throughout the academic year) on the 2nd Friday of each month from 12:00 - 1:00 (CT) in the LA Community of Practice Meetings channel. (Join the UW-Madison Learning Analytics team for more info and to receive calendar invitations.)
More about the LA CoP & where to participate
The Learning Analytics CoP is designed to connect colleagues across campus in sharing learning analytics experiences. You are invited to share what you’ve learned and learn from your peers. These informal sessions provide an opportunity to discuss strategies using LA in educational practices, and focus on various questions and topics.
- We meet virtually (throughout the academic year) usually on the 2nd Friday of each month from 12:00 - 1:00 (CT) in the LA Community of Practice Meetings channel. (Join the UW-Madison Learning Analytics team for more info and to receive calendar invitations. Dates will occasionally be modified due to the academic calendar or presenter availability)
- We are always open to idea for topics! If you would like to suggest a topic or share about work you are doing, please email kari.jordahl@wisc.edu
You do not have to be an expert to participate! Students, staff, instructors, leadership, and others in educational roles are all welcome to attend; whether you are just starting to explore using learning analytics or have experience using learning analytics in your teaching, learning or advising practice.
- UW-Madison employees and students can also access the most recent resources in the UW-Madison Learning Analytics team, in the LA Community of Practice Meetings channel.
- A shared google folder has resources from several years that you can access with your UW-Madison login.
Background
The LA CoP has been meeting virtually in Teams since fall 2020, after meeting in person since 2018. Topics have been recorded for the past few years; slides or other meeting resources are provided for earlier sessions that were not recorded. (Note: You must have UW-Madison credentials to access slides and recordings.)
Some earlier sessions were offered as part of the Learning Analytics Speakers Series. The LA CoP and the LA Speaker Series merged together, and sessions listed below include both event types.
Topics by Academic Year (high-level list)
More details and links to resources are available below (in the calendar year sections).
Key to acronyms: CTLM - Center for Teaching, Learning & Mentoring | CUE - Center for User Experience | DAPIR -Data, Academic Planning & Institutional Research | LACE - Learning Analytics Center of Excellence | OUA - Office of Undergraduate Advising | SLA - Student Learning Assessment
2024-2025
- Sept. 13, 2024 - Getting started with learning analytics - LA CoP fall semester kickoff meeting [Kari Jordahl, LACE]
- Sept. 20, 2024 - Data governance - why it matters and what it means for you [Data stewards: Dan Voeks, LACE & Mary K. Thompson, SLA]
- Oct. 11, 2024 - Exploratory and explanatory data processes: from developing insights to data stories - [Cid Freitag, CTLM]
- Nov. 8, 2024 - Teaching & Learning Data/Data Practices Topic Hop - [Chad Shorter (SMPH), Mary K. Thompson (SLA), James McKay, Andrew Jason Turner, Andrew Reinke (Learn@UW); Lisa Jong, John Martin (CTLM), Sarah Zurawski (School of Education/OT), Christa Wille (Engineering) Dariane Drake, Chris Lalande (LACE)]
- Dec. 13, 2024 - 5 Things for Improved Teaching & Learning Data (course organization and design)
- Jan. 10, 2025 - TBD
- Feb. 14, 2025 - TBD
- Mar. 14, 2025 - TBD
- Apr. 11, 2025 - TBD
- May 2, 2025 (first Friday due to graduation)
2023-2024
- Oct. 13, 2023 - Data governance - why it matters and what it means for you [Data stewards: Dan Voeks, LACE & Mary K. Thompson, SLA]
- Nov. 10, 2023 - Data collected from various tools in the Learn@UW suite of tools [James McKay, Andrew Reinke, Keegan Shaw, all with Learn@UW]
- Dec. 8, 2023 - Explore Curricular Data with Tableau Visualizations (5 workbooks) [Clare Huhn, DAPIR]
- Jan. 12, 2024 - Questions & Data [Cid Freitag, CTLM & Kari Jordahl, LACE]
- Feb. 9, 2024 - What Can Learning Analytics and the Scholarship of Teaching and Learning (SoTL) Teach Us About Teaching? [Jonathan Gallimore, Psychology]
- March 8, 2024 - How can data support inclusive teaching? DEEP Microgrants for DEIB - we heard about 5 projects from the first 2 years of the program [Liza Chang & Diana Frantz Anderson, CALS; Sarah Zurawski, Occupational Therapy; Christa Wille, Engineering; Amanda Margolis, Pharmacy & Beth Janetski, Pharmacy]
- April 12, 2024 - Empowering students - engagement & participatory design (My Learning Analytics "MyLA" pilot)
- May 10, 2024 - Learning Analytics Now & Future [Cid Freitag, CTLM & Kari Jordahl, LACE]
2022-2023
- Sep. 9, 2022 - Getting Started with LA at the Start of Semester [team presentation]
- Oct. 14, 2022 - Learning analytics for students - what do students want? [Chad Shorter, LACE & Maria Dahman, CUE]
- Nov. 11, 2022 - Kaltura Analytics [Andrew Reinke, Learn@UW]
- Dec. 9, 2022 - Leveraging the Review - Amend - Apply Framework [Cid Freitag, CTLM & Kari Jordahl, LACE]
- Feb. 10, 2023: Data Empowered Educational Practices (DEEP) Overview [Kim Arnold, LACE, Jeff Shokler, OUA, Mary K. Thompson, SLA]
- March 10, 2023 - What do biases have to do with learning analytics? [Dariane Drake, LACE]
- April 14, 2023- Student Perspectives/Capstone Projects from Educational Psychology MS in Learning Analytics program [Diana M. McFarland & Janae Winston, Educational Psychology MS-Learning Analytics Program]
- May 12, 2023 - Emerging Themes and Topics from Spring Conferences [group discussion]
2021-2022
- Learner Engagement Analytics Dashboard Demo & Discussion - sessions were offered regularly [James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIt Academic Technology]
- Oct. 8, 2021 - Canvas Analytics & New Analytics [James McKay, Learn@UW; Kari Jordahl, LACE & Cid Freitag, CTLM]
- Nov. 11, 2021 - Are you using LA? What data do you use in your teaching? FAQs about LA [Kari Jordahl, Chad Shorter, Shannon Harris - all with LACE]
- Dec. 10, 2021 - Kaltura Analytics [Andrew Reinke, Learn@UW & David Macasaet, L&S Learning Support Solutions]
- Jan. 14, 2022 - Course Design & Learning Analytics [Cid Freitag, CTLM & Kari Jordahl, LACE]
- Feb. 11, 2022 - Identify Struggling Students [Cid Freitag, CTLM]
- March 11, 2022 - Direct Evidence of Student Learning (DESL) [Mary K. Thompson & Regina Lowery, SLA; Saundy Solum, Learn@UW]
- April 8, 2022 - Reading data visualizations (that someone else created) [Cid Freitag, CTLM]
- May 13, 2022 - Emerging Themes & Topics from Spring Conferences [group discussion]
2020-2021
Due to the pandemic and the launch of the Learner Engagement Analytics Dashboard (LEAD) -- which was offered enterprise-wide for instructors beginning fall semester 2020 -- the LA Community of Practice programming shifted to accommodate frequent online LEAD demos. Additionally, the Learning Analytics Speaker Series was paused. (LEAD is currently not available due to significant changes in our local data infrastructure.- Learner Engagement Analytics Dashboard (LEAD) Demo & Discussion - sessions were offered frequently throughout the year [James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIT Academic Technology]
- Nov. 19, 2020 - Kaltura Analytics [Dan LaValley, Learn@UW]
- Feb. 9, 2021 - Struggling Students [Cid Frietag, James McKay, Kim Arnold, Kari Jordahl, all with DoIT Academic Technology]
- March 9, 2021 - How are you using learning analytics? FAQs about the Learner Engagement Analytics Dashboard (LEAD) [James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIT Academic Technology]
- April 13, 2021 - Course review, reflection, planning for next time [Cid Freitag, Shannon Harris, Kari Jordahl, James McKay all with DoIT Academic Technology]
- May 11, 2021 - Spring Conference Recaps [Sara Hagen, Engineering & Cid Freitag, Shannon Harris, Kim Arnold, Kari Jordahl all with DoIT Academic Technology]
- June 18, 2021 - Learning Analytics & Course Design (for Learning Design Community of Practice) [Kari Jordahl & Cid Freitag, DoIT Academic Technology]
2019-2020 - Learning Analytics Speaker Series & LA CoP Events
- Sept. 18, 2019 - Game-Based Learning and Data Analytics (LA Speaker Series) [Mike Beall & Greg Vaughan, Gear Learning/Wisconsin Center for Educational Research]
- Oct. 16, 2019 - Learner Engagement Analytics Dashboard (LEAD) [James McKay, Kari Jordahl, Shannon Harris, Cid Freitag, all with DoIT Academic Technology; pilot instructors]
- Oct. 22, 2019 - Learning Analytics Guiding Principles: Supporting Students while Ethically Leveraging Data (LA Speaker Series) [Beth Martin, Pharmacy & Brian Yandell, CALS and Data Institute]
- Oct. 22, 2019 - Conversation with Dragan Gasevic [impromptu conversation with small group]
- Nov. 13, 2019 - Direct Evidence of Student Learning (DESL) (LA Speaker Series) [Mo Bischof & Regina Lowery, SLA & Saundy Solum, Learn@UW]
- Nov. 21, 2019 - Kaltura MediaSpace [Dan LaValley, Learn@UW ]
- Jan 28, 2020 - Canvas Analytics [Lynn Prost, Biochemistry & Lindy Stoll, Chemistry]
- Feb. 18, 2020 and Feb. 26, 2020 - Learner Engagement Analytics Dashboard (LEAD) [James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIt Academic Technology]
- March 12, 2020 - Data Doubles: What do students think about their privacy on campus? (LA Speaker Series) Recorded due to pandemic onset. [Dorothea Salo, the Information School]
2018 - Learning Analytics Speaker Series
The LA Speaker Series was initiated in spring semester, 2018.- Feb. 21, 2018 - Using Pattern to Log Course Activities [Miguel Garcia-Gosalvez, WI School of Business; Heather Kirkorian, School of Human Ecology, Kim Arnold & James McKay, DoIT Academic Technology]
- March 20, 2018 - Data Visualizations & Infographics (it looks cool, but what is it telling you?) [Cid Freitag, DoIT Academic Technology]
- April 26, 2018 - Canvas Analytics: Instructor Perspectives on Course Analytics [Mark Millard, Engineering Professional Development; Catherine Arnott Smith, the Information School; Amanda Margolis, School of Pharmacy]
- Sept. 18, 2018 - 6 ways to use Learning Analytics: a Functional Taxonomy [Sara Hagen, Engineering & Sarah Traynor, Anatomy]
- Oct. 16, 2018 - The Importance of Meaning… Going Beyond Big Data (video) [David Williamson Shaffer, Educational Psychology]
- Nov. 13, 2018 - Course-Level Dashboard & Analytics Beta [Garrett Smith, Kari Jordahl, James McKay from DoIT Academic Technology; Xizhou “Canoe” Xie, WI School of Business]
Topics & Resources - by Calendar Year
Scroll down or jump to resources from recent years. Topics are organized by calendar year, in date order (vs. by academic year). Resources and links will continue to be added.
2024 2023 2022 2021 2020 2019 2018
2024 LA CoP
Jan. 12, 2024 | Questions & Data
Facilitators: Cid Freitag, Center for Teaching, Learning & Mentoring (CTLM) | Kari Jordahl, Learning Analytics Center of Excellence (LACE)
What questions do you have about the student experience? What data or information would help answer those questions, and are there strategies you can incorporate into your course to help you find answers?
Feb. 9, 2024 | What Can Learning Analytics & the Scholarship of Teaching & Learning (SoTL) Teach Us About Teaching?
Presenter: Jonathan Gallimore, Psychology
Jonathan shared his analysis and facilitated a conversation from considering questions in his course; for example, does attendance predict exam grades? Can students' access of course materials predict exam scores? How do late or missing assignments impact overall grades?
Mar. 8, 2024: How can data support inclusive teaching? DEEP Microgrants for DEIB
Participants from both years of the program discussed their action research projects, and shared some of the lessons learned and impacts. They spoke about the questions they explored, the data they accessed, and the actions they took or are planning to take.
- Liza Chang and Diana Frantz Anderson with CALS
- Sarah Ann Zurawski with School of Education/OT
- Christa Wille with Engineering (in collaboration with Kate Fu)
- Amanda Margolis with Pharmacy (in collaboration with Andrea Porter)
- Beth Janetski with Pharmacy (in collaboration with Casey Gallimore)
Apr. 12, 2024 | Empowering students - engagement & participatory design (My Learning Analytics "MyLA" pilot)
Presenters: Kari Jordahl, Dan Voeks & Kim Arnold; Learning Analytics Center of Excellence (LACE)
We have done numerous rounds of student engagement to find out what kinds of data might be useful for students. Find out more about what students have asked for, what types of approaches, tools and visualizations that students are interested in. We also discussed My Learning Analytics (MyLA), a student-facing tool that was created by the University of Michigan and that we're planning to pilot during fall semester.
May 10, 2024 | Learning Analytics Now & Future
Presenters: Cid Freitag, CTLM & Kari Jordahl, LACE
What resource, event or article has been impactful for you recently? We looked at a Big Ten Academic Alliance report about learning analytics efforts across numerous institutions, and briefly discussed several Unizin Summit sessions. Then we shifted towards thinking about AI and analytics, and looked at an example of a Tableau tool that uses AI.
Here's some interesting questions and resources to explore:
- What are our peer institutions doing with learning analytics? UW-Madison is part of the Unizin Consortium and is also a member of the Big Ten Academic Alliance.
- Check out the Big Ten Academic Alliance Learning Analytics Interest Group Landscape Report to learn more about how LA is supported and organized, tools and approaches, programming, and opportunities and barriers.
- Did you attend the Unizin Summit? This year we heard about tools and approaches to support students, instructors and advisors, along with how AI is being incorporated in teaching. Recordings are available on YouTube.
- Envisioning the future - AI is everywhere already- how do you see that intersecting more with learning analytics? Are you running into AI additions in the tools you use?
- The Instructure Community (Canvas) has an Artificial Intelligence in Education group with some interesting posts.
- One tool example - Tableau is promoting their Einstein tool - to help ask queries.
- Check out this Kaltura blog from 2022 “AI in Education - All you Need to Know” which makes some good points, and is also not going to be all you need to know….
- 2024 EDUCAUSE Horizon Action Plan: Unified Data Models - What is a unified data model for learning analytics, and why does it matter for higher education? What opportunities does it offer? “Unified data models for learning analytics have been identified as one of the key technologies and practices anticipated to have a significant impact on the future of higher education. The 2024 Action Plan envisions a future.”
Sept. 13, 2024 | Getting Started with Learning Analytics @UW-Madison
Presenter: Kari Jordahl, LACE
We started out the fall semester talking about strategies for getting started working with learning analytics.
- We reviewed the campus definition and cultural change model for LA, and looked at some examples of questions, data to help answer those questions, and potential actions that could be taken.
- We considered different stakeholder groups - instructors, students and advisors - and their specific questions and needs.
- We reviewed a framework for using learning analytics throughout the semester in a typical Canvas course, and some examples of where to find data for various questions.
- We used Canvas New Analytics as an example, to see where to find answers to some common questions that instructors often have.
- We also discussed ethical guidance around using learning analytics and talked about caveats and potential limitations of using analytics.
Resources & Opportunities:
- Getting started with learning analytics:
- What are the pedagogical uses of learning analytics?
- Learning Analytics Guiding Principles - review the four principles, along with stakeholder responsibilities, data that's in-scope and out-of-scope for learning analytics.
- Share the Teaching & Learning Data Transparency Statement with students to make sure they are informed about how data is used and protected.
- Peruse the Knowledge Base for learning analytics topics and specific tool analytics, including Canvas New Analytics and Kaltura Analytics.
- Find out about various approaches and review examples of learning analytics in practice
- Explore the Learning Analytics Functional Taxonomy, for 6 different approaches for LA; each category has UW-Madison examples, and also links to other institutional examples.
- Participate in other Learning Analytics Community of Practice sessions (offered monthly during the academic year, generally the 2nd Friday of each month)
- Access resources from past sessions, including a session summary and links to the slides and recordings. Learn more about topics that you've missed.
- Join the UW-Madison Learning Analytics Team - share information about events, projects, LA in the news.
- Request a consultation - contact the Help Desk
- Find out more about the Learning Analytics Center of Excellence (LACE)
Sept. 20, 2024 | Data governance - why it matters and what it means for you
Presenters: Dan Voeks, LACE & Mary K. Thompson, SLA
Data stewards Dan and Mary provided an overview of what data governance is, and how it's structured and managed across UW-Madison. We heard about our institutional data policy and considered different types of data - institutional data, teaching and learning data, and student record data. Then we discussed some real-life situations about accessing and using data - what do you need to know when you're using data to support teaching and learning? We considered these scenarios and discussed things to consider for each one:
- You often work with student data in your area and have access to student data including grades as part of your role on campus. A close, trusted colleague wants access to the data.
- You are a campus instructor, and you want to engage students in the classroom by trying out a new software tool you found online.
- You are working closely with an instructor over the course of a semester on belonging and what that looks like for students in a large course. The instructor has become interested in publishing the data collected with you as a research paper.
- You have been asked by leadership to collect teaching and learning data about student performance by demographic groups. What are some questions you might want to pose and what are some of the risks you should consider?
Please check out the slides/recording to see and hear thoughtful responses and the discussion.
Resources
- Access the Data Governance, Academic Planning & Institutional Research (DAPIR) page to learn more about Data Governance. The Data Governance dropdown provides access to a program overview, descriptions of the various data domains across campus and their data trustees and data stewards. Links to policy and training opportunities are also provided.
- Review guidance around using learning analytics and teaching and learning data.
Training
- Numerous learning opportunities are posted on the Data Literacy & Training page (all online).
- Data@UW: Data Governance and Responsible Use - online course in Canvas - self-register to access this asynchronous, brief course.
- Data Literacy track
- Data Management track
- Links to other training - eg. FERPA, HIPAA, Cybersecurity and more.
Oct. 11, 2024 | Exploratory and explanatory data processes: from developing insights to data stories
Presenter: Cid Freitag, CTLM
Cid Freitag from the Center for Teaching, Learning and Mentoring facilitated a discussion about exploratory and explanatory data analysis methods, emphasizing the role of visualizations for both methods. Exploratory analysis is about making meaning - finding insights, using analysis to view trends and relationships. Explanatory analysis is about a selected, specific view of the data that provides a message for an anticipated audience. We reviewed many examples of visualizations, and considered how they complement statistical analytics, can reveal patterns and lead to new insights.
We explored a hypothetical research process that began as an initial exploration of a dataset, walking through numerous steps and considering the role of visualizations in exploring the data through multiple types of visualizations. Moving from exploration to insights, checking the hypothesis and communicating to specific audiences involved multiple iterations and different visualizations and tools. A data storytelling framework provided a structure for creating visual communication that met the project goal and the audiences’ need - focusing attention on key points.
Resources:
- Yi, Ji Soo, et al. "Understanding and characterizing insights: how do people gain insights using information visualization?." Proceedings of the 2008 Workshop on BEyond time and errors: novel evaLuation methods for Information Visualization. 2008.
- North, Chris. "Toward measuring visualization insight." IEEE computer graphics and applications 26.3 (2006): 6-9.
- Shao, Hongbo, et al. "Data Storytelling in Data Visualisation: Does it Enhance the Efficiency and Effectiveness of Information Retrieval and Insights Comprehension?." Proceedings of the CHI Conference on Human Factors in Computing Systems. 2024.
- Zdanovic, Dominyk, Tanja Julie Lembcke, and Toine Bogers. "The influence of data storytelling on the ability to recall information." Proceedings of the 2022 Conference on Human Information Interaction and Retrieval. 2022.
- Danyel Fisher and Miriah Meyer, Making Data Visual. O’Reilly, 2018
- Blogs:
Nov. 8, 2024 | T&L Data/Data Practices Topic Hop
The goal for this session is to allow you to connect and discuss topics of interest during the one-hour meeting in small breakout rooms. We’re hoping the small group format will be a comfortable way to meet some new folks, discuss several topics of interest and learn something new about using teaching and learning data. You will be able to choose 3 sessions that interest you.
We’re still finalizing some of the details and topic descriptions, but we’re planning to have 6 ten-minute breakout sessions over the one hour meeting. Potential discussion topics include:
- Assessment and Evaluation - When are surveys helpful? What can surveys do well/not do well?
- Using Learn@UW Tools and T&L Data - What kinds of data can you get from X tool? What are common problems or questions instructors come to you for that X tool can help solve?
- Active Learning and Classroom Observations - How can I structure classroom activities that facilitate learning and generate useful data? How does classroom observation work? Does it benefit students or instructors?
- Teaching and Learning Data Environment - What are common questions that our T&L data could help instructors answer? What are some challenges to answering certain questions due to our T&L data environment?
- Measuring Student Team Dynamics - What is a challenge or a lesson learned while working with student teams? Some ideas for thinking about group work, how to iterate/improve on it, and measure its effectiveness.
- T&L Project Iteration and Transparency - What is a challenge faced or a lesson learned while improving the T&L in class? How to iterate on a T&L project? How to continue to engage with students and be transparent about this work?
Dec. 13, 2024 | 5 Things for Improved Teaching & Learning Data
[More details will be provided soon]
2023 LA CoP
Feb. 10, 2023 | Data Empowered Educational Practices (DEEP) Overview
Presenters: Kim Arnold, Learning Analytics Center of Excellence (LACE) | Jeff Shokler, Office of Academic & Career Success (OACS) | Mary K. Thompson, Student Learning Assessment (SLA)
We discussed the high-level organization and structure of the DEEP framework, and heard updates about a couple of the working groups and their projects.
Mar. 10, 2023 | What do biases have to do with learning analytics?
Presenter: Dariane Drake, Learning Analytics Center of Excellence (LACE)
Dariane talked about types of biases and helped us consider how we learn and reinforce them. We looked at case studies and examples, and reviewed tips for increasing awareness.
Apr. 14, 2023 | Student perspectives/capstone project sharing from Educational Psychology MS in Learning Analytics
Presenters: Diana M. McFarland & Janae Winston, Educational Psychology MS program in Learning Analytics
We heard from two students in the first cohort of the Educational Psychology MS program on learning analytics: Diana Marie McFarland and Janae Winston. They shared their capstone projects and reflected on their unique perspectives with learning analytics.
May 12, 2024 | Emerging Themes and Topics from Spring Conferences
Group discussion
We created a google doc and shared notes, insights and links and heard about the microgrant program, the Unizin Spring meeting, several NYU LEARN recent events about subversive LA and equity oriented LA.
Oct. 13, 2023 | Data Governance - why it matters and what it means for you
Presenters: Dan Voeks, Learning Analytics Center of Excellence (LACE) | Mary K. Thompson, Student Learning Assessment (SLA)
Dan and Mary provided a brief review/introduction to our institutional data policy and data governance, and then we spent the rest of the session discussing and considering some real-life situations. For example:
- You often work with student data and have access to student data, including grades as part of your role on campus. A close, trusted colleague wants access to the data. What are some things to consider?
- You are a campus instructor and you want to engage students in the classroom by trying out a new software tool you found online. What are some things to consider?
Nov. 10, 2023 | Learning Analytics in our Learn@UW Tools - Quick Tour
Presenters: James McKay, Learn@UW | Andrew Reinke, Learn@UW | Keegan Shaw, Learn@UW
James McKay showed us Piazza (for discussions); Canvas Analytics & New Analytics (which are no longer new but still branded that way); and TopHat (student response system).
- Piazza starts at 8:45 mins
- Canvas Analytics/New Analytics - starts around 13.25 mins
- TopHat starts at 24 mins
Andrew Reinke provided an overview about Kaltura Analytics, and showed us a couple of ways to access analytics which varies based on how you’ve embedded media into your course. He shared slides and a Kaltura terminology doc as additional resources.
- Kaltura Analytics starts at 27:56 min
Keegan Shaw discussed Atomic Assessments analytics, which integrates directly into Canvas and offers advanced quizzing functionality.
- Atomic Assessments - starts at 41 mins
Dec. 8, 2023 | Exploring Course-Level Data in Tableau Visualizations
Presenter: Clare Huhn, Data, Academic Planning & Institutional Research (DAPIR)
Clare reviewed the overall structure of Tableau and how to access UW-Madison workbooks. These institutional resources can answer a variety of questions, for example: how are curricular subjects related to departments? What are the learning outcomes for a course? Are there differences in average grades between terms? Are there gaps in D/F/drop rates by demographic groups?
You have access to the workbooks we explored with your UW-Madison credentials from either RADAR or the Tableau server web pages (you must use VPN if you are not on campus). Here's the workbooks we explored:
-
- UW-Madison Academic Structure
- UW-Madison Course Catalog
- Course Grade Distribution
- Undergraduate Course D/F/Drop Rates
- Courses Completed by Bachelor’s Degree Recipients
- Course Demographics Profile
LEAD Demo & Discussion
Presenters: James McKay (Learn@UW); Kari Jordahl & Shannon Harris (LACE)
Sessions were offered periodically.
We explored the three visualizations in the Learner Engagement Analytics Dashboard (LEAD), and how to filter data to answer questions about courses, teaching, and students' activity in a course. LEAD aggregates data from Canvas, Kaltura and Unizin Engage eText and offers unique insights about for-credit courses.
Slides (no recording)
2022 LA CoP & LEAD Demos
Jan. 14, 2022 | Course Design & LA
Presenters: Kari Jordahl, Learning Analytics Center of Excellence | Cid Freitag, Center for Teaching, Learning & Mentoring
How you design your course will affect what data you can see in various learning analytics tools. In this session we discussed tips for designing a course to help create useful data, including;
- Review and reflect; what is your question? What tools/data are available?
- Identify a pivotal assignment or time in the course
- Use logical naming conventions and clear navigation
- Reminders about how to link to content (eg. Kaltura videos)
We also discussed using course blueprints or instructional design frameworks (Horton’s Absorb - Do - Connect) when designing a course, to ensure learning analytics is part of the overall course design and strategy.
Resources:
- Data Informed Design for Online Course Improvement (Chris Millet & Jessica Resig) book chapter in A Practitioner's Guide to Instructional Design in Higher Education.
- Transparency for Learning and Teaching Project: TILT Higher Ed
Feb. 11, 2022 | Identify struggling students
Presenter: Cid Freitag, Center for Teaching, Learning & Mentoring
The Learner Engagement Analytics Dashboard (LEAD) can help identify students who may be struggling. Which visualization is most useful for you? Do you use other tools or methods to identify struggling students?
Cid facilitated a discussion about how to translate data into action - using a framework that discussed Canvas tools and achievable actions - before the course starts, at the beginning of the term, during the term, and after the end of the course. (Muljana, Pauline Salim, and Greg Placencia. "Learning analytics: Translating data into “just-in-time” interventions." Scholarship of Teaching and Learning, Innovative Pedagogy 1.1 (2018): 6.)
Mar. 11, 2022 | Direct Evidence of Student Learning (DESL)
Presenters: Mary K. Thompson, Student Learning Assessment | Saundy Solum, DoIT Academic Technology | Regina Lowery, Student Learning Assessment
Direct evidence of student learning (DESL) is an assessment approach that allows instructors to evaluate learning based on student performance on tasks directly connected to course learning outcomes. We learned how Canvas assignments can be linked to AEFIS Course Learning Outcomes, or CLOs and saw a demo of AEFIS. We also discussed the difference between grading and assessment, formative and summative assessment, the benefits of DESL, and how to get started using it.
Apr. 8, 2022 | Reading data visualizations (that someone else created)
Presenter: Cid Freitag, Center for Teaching, Learning & Mentoring (CTLM)
This session focused on one aspect of data literacy — being a consumer of data visualization products, such as those in the news, popular media, and data dashboards. By analyzing a visualization we focused on making meaning and thinking critically about the meaning and message it represents — preparing us to become a better consumers of visualizations.
May 13, 2022 | Spring Conferences; Reflections & Emerging Themes
Group discussion
Spring conference season - what themes and new ideas were hot topics at events that you've attended (or that you wished you could attend)? Whether you had a chance to attend LAK'22 in March, the Unizin Summit in late April or the Indiana University LA Summit in mid-May (or other sessions we've missed) this conversation was open for all to share.
Sept. 16, 2022 | Fall Semester Kickoff Meeting
Facilitators/presenters - team presentation facilitated by Kari Jordahl; Dan Voeks, Learning Analytics Center of Excellence | Shannon Harris, Learning Analytics Center of Excellence | Mary K. Thompson, Student Learning Assessment n
At this session we spent a little time providing information and updates on the LA landscape at UW-Madison, including the DEEP framework and our institutional data policy, and transparency around using data. We learned about enhancements for the Learner Engagement Analytics Dashboard (LEAD) and heard about Direct Evidence of Student Learning (DESL). We shared information about the new microgrant program - for exploring data-empowered educational practices/learning analytics in support of diversity, equity, inclusion and belonging. We also discussed the schedule and planned topics for fall LA CoP, while soliciting ideas for later sessions.
Oct. 14, 2022 | Learning Analytics for Students - what do students want?
Presenters: Chad Shorter, Learning Analytics Center of Excellence (LACE) | Maria Dahmen, Center for User Experience (CUE)
What types of learning analytics do students want? How do we empower students to use data about them, to support their own learning?
We discussed what UW-Madison students think about learning analytics - what types of data and visualizations do they think are useful? How do they feel about data about them being used, when it’s used to support their learning? DoIT Academic Technology conducted several phases of student engagement over the past couple of years and this combined feedback from across those efforts.
Nov. 11, 2022 | Understanding Kaltura Analytics
Presenter: Andrew Reinke, Learn@UW
There are numerous ways to incorporate media into your course, and the analytics you can access will vary, based on your approach.
- Individual media analytics
- Mediaspace My Analytics dashboard
- Canvas embedding options for best analytics
- Kaltura Gallery in Canvas Analytics
- Interactive video quizzes (for self-check/not for gradebook integration)
Dec. 9, 2022 | Leveraging the Review-Amend-Apply Framework for LA
Presenters: Cid Freitag, Center for Teaching, Learning & Mentoring (CTLM) | Kari Jordahl, Learning Analytics Center of Excellence (LACE)
We looked at a framework that can be used for learning analytics approaches. The Review-Amend-Apply framework (created at Indiana University) provides a useful and very approachable 3-step process. We discussed how it aligns (or doesn't align exactly) with the UW-Madison approach for learning analytics which focuses on a question that leads to data that leads to action.
- Review the information available to you about your students' behavior, your course, your teaching
- Amend the information you've gathered - are there other resources or sources of data?
- Apply what you've learned - what modification or change might help? Consider evidence-based teaching practices.
LEAD Demos & Discussion
Presenters: James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIT Academic Technology
Sessions were offered frequently throughout the year.
We explored the three visualizations in the Learner Engagement Analytics Dashboard (LEAD), and how to filter data to answer questions about courses, teaching, and students' activity in a course. LEAD aggregates data from Canvas, Kaltura and Unizin Engage eText and offers unique insights about for-credit courses.
Slides (no recording)
2021 LA CoP & LEAD Demos
Due to the pandemic and the launch of the Learner Engagement Analytics Dashboard (LEAD) -- which was offered enterprise-wide for instructors beginning fall semester 2020 -- the LA Community of Practice programming shifted to accommodate frequent online LEAD demos. Additionally, the Learning Analytics Speaker Series was paused. (LEAD is currently not available due to significant changes in our local data infrastructure.
Learner Engagement Analytics Dashboard (LEAD) Demos & Discussion
Presenters: James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIT Academic Technology
Sessions were offered frequently throughout the year.
We explored the three visualizations in the Learner Engagement Analytics Dashboard (LEAD), and how to filter data to answer questions about courses, teaching, and students' activity in a course. LEAD aggregates data from Canvas, Kaltura and Unizin Engage eText and offers unique insights about for-credit courses.
Slides (no recording)
Feb. 9, 2021 | Student engagement - identify struggling students
Presenter: Cid Freitag, CTLM
We focused on student engagement in a course, and identifying struggling students using LEAD visualizations. How can learning analytics help you identify students who may need more support? We also discussed actions you can take in Canvas throughout various times in the semester, to support students.
(Muljana, Pauline Salim, and Greg Placencia. "Learning analytics: Translating data into “just-in-time” interventions." Scholarship of Teaching and Learning, Innovative Pedagogy 1.1 (2018): 6.)
Slides (no recording)
March 9, 2021 | How are you using learning analytics? FAQs about LEAD
Presenters: Cid Freitag, Kari Jordahl, James McKay, Shannon Harris, all with DoIT Academic Technology
Do you use LEAD, Canvas New Analytics or Kaltura Analytics? Are you using Engage or other e-texts? We looked at some commonly asked questions about learning analytics and the Learner Engagement Analytics Dashboard (LEAD).
Slides (no recording)
April 13, 2021 | Course review, reflection, planning for next time
Presenters: Cid Freitag, Kari Jordahl, James McKay, Shannon Harris, all with DoIT Academic Technology
What worked well this semester? Are there changes you’d like to consider making in your course? Do you have instructional design strategies that worked well to leverage learning analytics? Interrogate your course data to discover which resources were most/least used, what times students accessed course content and activities. What strategies might help support teaching and learning?
Google doc (no recording)
May 11, 2021 | Spring Conference Recaps
Contributors: group discussion
Many spring conferences have learning analytics tracks or areas of focus, and one pandemic upside is that we can attend more conferences. This group discussion includesd updates from the Learning Analytics & Knowledge (LAK) conference, and the Unizin Summit 2021.
Shared notes doc, links out to more resources (no recording)
June 18, 2021 | Learning Analytics & Course Design (presented at Learning Design CoP)
Presenters: Kari Jordahl, LACE & Cid Freitag, CTLM
We facilitated a session at the Learning Design Community of Practice focusing on LA and course design. The learning analytics landscape and recent efforts at UW-Madison were discussed, and then we looked at analytics in tools that instructional designers typically have access to - eg. Canvas Analytics & New Analytics, Kaltura, etc.
Slides | (no recording)
Oct. 8, 2021 | Canvas Analytics & New Analytics - Explore your own course
Presenters: James McKay, Learn@UW; Kari Jordahl, LACE & Cid Freitag, CTLM
Have you explored learning analytics options available in Canvas? There are several locations in Canvas where you can access analytics, to answer questions you might have about your course and your students.
Slides | (no recording)
Nov. 11, 2021 | Are you using learning analytics? What data do you use in your teaching? FAQs about LA
Presenters: Kari Jordahl, Chad Shorter, Shannon Harris, all with Learning Analytics Center of Excellence (LACE)
This was a more general discussion around the use of learning analytics broadly. We discussed various ways to use learning analytics and talked about how course design impacts analytics, how analytics can provide insights and help you answer some questions, while potentially leading to more questions.
Dec. 10, 2021 | Kaltura Analytics
Presenters: Andrew Reinke, Learn@UW & David Macasaet, L&S Learning Support Solutions
We looked at several ways to incorporate media into a course with Andrew Reinke, and then looked at the visualizations and analytics that result from various methods.
David Macasaet discussed how he used Kaltura Analytics to review student engagement with video content in his course, and how student engagement improved after he made several modifications to the content.
2020 - LA Speaker Series ~ LA CoP ~ LEAD Demos
Programming changed during 2020. Due to the pandemic and the launch of the Learner Engagement Analytics Dashboard (LEAD), which was offered enterprise-wide for instructors beginning fall semester 2020 - LA Community of Practice programming shifted to accommodate frequent online LEAD demos. Additionally, the Learning Analytics Speaker Series was paused. (LEAD is currently not available due to significant changes in our local data infrastructure.
- Jan 28, 2020 - Canvas Analytics - Lynn Prost, Biochemistry and Lindy Stoll, Chemistry.
- Feb. 18, 2020 and Feb. 26, 2020 - Learner Engagement Analytics Dashboard (LEAD CoP notes) - James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIt Academic Technology
- March 12, 2020 - Data Doubles: What do students think about their privacy on campus? Recorded due to pandemic onset. Dorothea Salo, the Information School
- Learner Engagement Analytics Dashboard (LEAD CoP notes) - James McKay, Shannon Harris, Cid Freitag, Kari Jordahl, all with DoIt Academic Technology
- Sept. 15 & 24, 2020 - Oct. 8 & 20, 2020 - Nov. 5 & Nov. 17, 2020 (and continued into spring and through fall semester 2023)
- Nov. 19, 2020 - Kaltura Analytics - Dan LaValley, Learn@UW slides | recording
2019 - LA Speaker Series & LA CoP
- Sept. 18, 2019 - Game-Based Learning and Data Analytics (LA Speaker Series) - Mike Beall & Greg Vaughan, Gear Learning/WIsconsin Center for Educational Research
- Oct. 16, 2019 - Learner Engagement Analytics Dashboard (LEAD) - James McKay, Kari Jordahl, Shannon Harris, Cid Freitag and pilot instructors
- Oct. 22, 2019 - Learning Analytics Guiding Principles: Supporting Students while Ethically Leveraging Data (LA Speaker Series) - Beth Martin, Pharmacy and Brian Yandell, CALS and Data Institute
- Oct. 22, 2019 - Conversation with Dragan Gasevic - impromptu conversation with small group
- Nov. 13, 2019 - Direct Evidence of Student Learning (DESL)(LA Speaker Series) - Mo Bischof and Regina Lowery, Student Learning Assessment, Office of the Provost and Saundy Solum, DoIT Academic Technology.
- Nov. 21, 2019 - Kaltura MediaSpace | recording - Dan LaValley, DoIT Academic Technology
2018 - LA Speaker Series
- Feb. 21, 2018 - Using Pattern to Log Course Activities (Miguel Garcia-Gosalvez, WI School of Business; Heather Kirkorian, School of Human Ecology, Kim Arnold & James McKay, DoIT Academic Technology)
- March 20, 2018 - Data Visualizations & Infographics (it looks cool, but what is it telling you?) (Cid Freitag, DoIT Academic Technology)
- April 26, 2018 - Canvas Analytics: Instructor Perspectives on Course Analytics (Mark Millard, Engineering Professional Development; Catherine Arnott Smith, the Information School; Amanda Margolis, School of Pharmacy)
- Sept. 18, 2018 - 6 ways to use Learning Analytics: a Functional Taxonomy (Sara Hagen, Engineering; Sarah Traynor, Anatomy)
- Oct. 16, 2018 - The Importance of Meaning… Going Beyond Big Data (video) (David Williamson Shaffer, Educational Psychology)
- Nov. 13, 2018 - Course-Level Dashboard & Analytics Beta (Garrett Smith, Kari Jordahl, James McKay from DoIT Academic Technology; Xizhou “Canoe” Xie, WI School of Business)