Learning Centered Design Project
Legislation at the local, state, and federal levels affects users' rights, resources, and daily lives. The internet makes it easy to find information without a clear way to vet its context, accuracy, and relevance. This pain point can stem from a lack of foundational understanding of our government's structure and how it functions. The gap between both access and understanding presents an opportunity to design an e-learning system that builds users' civic knowledge of the three branches of government and empowers them to better evaluate and understand legislation and its impact.
This iteration of the project focuses on developing an e-learning course that teaches users about the City of Chicago government.
The prototype is an online, self-paced e-learning course, accessible via desktop, tablet, or mobile device.
The e-learning course seeks to help learners achieve the following five objectives according to the Revised Bloom's Taxonomy Table (RBT).
This project applies the following seven principles from e-Learning and the Science of Instruction by Ruth Colvin Clark and Richard E. Mayer.
Pretest-Posttest Design
The project used a Qualtrics account that is linked to a DePaul University email that is no longer retrievable.
The project did not include a questionnaire to capture participant demographics.
This project cannot confirm whether the seven participants who completed the course meet the target user criteria.
The pretest and posttest assessment collected limited objective-level granularity.
The course flows are functional.
The project goals span multiple levels of RBT.
The data indicates an overall gain of d = 1.14.
The course provides a defensible business case.
The research establishes a baseline for iteration.
The research reduces the risk in decision-making.
This study was designed according to seven e-learning principles from the Clark and Brown framework describe above to meet the five Bloom's Taxonomy learning objectives (described above).
Lorem Ipsum
| Question | Learning Objective | |
|---|---|---|
| 1. | What is your name | N/A |
| 2. | What does the executive branch of the government do? | LO1, LO5 |
| 3. | What does the legislative branch of the government do? | LO1, LO5 |
| 4. | What does the judicial branch of the government do? | LO1, LO5 |
| 5. | Which of the following are city-wide elected positions in the City of Chicago? | LO2, LO5 |
| 6. | What does the mayor's office do? | LO2, LO5 |
| 7. | What does the City Clerk do? | LO2, LO5 |
| 8. | What does the Treasurer's Office do? | LO2, LO5 |
| 9. | What is a Chicago ward? | LO1, LO5 |
| 10. | How many wards are there in the City of Chicago? | LO1, LO5 |
| 11. | What does an alderman do? | LO2, LO5 |
| 12. | What is the City Council? | LO1, LO5 |
Lorem Ipsum
| Age Range | Education | |
|---|---|---|
| 1. | 21+ | Master's Degree |
| 2. | 21+ | Master's Degree |
| 3. | 21+ | Master's Degree |
| 4. | 21+ | Master's Degree |
| 5. | 21+ | Bachelor's Degree |
| 6. | 21+ | High School |
| 7. | 13+ | High School |
| 8. | 13+ | High School |
| 9. | 13+ | High School |
Lorem Ipsum
Lorem Ipsum
Data
| Participant | Pretest: Correct | Pretest: Score | Posttest: Correct | Posttest: Score | Difference |
|---|---|---|---|---|---|
| 1. | 6 | 55% | 8 | 73% | 2 |
| 2. | 8 | 73% | 11 | 100% | 3 |
| 3. | 6 | 55% | 9 | 82% | 3 |
| 4. | 4 | 36% | 4 | 36% | 0 |
| 5. | 5 | 45% | 10 | 91% | 5 |
| 6. | 9 | 82% | 10 | 91% | 1 |
| 7. | 8 | 73% | 11 | 100% | 3 |
Analysis
Pretest
Posttest
Average of Standard Deviations
Effect Size Calculation
Step 1: Difference between average correct answers
Step 2: Divide by the pooled/average standard deviation
T-Test Calculation
Step 1: Calculate the difference between posttest and pretest scores for each participant, then find the mean difference
Step 2: Calculate the standard deviation of the per-participant differences from Step 1
Step 3: Calculate t
Step 4: Degrees of freedom
Step 5: Determine p-value
Effect Size
The effect size is 1.14 > 0.8.
A Cohen's d of 1.14 indicates a large effect size (d > 0.8), meaning the improvement from pretest to posttest represents a substantial change, not just a statiscally detectable one. Combined with the paired t-test results (t(6) = 3.97, p = 0.007), this provides strong evidence that the training had a real and sizeable impact on participant performance.
Lorem Ipsum
AI disclaimer: This case study uses Claude.ai to proofread copy, validate the data analysis, and collaborate to break down the calculation processes.