My project titled “Exploring the Impact of Digital Design on Augmented Cognition” was for a research study under the mentorship of Dr. Michael-Brian Ogawa and Branden Ogata. This project was presented at the Fall 2024 Undergraduate Showcase at UH Manoa.
As students increasingly engage with digital interfaces, understanding how technology influences learning has become essential. This study investigates how variations in instructional website design affect learning outcomes, focusing on identifying specific design elements that enhance engagement, knowledge retention, and cognitive processing in digital environments. For this project
Two instructional websites on Python programming fundamentals were developed using HTML, CSS, Javascript, Typescript, React, Bootstrap, PostgreSQL, and Node.js. Each website incorporated distinct human-computer interaction (HCI) principles to assess their impact on learning behaviors. User interactions were tracked using the WebGazer.js and heatmap.js eye-tracking libraries, with data stored locally via the IndexedDB LocalForage database. Screen recordings were also utilized to analyze user flows and interaction patterns.
Scrollable Website format
Scrollable Website heatmap
Multi-paged Website format
Multi-paged Website heatmap
A sample of 16 students enrolled in introductory computer sciences courses with minimal prior experience in Python were selected to ensure a consistent baseline for learning gains. These students were separated into groups of 8 and randomly assigned to a scrollable or multi-paged website. After exploring the websites, participants took a 10-question quiz that reviewed material covered in the websites. Participants explored the websites, completed a quiz on the content, and provided feedback through post-study surveys that captured their perceptions of the websites’ designs and their influence on the learning experience. Data analysis were conducted using ANOVA and t-tests to evalute the influence of user interface (UI) variations on cognitive processing and retention metrics.
Findings indicate that for this group of participants, scrollable websites improved their overall retention, as reflected by the average 63.76% average quiz score mean of the scrollable website group in compariso to the 56.25% average quiz score mean of the multi-paged website. When analyzing the results of the quizzes in a t-test we see that the p value for the two tailed test is above the 0.05 threshold to be considered statistically significant. However, after analyzing the data more closely, specific questions stood out in relation to how much time students spent on it and their correctness.
When analyzing a t-test based on the time spent on specific questions, the one-tailed p-value is 0.1013583416, which is closer to the less than 0.05 threshold, thus marking it as a trending value. In addition, for the question with the largest time difference between the two groups, the one-tailed p-value is 0.06286948428, which is also very close to the 0.05 threshold, suggesting a trend toward statistical significance. This indicates that the observed difference may not be due to chance and could point to a meaningful difference in how the groups approached this question. Thus, can determine that the scrollable website encourages more review, with certain question types aligning better with specific designs. Both websites were effective learning tools, though limitations such as the small sample size and small effect size should be considered.
Moving forward, there are several opportunities to expand on this study and address some of the limitations. Future research could focus on testing with a larger sample size to increase the reliability of the findings. Additionally, investigating how these design variations perform on mobile platforms would be valuable, given the growing use of mobile devices in education. Finally, embedded testing, where assessments are conducted in real-time after each section, could provide more immediate insights into student engagement and learning. These results emphasize the role of intentional digital design in fostering engagement, reducing visual overwhelm, and supporting effective cognitive processing. This study contributes to educational technology by emphasizing how intentional digital design best enhances engagement, information processing, and learning outcomes. These insights into HCI principles inform best practices for designing educational interfaces that decrease cognitive load to optimize student experiences and promote effective learning in digital environments.
This research provided me with invaluable experience in website development, particularly as it was my first time building two instructional websites entirely on my own. While I had previously worked on web development projects within a team, this self-led project required me to take full ownership, solving problems and debugging challenges independently. This experience, while sometimes difficult, was ultimately rewarding and greatly enhanced my technical skills. I hope this research highlights the importance of intentional digital design in enhancing student learning, particularly in the context of our rapidly evolving digital educational environments.
To view this project’s Undergraduate Showcase presentation, click here.