MathJam
MathJam
MathJam
A Playful Fusion of Music and Math
Concept & Inspiration
Math can feel intimidating—especially when it’s taught through memorization and worksheets. We wanted to reimagine early math learning as something tactile, joyful and rewarding.
IGEN 430 is the Advanced Engineering Design Projects course taken by students in the final year of their degree. It spans the full academic year, and
Team Members: Mika Nogami, Beatrice Tam, Josiann Zhou
Technologies: OpenCV, MediaPipe Hands, React, p5.js, Solidworks, 3D Printing, Sensors (Flex, Force, IMU)
Team Members: Chantal Martinez & Lauryn Wright
IGEN 430 is the Advanced Engineering Design Projects course taken by students in the final year of their degree. It spans the full academic year, and
Team Members: Mika Nogami, Beatrice Tam, Josiann Zhou
Technologies: OpenCV, MediaPipe Hands, React, p5.js, Solidworks, 3D Printing, Sensors (Flex, Force, IMU)
Technologies: Particle Photon 2, RFID Sensors, 3D Printing, p5.js/tone.js
IGEN 430 is the Advanced Engineering Design Projects course taken by students in the final year of their degree. It spans the full academic year, and
Team Members: Mika Nogami, Beatrice Tam, Josiann Zhou
Technologies: OpenCV, MediaPipe Hands, React, p5.js, Solidworks, 3D Printing, Sensors (Flex, Force, IMU)
Role: Audiovisual Developer
IGEN 430 is the Advanced Engineering Design Projects course taken by students in the final year of their degree. It spans the full academic year, and
Team Members: Mika Nogami, Beatrice Tam, Josiann Zhou
Technologies: OpenCV, MediaPipe Hands, React, p5.js, Solidworks, 3D Printing, Sensors (Flex, Force, IMU)
Transforming Math Practice
into Interactive Musical Play
The system consists of four wheels, each featuring a black notch for tracking. I built a custom optical encoder using an IR sensor, which detects each notch pass and increments an internal counter. At the end of a monitoring period, the counters are compared to determine wheel order— the highest count corresponds to Wheel 4, and so on. This sequence dictates which track is played, turning wheel placement into a dynamic musical control system.
IGEN 430 is the Advanced Engineering Design Projects course taken by students in the final year of their degree. It spans the full academic year, and
Team Members: Mika Nogami, Beatrice Tam, Josiann Zhou
Technologies: OpenCV, MediaPipe Hands, React, p5.js, Solidworks, 3D Printing, Sensors (Flex, Force, IMU)
Wireless Integration with MAX/MSP
The ESP32 Feather transmits the wheel sequence via a Bluetooth stream to MAX/MSP, a visual programming environment for music and multimedia applications. MAX/MSP then interprets the sequence and triggers the corresponding audio track, allowing real-time sequencing where rearranging the wheels dynamically controls playback. This setup seamlessly connects physical motion to digital sound processing.
IGEN 430 is the Advanced Engineering Design Projects course taken by students in the final year of their degree. It spans the full academic year, and
Team Members: Mika Nogami, Beatrice Tam, Josiann Zhou
Technologies: OpenCV, MediaPipe Hands, React, p5.js, Solidworks, 3D Printing, Sensors (Flex, Force, IMU)
Kaylee Jung
© 2025