Production

In the first week, we met with our instructor, Mo as well as our team members, and decided on the team name.”Stringers”

Team meeting notes:

1. Understand why the client wants the design, not just what they want. This helps create purpose-driven solutions.
2. Prepare for the Client Meeting, Clarify goals, expectations, and priorities to align on the design vision, have a question list.
3. Deeping knowing the design content, if necessary find a Ukulele expert to interview.
4. Explore how musical instruments can be integrated into games—either as tools for teaching or as game elements.
5. Kick-off Task
   1. Research music games for inspiration.
   2. Study teaching methods for ukuleles, pedagogies
   3. Storyboards to map out possible user experience.

Insights from Client Meeting:

1. Research Question: How do humans acquire, adapt, and retain motor skills?
2. Outcome:  Develop a web-based Ukulele Training Tool that:

• Creates learning scenarios involving hand-object interaction (ukulele).
• Scales data collection using webcams (crowdsourcing).
• Functions as an open-source, research-friendly platform that is simple yet playable.
  • “Playable as a simple open-source computer web-app, amenable for research”
  • How can I experience it easily? No need for complex setups

3. Pivot:

• Simplicity Over Flashiness: Clear and easy-to-follow design is more important than visual complexity.
• Interactive but Not Overwhelming: Avoid overly abstract interactions to maintain research clarity.

4. Approaches:

1. Direct Mapping
   
   • Track user’s hands and the ukulele in real time.
   • Give instructions by directly showing where to press, no more abstraction or deciphering.
2. Why Ukulele?
   
   • Compact and fits within the frame of a webcam.
   • Simple enough to teach foundational motor skills effectively.
3. Existing Reference: Roli – Direct mapping for piano.

5. Data Type for Research

• Hand Tracking: x, y positions of both hands for accurate feedback.
• Performance Metrics: Reaction time, execution accuracy, and proficiency

6. Concerns and Open Questions

1. Is it enough to recognize hand shapes, Can the tool track exact pressing accuracy?
2. Hand Tracking Visibility can be flexible: Should users see their tracked hands during training?
3. Enabling Learning Customization: Should users choose what to learn, or should groups follow a structured learning path?
4. How can the app ensure ease of use and minimize setup complexity for users?

Based on the discussion: we will be coming up with several pitches based on following learning process:

1. Chord Learning: Teach hand positions for individual chords.
2. Strumming Pattern: Accurate strumming or plucking.

Song Integration: Piece chords and strumming into full songs.