Step 1: Designed

CyberStrum is a learning framework

that helps beginners practice guitar without owning a guitar.

The core ideas are simple:

1. Train the left hand to recognize chords
2. Train the right hand to feel strumming rhythm
3. Practice performance and coordination before sound
4. Reduce cost, frustration, and barriers to entry

CyberStrum does not replace a real guitar.

It prepares you for one.

Step 2: System Overview

CyberStrum uses two main components:

1️⃣ HuskyLens – Chord Recognition (Left Hand)

1. Uses HuskyLens AI Camera
2. Trained to recognize hand gestures as guitar chords
3. Detects which chord shape the left hand is forming
4. Acts like a visual coach saying: “Yes, that’s the chord.”

👉 Perfect for beginners who still struggle with chord shapes.

2️⃣ Raspberry Pi Pico – Strumming Detection (Right Hand)

1. Uses Raspberry Pi Pico
2. Detects hand movement for up/down strumming
3. Converts gestures into rhythm signals
4. Sends timing information for sound or visual feedback

👉 Helps build rhythm and muscle memory.

Step 3: How CyberStrum Works

🎶 How CyberStrum Works

1. The left hand forms a chord gesture
2. HuskyLens recognizes the chord
3. The right hand performs a strumming motion
4. Pico detects the strum direction and timing
5. The system combines chord + rhythm
6. Feedback is shown as sound, visuals, or indicators

There are no strings,

but the body begins to understand how playing feels.

🎯 Why CyberStrum Is Great for Beginners

1. No need to buy a guitar first
2. No finger pain
3. No pressure
4. Can practice in short sessions
5. Learning feels playful and engaging

Most importantly:

You don’t need to be good to start.

Step 4: HuskyLens 2 – AI Vision for Chord Recognition

HuskyLens 2 is an AI vision sensor that can recognize images, objects, and gestures without complex programming.

In CyberStrum, HuskyLens 2 is used to:

1. Recognize left-hand chord shapes
2. Identify finger positions as different guitar chords
3. Provide instant feedback on whether a chord gesture is correct
4. Act as a “visual guitar teacher” for beginners

Why HuskyLens 2?

1. No need for heavy AI models or cloud processing
2. Easy to train using buttons (no PC required)
3. Works offline and in real time
4. Perfect for beginners and rapid prototyping

👉 This helps users who cannot memorize or form guitar chords yet

to visually understand and practice chord shapes first.

If you’re interested in building CyberStrum or experimenting with AI-based hand gesture recognition, the HuskyLens 2 AI camera used in this project is available from the official DFRobot store at:

https://www.dfrobot.com/product-2995.html

Step 5: TOF200_TPS – Time-of-Flight Distance Sensor (Strumming Detection)

The TOF200_TPS is a Time-of-Flight (ToF) distance sensor.

It measures how far an object is from the sensor in real time.

In CyberStrum, it is used to:

1. Detect hand distance and movement speed
2. Identify strumming direction (hand moving closer or farther)
3. Measure motion without physical contact
4. Enable smooth and responsive gesture tracking

Why a ToF Sensor?

1. Works without touching anything
2. Accurate and fast response
3. Less sensitive to lighting than cameras
4. Ideal for gesture-based interaction

👉 This allows CyberStrum to detect natural air-strumming motions,

similar to how people perform Air Guitar.

Step 6: Setting Up the Hardware

In this step, we assemble the core hardware components of CyberStrum.

The goal is to mount, align, and connect each module so the system can correctly detect chords and strumming gestures.

🧩 Components Shown in the Image

From the image, the CyberStrum hardware consists of:

1. HuskyLens 2 AI Camera
2. Raspberry Pi Pico (with ToF200_TPS sensor mounted on a perfboard)
3. 3D-printed mounting brackets (black parts)
4. 3D-printed enclosure (green case)

Each...