Project ALT CONTROL

UPDATE 3 I AM REMAKING THIS




Concept
A 2D pixel-art rhythm game controlled through gesture inputs using the Arduino Nano 33 BLE Sense.
Players embody a “Hero” trapped in an endless reincarnation loop, performing rhythmic hand gestures to defeat monsters. The repetitive cycle intentionally deconstructs the colonialist and power-fantasy tropes often found in isekai stories—
tropes such as “saving a new world,” arrival superiority, conquering women, earning loot, and taking rewards.”
Here, the loop becomes a critique rather than a power fantasy.


Project Details
Platform: Unity
Tools Used: Unity3D, Arduino Nano 33 BLE Sense
Duration: 4 weeks


Background & Evolution of the Idea
The earlier prototype began as an experiment in pure VFX-driven interaction, where gesture recognition triggered visual effects without traditional gameplay structure. After early testing and reflection, the direction shifted toward a design where gesture interaction becomes the core mechanic rather than simply a trigger for effects.

This shift revealed a new pleasure in the experience:
the sensation of playing as an invisible, intangible being who manipulates the world through movement alone. The project now focuses on crafting highly exaggerated, deeply satisfying feedback—visual, auditory, and contextual—that reacts to each gesture. The goal is to make every action feel physical and emotionally resonant despite the controller being invisible.







UPDATE 2
Added start screenUI
synth sound 
humanoid sound... SFXs
Further goal would be add combo and an end



UPDATE
added 8x8bayer dither shader/UI for hit number. But losted everything due to accident so I spend a week to rebuild everything and further development. 

USER FEEDBACK

“Harder, an ending for the game Difficulty, enemy feedbacks”


-I added Health system and losing.So player can lose the game.
-I added pacing system to the game so the enemy spawn/enemy speed increase through time.
-I added 3 variation of enemy from MIXAMO and changed the animation to a more creepy behavior.

“With gloves, use two hands.”
-I made a bangle to hold audrino on wrist. So player can be away from the screen/table and use to hands.


“I love the animation and the whole idea! Maybe you could add a more surreal background for those little buddies;)”

-I added a random color script for the scene for better visual effects(Since 3d background is sort of out of scope for the develop period)

“Something lead the player to do input.”
-I added game kill UI indicates the enemy number
-I want to add a loot and economy system to create the full game loop but my development process is stucked for a while since i lost all my code.








Reference
https://docs.arduino.cc/tutorials/nano-33-ble-sense/gesture-sensor/
After learned how to track hand gesture through Nano 33 BLE SENSE, I simplified the code. I deleted LED feedback but only keep a printed serial message. 

which allows me to have something for unity to read.

With the serial communication between 2 software. Then, i have a early stage prototype of the game.

Polishing a bit
i added ragdoll/camera shake/particle effects from unity asset store(JMO ASSET)/running animation from Mixamo/trail/hit sound