p5js

p5js

body glitch + hand drag + puzzle

b5ba0b6f522018d92cf2be7544af5eaa.mp4

One problem:

When the player uses their hand to drag, their hand may cover the face, preventing the face from being detected. As a result, the game is interrupted or cannot continue smoothly. I’m not sure how to solve this issue.

some other ideas/attempts:

470f7980ecef5b1611b5c6143ff72ff7.mp4

163fe8f7900d4ccb0f103205845273fc.mp4

A project that utilizes machine learning in a creative way.

BDX robots from Disney

focus on character-driven mechanical features

1. mainly reinforcement learning + imitation learning / behavior cloning + diffusion-based models for human-robot interaction.

   • learn locomotion and balance/control of walking in virtual + real world simulation
   • record teleoperated interactions (expert operator controlling the robot) and train the model to imitate those trajectories / control signals.

2. Simulated physics environments,

   Expert teleoperation logs (human operator control),

   Animator motion reference / desired style trajectories,

   Sensor data from real robots / prototypes,

   Perturbation / disturbance data

3. don’t need hand-crafting controller for each robot

   safe, fast, and cheap to train them in simulations

   give personalities to each robot

   Scalability to multiple characters / faster iteration

   Guest interaction / autonomy (not autonomous yet)

   Robustness under real-world perturbations

   Blending operator control and autonomy (mixed control)