All that remains here are practice pieces for vibe coding.
This time, I attached an 8x8 dot matrix LED display module to an ESP32 microcontroller board and controlled it via serial communication from a Mac.
On the Mac, facial expressions in the camera feed are recognized in real time, and the recognition results are sent to the ESP32 to display the expressions on the LED display.
今回はソフトウェアだけではなく、ESP32というマイコンボードとマトリックスLEDモジュールを使った。
Macで表情を認識して、その結果をシリアル通信でESP32に送信し、LEDで表情を表示するようにしてみた。
電子工作というほどでもなく小学生でも組み立てられるし(でも、USBでPCにつなぐので、配線を間違えるとPCを壊す恐れはある)、ソフトウェアもAIに相談すれば小学生でもできると思う。夏休みの自由課題にパクっていいよ!
his time, I used a head-related transfer function again. I made it so that when you touch the rods floating around your head, they play sounds.
The rod arrangements include chromatic mode and chord mode.
Pressing the Random Play button makes a ball bounce around the screen and play sounds.
The sound is inspired by the instrument known as the Koshi Chime.
The screen is simple, but it generates beautiful sounds, so please give it a try if you like.
また頭部伝達関数(HRTF)ネタなので、ヘッドフォンなんかを使って聴いてもらいたい。サウナの外気浴中に聴かせてもらったコシチャイムという楽器の音色にインスパイアされて作ってみた。
You can try this app in your web browser.Today's vibecoding work is a simple virtual theremin.
Well, it's an idea pretty much anyone would come up with, so I probably should have made it sooner.
I added a switch to play chromatic scales, but even with that enabled, it's tricky to hit the intended notes.
アイデアとしては陳腐だとも思うけれど、一回作っておかないとダメかなと思ったバーチャルテルミン(シンプル版)。なんの捻りもない。
まあ、これでとりあえず満足。
I tried the pupil tracking test, but my eyes are too narrow to detect downward gaze!
You can check if your eyes are detected correctly.
But there's another drawback: if you're not facing forward (toward the camera), you can't check the detection results yourself... ;p
視線というか黒目追跡のテストをしたのだけれど、目が細すぎるからか、下向きを検知してくれない……。
You can try this app in your web browser.This is a silent video.
I was trying to make a kaleidoscope camera, but a bug caused unexpected footage—though this turned out more interesting, so I went with it.
万華鏡カメラを作ろうと思ったものの、バグってできたのがコレ。
You can try this app in your web browser.