All that remains here are practice pieces for vibe coding.
The vowels in human speech are largely determined by the relationship between the first formant and the second formant.
This work explores the idea that it might be interesting if we could manipulate those formants with our hands instead of our throats.
While it's easy to produce the five Japanese vowels—a, i, u, e, o—using our throats, doing so with our hands is far too difficult!
And while my recent works have tried to sound cute, this one isn't cute at all!
母音は第1フォルマントと第2フォルマントの関係で決まるわけで、それを声道ではなく手で操作してみようというのが今回のチャレンジ。
難しいわ。
This post is not about a new project. In my previous project, the microcontroller board for LED control communicated with a Mac via USB connection. This time, I made it operate via Bluetooth communication with a smartphone.
Also, I hadn't planned to release the source code for this project, but since several people inquired about it, I've decided to publish the source code on GitHub. It's not complex code, nor is it particularly excellent, but if you're interested, please check it out.
前回の投稿が予想外に好評だったのでMacとUSB接続していたのをスマホとBluetooth接続で動作するようにした。
ついでにソース公開。まあ、公開するほどのものでもないけど。
モバイル対応したので屋外で外国人に向けて富士山背景で撮影しようかと思ったものの面倒になってしまい、テントサウナ背景で撮らせてもらった。
This time, I attached an 8x8 dot matrix LED display module to an ESP32 microcontroller board and controlled it via serial communication from a Mac.
On the Mac, facial expressions in the camera feed are recognized in real time, and the recognition results are sent to the ESP32 to display the expressions on the LED display.
今回はソフトウェアだけではなく、ESP32というマイコンボードとマトリックスLEDモジュールを使った。
Macで表情を認識して、その結果をシリアル通信でESP32に送信し、LEDで表情を表示するようにしてみた。
電子工作というほどでもなく小学生でも組み立てられるし（でも、USBでPCにつなぐので、配線を間違えるとPCを壊す恐れはある）、ソフトウェアもAIに相談すれば小学生でもできると思う。夏休みの自由課題にパクっていいよ！
his time, I used a head-related transfer function again. I made it so that when you touch the rods floating around your head, they play sounds.
The rod arrangements include chromatic mode and chord mode.
Pressing the Random Play button makes a ball bounce around the screen and play sounds.
The sound is inspired by the instrument known as the Koshi Chime.
The screen is simple, but it generates beautiful sounds, so please give it a try if you like.
また頭部伝達関数（HRTF）ネタなので、ヘッドフォンなんかを使って聴いてもらいたい。サウナの外気浴中に聴かせてもらったコシチャイムという楽器の音色にインスパイアされて作ってみた。
You can try this app in your web browser.Today's vibecoding work is a simple virtual theremin.
Well, it's an idea pretty much anyone would come up with, so I probably should have made it sooner.
I added a switch to play chromatic scales, but even with that enabled, it's tricky to hit the intended notes.
アイデアとしては陳腐だとも思うけれど、一回作っておかないとダメかなと思ったバーチャルテルミン（シンプル版）。なんの捻りもない。
まあ、これでとりあえず満足。
I tried the pupil tracking test, but my eyes are too narrow to detect downward gaze!
You can check if your eyes are detected correctly.
But there's another drawback: if you're not facing forward (toward the camera), you can't check the detection results yourself... ;p
視線というか黒目追跡のテストをしたのだけれど、目が細すぎるからか、下向きを検知してくれない……。
You can try this app in your web browser.This is a silent video.
I was trying to make a kaleidoscope camera, but a bug caused unexpected footage—though this turned out more interesting, so I went with it.
万華鏡カメラを作ろうと思ったものの、バグってできたのがコレ。
You can try this app in your web browser.