Post #2463653

2026-05-12 15:03 UTC

🚀 IT WORKS!!!! 🚀 ARKit iPhone face tracking, without an iPhone. Just a webcam on any Mac. All the blend shapes. All the features. No magic camera required. It just works. Now I just need to plug this into VBridger/VTS and clean things up a bit ✨ Logs: https://gist.github.com/hoshinolina/ba7548a50563146fa1caf3d2bd8ea3be

Replies (5)

@lina@vt.social 2026-05-12 15:06

This is the exact same code and machine learning model that ARKit uses under the hood on iPhones, with the same quality. Apple doesn't publicly support it on macOS through ARKit... but they've been shipping it secretly as a private API.

Open ##2593808
@jjj@functional.cafe 2026-05-12 15:22

@lina@vt.social That's amazing! Congrats! :)

Open ##2593813
@chaos_princess@social.treehouse.systems 2026-05-12 15:49

@lina@vt.social Spite-driven development?

Open ##2593814
@yon@sakurajima.moe 2026-05-12 16:47

@lina@vt.social The computer built in webcams aren’t that terribly good either afaik. Sounds like it’s software more than hardware. Ever tried lowering the quality from the camera through software to see how “bad” it can get before it stops working well enough? <— no practical reason for this, just curious, don’t burn a lot of time on my behalf :)

Open ##2593816
@nrab@hachyderm.io 2026-05-13 19:21

@lina@vt.social given the model and everything is just inside the framework, it should be very doable to use it on other systems too, right? Even if people would obviously need to source their own models, weights, etc (definitely not from an Apple computer)

Open ##2593819