Modern smartphones contain many sensors and frameworks that can capture the surrounding world.Capable mobile processors, machine learning and frameworks allow us to capture the pose of a human with very little extra work.

We are looking for a student that wants to work with augmented reality and extend the posture detection system in iOS with a 3D positioning system. The software may combine multiple iPhones at different locations to enhance tracking. In the end, such a system allows to quickly create dataset necessary for WiFi sensing, create interactive games and more.

A small introduction to the available frameworks has been given on WWDC 2020. Starting at minute 13 the video shows what is already possible today.

https://developer.apple.com/videos/play/wwdc2020/10653/