Urho + iOS ARKit (Augmented Reality)

Apple introduced a very powerful AR toolkit in iOS11 called ARKit. So I’d love to share my sample using UrhoSharp and ARKit
The code is simple and can be easily “backported” to C++ if you want: https://github.com/EgorBo/ARKitXamarinDemo

Videos:
https://www.youtube.com/watch?v=KSZtvq_iGoE
and
https://www.youtube.com/watch?v=BdEIetc4rHU

ARKit is able to detect movements and planes (I will add “plane (ARPlaneAnchors) visualization” later).
There were some challenges:

1. NPOT textures on iOS (hey guys, let’s add ES3 support together :slight_smile)
2. YUV to RGB
3. Render video instead of clear color
4. Shadows on a transparent surface

Thanks for this! Do you have any thoughts on how one would go about writing the C++ version? I’m pretty comfortable with the Urho side of things, but how does ARKit fit in? How do I go about linking in ARKit and getting, say, the registered surfaces?

it should be strait forward.

1. Add ARKit framework (just like other frameworks such as AVFoundation are added somewhere in makefiles)
2. Create an ARSession, run and listen to events (didUpdateFrame, etc…) Here is how it looks like in C#: https://gist.github.com/EgorBo/71d66993e40fec32987b7f00e2ff734c
   translate code from C# to C++ in ArkitApp.cs - should not be difficult

And don’t forget you will need:

1. A9 ios device (iphone 6s or better)
2. iOS 11
3. XCode 9
   both iOS11 and XCode 9 are betas.