Want to build an AR game with Android camera feed? Or perhaps, want to get Realtime Camera Frame as raw buffer super fast for performing Computer Vision analysis without stalling GPU and compromising FPS?

It is easy to feel constrained with the WebCamTexture API of Unity or while using other third party AR SDKs like ARCore or Vuforia when you want to customize your camera parameters as much as possible. For example, if you want to use your front camera for tracking/analyzing your face or turn on the flashlight for a horror game.

AR Camera Controller will give you that exact control you crave for and so much more.

The package is tested and meant to be currently used only in android platform, although it should work with less functionality on all platforms using Unity's WebCamTexture api(Tested in Unity Editor).

Features:
- [Android only] The included android camera plugin is built using the latest Camera2 apis for supported phones and falling back to deprecated Camera api for older ones.
- [Android only]Supports switching camera between front and back
- [Android only]Supports toggling FlashLight on and off
- Capturing camera feed as image(only up to screen size)
- Retrieve Low Res Unity MainCamera RenderTexture data as both Texture2D and native c++ char* buffer(IntPtr). For Android running Oreo 8.0+, Buffer/Texture2D retrieval is GPU stalling free and with latency of just 5-10 ms.
This buffer/texture can be directly used in native C++ or C# code for computer vision analysis or something else as required.

Installation[For Android]:
- Import the package into your project
- Disable Multithreaded Rendering in PlayerSettings/Android/Other Settings
- Minimum API Level needs to be set to 16(Android 4.1)
- Build and Run the SampleScene
Further usage guide is provided in "AR Camera Controller Guide.pdf" present in the package

This asset uses ARBackground.shader from Google ARCore SDK under Apache 2.0 license; see Third-Party Notices.txt file in package for details.


Links:
Website