ARDK 0.11.0 Release Notes 2021-09-02

What’s New

  • [Multiplayer] Added MarkerSync example scene to ARDK-Examples.

  • [Developer Tools] It is now possible to get depth buffers from a mock ARSession.

  • [Developer Tools] Add the MockSemanticLabel component to GameObjects in the ARDK_MockWorld layer to see them labeled in the semantic buffers.

Known Issues

  • [Contextual Awareness] Semantics: ceiling gets classified as “Sky”

  • [Contextual Awareness] For Samsung S7 Edge, camera view fails to appear

Improvements

  • [AR Scanning] LIDAR, compass support added to recorder

  • [Contextual Awareness] Meshing memory management improvements

  • [Contextual Awareness] Reduce the number of memory allocations needed by meshing in C#.

  • [Contextual Awareness] Log message added when meshing, depth, semantics performance impacted

  • [Contextual Awareness] Enable per ARFrame interpolation of depth/semantic buffers

  • [Contextual Awareness] Reduced the memory allocations required for meshing.

  • [Contextual Awareness] MeshBlocksUpdatedArgs renamed to MeshObjectsUpdatedArgs.

  • [Contextual Awareness] Gameboard improvements

  • [Contextual Awareness] Adds an API to control the meshing radius

  • [Contextual Awareness] Updates to multidepth model

  • [Contextual Awareness] In IARFrame, changed IARPointCloud DepthFeaturePoints to IDepthPointCloud DepthPointCloud. IDepthPointCloud offers width and height info for the cloud.

  • [Developer Tools] (1) Depth and semantics buffers sent from the device over Virtual Studio’s RemoteConnection are now oriented the same in editor as when surfaced on device, and can now be rotated to the screen orientation. (2) Removed FocalLength and ARCameraIntrinsics properties from IAwarenessBuffer, as they were only useful as part of a now deprecated set of other methods. (3) Intrinsics are now available as a CameraIntrinsics type (changed from a Matrix4x4).

  • [Developer Tools] Improved profiling for frame processing.

  • [Developer Tools] The ARDK Examples application for iOS now supports file sharing, which makes it easier to extract files generated by the app, like mock meshes. If you’re using ARDK Examples as a starting point for your app, you may want to disable the EnableFileSharingPostProcessor class if file sharing is not a desired feature for your use case.

  • [Developer Tools] Added more configurable quality settings for Virtual Studio’s RemoteConnection.

  • [Developer Tools] Decreased bandwidth used by Virtual Studio’s RemoteConnection.

  • [Developer Tools] Improves the IQP report to include visualization of newly added trace events for fps metrics and memory usage over session duration.

  • [Developer Tools] Add model initialize time to ctrace.

  • [Developer Platform] Better warnings when multiple API keys used

Bug Fixes

  • [Contextual Awareness] Fix precision issue with multidepth playback test

  • [Contextual Awareness] Fix issue with enabling/disabling inference manager

  • [Contextual Awareness] Make the semantic segmentation example scene clear out the overlay image when segmentation is disabled.

  • [Contextual Awareness] Target frame rate fixes

  • [Contextual Awareness] Semantics fixes

  • [Multiplayer] Fixed a null reference in NetTransform’s OnDestroy if networking is never initialized

  • [Multiplayer] Added 8-player limit information to docs

  • [Developer Tools] Mock camera configurations are now properly read when entering Play Mode.

  • [Developer Tools] Fixes bug preventing the ARDK trace logs from being generated

  • [Developer Platform] Fixed broken references in documentation.

  • [Developer Platform][Examples] Minor fixes for AnchorsWithoutPlanes examples scene.

  • [Developer Platform] When using OnDevice networking, the OnDisconnected event is now correctly raised after the native networking instance is fully disconnected.

Breaking Changes

  • [Contextual Awareness] Cleaned up Awareness namespaces. Depth APIs were moved to Niantic.ARDK.AR.Awareness.Depth, and Semantic APIs were moved to Niantic.ARDK.AR.Awareness.Semantics.

Upgrade Guide

Awareness Namespace Updates

Depth and Semantics classes were moved to the Niantic.ARDK.AR.Awareness namespace (to Niantic.ARDK.AR.Awareness.Depth and Niantic.ARDK.AR.Awareness.Semantics respectively). If you’re using these classes you’ll need to update your code to use the namespace changes. For example, if you were including using Niantic.ARDK.AR.Depth you’ll need to update this to using Niantic.ARDK.AR.Awareness.Depth.

Released: September 02, 2021