Vuforia Engine not starting camera with XRSession (with ML Rig) on Magic Leap 2 - Stack Overflow

admin管理员组

文章数量:1122846

I am trying to make Vuforia work on Magic Leap 2 with latest ML SDK Appropriately for almost 3 weeks. I am able to make Vuforia work somehow but always there is a missing feature that is not working in every different configuration I tried. Either Vuforia is not working properly (with ML-Rig or ML Camera) or Video stream on PC has an offset and objects are not overlapping to the real world. I need exact overlap on PC video stream, otherwise it is hard to demonstrate to people or publish videos via internet and social media.

I am using: Unity 2022.3.54 to Build Magic Leap 2 Glasses OS is 1.11.0 Magic Leap Unity SDK is 2.6.0 MRTK 3 Package is 1.4.0 Magic Leap Hub 3 to get Video Stream and watch in PC

I tried Vuforia in different settings, but always one different feature is not working, there are 3 different main configurations that have tried are below:

1. At first Vuforia never works with Magic Leap standard ML Rig. If there is any XRSession script on an object Vuforia cannot start the camera (not RED camera dot appears). But if I remove XR session from the rig, then Vuforia works but that time ML tracking features cannot work correctly, depending on different settings, either head/controller are not moving or there is an offset on glasses virtual objects with real objects (for instance, controller or hands are not on real world objects, there is several cm offset on glasses view, note: this time I am not mentioning about Video Stream).

2. Vuforia works correctly with old ML Camera (as described in sample) which is initialized from camera prefab in Magic Leap SDK packages folder and if Settings are checked as "Magic Leap" in XR Plugin Management settings in addition to Magic Leap OpenXR. But this time Secondary View of Magic Leap is not working so there is a significant difference between camera image and virtual objects on PC video stream. If I use stereo convergence point of ML, than offset decrease but not enough to showcase people. I tried what is written in here , but not worked for me (may be not working with new ML SDKs).

3. If Settings are NOT checked as "Magic Leap" in XR Plugin Management. Then everything works but this time Vuforia cannot locate objects to its correct position. Vuforia targets are visualized on floor instead of in front of me. With old ML Camera if "Magic Leap" is not checked in XR Plugin Management, XR origin is not set correctly. Although I select "Device" from anywhere I found in settings including MRTK3 settings, floor is always chosen and head coordinates start at about 1.05 meters instead of zero meter. So Vuforia thinks it is putting objects on device but actually it puts markers to floor. I tried to manually make offset to markers, but could not managed to compute offset exactly, offsets changes in every different Run.

I spent weeks to find a working configuration but always at least one thing works incorrect. What shall I do? How can I make one of these configurations work. I prefer to make the first one work first (Make Vuforia work with XRSession), since this is Magic Leap's current working configuration. All the others are temporary solutions.

Best regards

本文标签： Vuforia Engine not starting camera with XRSession (with ML Rig) on Magic Leap 2Stack Overflow