AR is about to usher in a killer application

Editor’s note: This article comes from WeChat public account “qubit” (ID: QbitAI ) , author: Xiao investigation.

Just this morning, Apple released the iOS / iPadOS 13.4 update. In addition to the regular upgrade, there is a seemingly inconspicuous update: ARKit 3.5 has been added.

If you followed the iPad Pro released last week, you must have guessed that ARKit 3.5 is for its lidar.

What is the experience of putting lidar on iPad? I was shocked to see the effect of the

From 2017, Apple has been promoting AR (augmented reality), but only games such as MineCraft at the press conference were impressive and few manufacturers followed up. Magic Leap, who once developed AR glasses, is also on the verge of selling.

What is the experience of putting lidar on iPad? I was shocked to see the effect of the

AR seems to be far from the day when large-scale practical applications will be made, but the advent of the iPad Pro Lidar may change this situation.

About ARKit 3.5

In today’s updated ARKit 3.5, Apple has added a new “Scene Geometry” API that allows developers to create 3D maps of rooms using lidar scanners on the iPad Pro, identifying floors, walls, and ceilings , Tables, chairs and sofas.

What is the experience of putting lidar on iPad? I was shocked to see the effect of the

It can accurately measure the length, width, and height of objects within 5 meters, perceive the direction of each plane of the object, and even find the occlusion relationship between objects, so that the digital content and scene embedded in the video are better. mix together.

What is the experience of putting lidar on iPad? I was shocked to see the effect of the

This brings a qualitative leap to the rangefinder App experience that comes with iOS.

The previous iPad and iPhone used the depth of field of the camera to sense the distance of the object. In fact, the rangefinder photos do not contain real 3D information.

Everyone who has used the rangefinder knows that, for example, when we measure the length of a table, the start and end points of the rangefinder are difficult to accurately place on the edge of the table. This compromises our measurement accuracy.

What is the experience of putting lidar on iPad? I was shocked to see the effect of the

The rangefinder app on the iPad Pro is very different from other Apple devices because of the existence of lidar.

The iPad Pro, which is equipped with lidar, can automatically recognize the edge when it reaches the end of an object such as a table to be measured.

What is the experience of putting lidar on iPad? I was shocked to see the effect of the

△ Pictures are transferred from Webbus video

And if you get closer, more details will be shown on the screen, such as a new ruler view that appears automatically.

Digital reviewer Weibus has a detailed introduction to the iPad Pro’s lidar in his review video: