フレクトのクラウドblog re:newal

http://blog.flect.co.jp/cloud/からさらに引っ越しています

New iPad Pro with LiDAR max distance

技術開発室の馮 志聖(マイク)です。

Introduction

I work in some project and it use New iPad Pro with LiDAR.

I try to find out the LiDAR sensor max distance.

But I can not find out any information about this.

So I try to do some experimental test.

Visual SLAM

ios ARkit is base on this.

It will create a map for AR.

And base on Localization & Mapping.

How Visual SLAM work?

IMU (Inertial Measurement Unit、慣性計測装置) with Camera.

LiDAR SLAM

What is LiDAR (Light Detection and Ranging)?

LiDAR is depth sensor.

It can detect depth data.

How LiDAR SLAM work?

IMU (Inertial Measurement Unit、慣性計測装置) + LiDAR + Camera.

issue

Brightness

For this case I will test it in morning and night.

And use application to detect the value of brightness.

Task

f:id:fengchihsheng:20200514132739p:plain
test illustration

iPhone X without LiDAR result in morning

Value of brightness (AVG) : 7291 Lux

Value of brightness (MAX) : 8187 Lux

Max distance is 1.65 meter.

If more than 1.65 meter value will unstable.

f:id:fengchihsheng:20200514221506p:plain
Value of brightness

f:id:fengchihsheng:20200514144932j:plain
test for 1 meter

f:id:fengchihsheng:20200514144958j:plain
confirm 1 meter

f:id:fengchihsheng:20200514145026j:plain
max distance 1.65 meter

f:id:fengchihsheng:20200514145132j:plain
confirm 1.65 meter

New iPad Pro with LiDAR result in morning

Value of brightness (AVG) : 10605 Lux

Value of brightness (MAX) : 14371 Lux

Max distance is 5.24 meter.

If more than 5.24 meter value will unstable.

f:id:fengchihsheng:20200514221536p:plain
Value of brightness

f:id:fengchihsheng:20200514133057j:plain
test for 1 meter

f:id:fengchihsheng:20200514134220j:plain
confirm 1 meter

f:id:fengchihsheng:20200514133147j:plain
test for 2 meter

f:id:fengchihsheng:20200514134355j:plain
confirm 2 meter

f:id:fengchihsheng:20200514133211j:plain
test for 3 meter

f:id:fengchihsheng:20200514180553j:plain
confirm 3 meter

f:id:fengchihsheng:20200514133239j:plain
test for 4 meter

f:id:fengchihsheng:20200514134457j:plain
confirm 4 meter

f:id:fengchihsheng:20200514133303j:plain
test for 5 meter

f:id:fengchihsheng:20200514134520j:plain
confirm 5 meter

f:id:fengchihsheng:20200514133326j:plain
max distance 5.24 meter

f:id:fengchihsheng:20200514134545j:plain
confirm 5.24 meter

New iPad Pro with LiDAR result in night

Value of brightness (AVG) : 0 Lux

Value of brightness (MAX) : 0 Lux

Max distance is 5.24 meter.

If more than 5.24 meter value will unstable.

f:id:fengchihsheng:20200514221558p:plain
Value of brightness

f:id:fengchihsheng:20200514133809j:plain
test for 1 meter

f:id:fengchihsheng:20200514134619j:plain
confirm 1 meter

f:id:fengchihsheng:20200514133830j:plain
test for 2 meter

f:id:fengchihsheng:20200514134644j:plain
confirm 2 meter

f:id:fengchihsheng:20200514133857j:plain
test for 3 meter

f:id:fengchihsheng:20200514134712j:plain
confirm 3 meter

f:id:fengchihsheng:20200514133918j:plain
test for 4 meter

f:id:fengchihsheng:20200514134735j:plain
confirm 4 meter

f:id:fengchihsheng:20200514133940j:plain
test for 5 meter

f:id:fengchihsheng:20200514134759j:plain
confirm 5 meter

f:id:fengchihsheng:20200514134002j:plain
max distance 5.24 meter

f:id:fengchihsheng:20200514134816j:plain
confirm 5.24 meter

Final

Depth result will not influence of brightness.

issue

Dark place

Camera can not work in dark place.

So even only LiDAR is work fine.

But ARKit doesn't work.

Other real object nearby the target 3D Object

iPhone X without LiDAR can not detect it.

New iPad Pro with LiDAR will detect it and hidden the part of target 3D Object.

3D scanner

iPhone X without LiDAR can not detect more detail concave-convex on real Object.

New iPad Pro with LiDAR can detect more detail concave-convex on real Object.

New iPad Pro with LiDAR will work better on 3D scanner.

And also can scan more large object.

Unstable value of distance

iPhone X without LiDAR have a lot of unstable depth value.

It need to scan more views to confirm the distance.

New iPad Pro with LiDAR have stable depth value.

The 3D object position will stable.

Other

Tell us what do you think about our result , or anything else that comes to mind.

We welcome all of your comments and suggestions.

Next time I will do more detail testing.

Reference

SLAM
LiDAR