ISPRS Benchmark on Multisensorial Indoor Mapping and Positioning

Project Goals

The ISPRS BENCHMARK ON MULTISENSORIAL INDOOR MAPPING AND POSITIONING (MiMAP) project provided a common framework for the evaluation and comparison of LiDAR-based SLAM, BIM feature extraction, and smartphone-based indoor positioning methods.  Datasets are available from the this webpage and the mirror website http://mi3dmap.net/. Interested participants are invited to test their methods and submit their results for evaluation. For each of our datasets, we provide an evaluation metric and an evaluation submitting webpage. The evaluation results will be published on each dataset webpage.

Activities and Benchmark Datasets

MiMAP project team upgraded the XBeibao system (a multi-sensory backpack system developed by Xiamen University) to build the MiMAP benchmark. The upgraded system (Figure 1) can synchronously collect data with multi-beam laser scanners, fisheye cameras, and sensor records from smartphones.

Figure 1. The XBeibao System with Smartphone attached on top

The MiMAP benchmark includes three datasets:

We collected indoor point clouds dataset in three multi-floor buildings with the upgraded XBeibao. This dataset represents the typical indoor building complexity. We provide raw data of one indoor scene with ground truth for users’ evaluation. We also provide raw data of two scenes for evaluation by submitting. The evaluation criteria encompass the error to the ground truth point cloud acquired with a millimeter-level accuracy terrestrial laser scanner (TLS) (Figure 2(b)).

We established three data for evaluating the BIM feature extraction on indoor 3D point clouds. Ground truth data was manually built, and examples are presented in Figure 3.

We provide two data sequences with ground truth for users’ evaluation. We also provide three data sequences for evaluation by submitting results. The evaluation criteria encompass the error to the centimeter-level accuracy platform trajectory from the SLAM algorithm (Figure 4).

Figure 2. The Indoor LiDAR SLAM benchmark
(a) multi-beam laser scanning data and (b) the TLS reference point cloud

 

Figure 3. The BIM feature extraction benchmark
(a) (a-c) indoor point clouds, (d-f) the corresponding BIM frame features

 

Figure 4. The smartphone-based indoor positioning benchmark
(a)   Setup of the attached smartphone, (b)SLAM platform trajectory as synchronize reference

 

Conditions of use

The download of the datasets is subjected to the following conditions:

  • Datasets must be used for research purposes only. Any other use is prohibited.
  • Datastes must not be distributed to third parties. Any person interested in the data may obtain them via ISPRS WG I/6.
  • If the datasets are used in any publication, please acknowledge the ISPRS WG I/6 for the provision of the data, and cite the Benchmark paper:

C. Wen, Y. Dai, Y. Xia, Y. Lian, C. Wang, J. Li, Towards Efficient 3-D Colored Mapping in GPS/GNSS-denied Environments, IEEE Geoscience and Remote Sensing Letters, 17, 147-151, 2020.

C. Wang, S. Hou, C. Wen, Z. Gong, Q. Li, X. Sun, J. Li, Semantic Line Framework-based Indoor Building Modeling using Backpacked Laser Scanning Point Cloud, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 143, pp. 150-166, 2018.

Downloads

Please visit http://mi3dmap.net/ to download the data

Investigators

Dr. Cheng Wang (Principal Investigator)
Xiamen University, China

 

 

Dr. Naser Elsheimy (Co-Investigator)
University of Calgary, Canada

 

 

Dr. Chenglu Wen (Co-Investigator)
Xiamen University, China

 

 

Dr. Guenther Retscher (Co-Investigator)
TU Wien - Vienna University of Technology, Austria

 

Dr. Zhizhong Kang (Co-Investigator)
China University of Geosciences, Beijing

 

 

Dr. Andrea Lingua (Co-Investigator)
Polytechnic University of Turin, Italy

WG I/6

Figure 4

Fig1 1

Fig3

Traffic Sign

White

White

Logo

The International Society for Photogrammetry and Remote Sensing is a non-governmental organization devoted to the development of international cooperation for the advancement of photogrammetry and remote sensing and their applications. The Society operates without any discrimination on grounds of race, religion, nationality, or political philosophy.

Our Contact

ISPRS
c/o
Leibniz University Hannover
Institute of Photogrammetry and GeoInformation
Nienburger Str. 1
D-30167 Hannover
GERMANY
Email: isprs-sg@isprs.org