Benchmark on Indoor Modeling

Introduction

Up-to-date spatial models of indoor environments are needed in a growing number of applications, including navigation, emergency response and a range of location-based services. Automated generation of 3D indoor models from point cloud data has been a topic of intensive research in recent years. While results on various datasets have been reported in literature, a comparison of the performance of different methods has not been possible due to the lack of benchmark datasets and a common evaluation framework.

The ISPRS Benchmark on Indoor Modelling aims to address this issue by providing a public benchmark dataset and an evaluation framework for performance comparison of indoor modelling methods.

The Scientific Initiative is already ongoing. If you are interested in participation, instructions on how to download the datasets will be inmediately provided after filling this questionnaire. Participants are invited to submit their models for evaluation. The results will be released in a few weeks and published in the ISPRS WG IV/5 website.

Detailed information about the datasets and the test is provided in the pdf file that can be downloaded here: 

Conditions of use

The download of the datasets is subjected to the following conditions:

  • Datasets must be used for research purposes only. Any other use is prohibited.
  • Datasets must not be used outside the context of this Scientific Initiative.
  • Datastes must not be distributed to third parties. Any person interested in the data may obtain them via ISPRS WG IV/5.
  • If the datasets are used in any publication, please acknowledge the ISPRS WG IV/5 for the provision of the data, and cite the Benchmark paper: Khoshelham, K., Díaz Vilariño, L., Peter, M., Kang, Z., and Acharya, D.: THE ISPRS BENCHMARK ON INDOOR MODELLING, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-2/W7, 367-372, https://doi.org/10.5194/isprs-archives-XLII-2-W7-367-2017, 2017.

Important dates

This Scientific Initiative will finish at the end of February 2018. Therefore, participants are encouraged to submit their models before that date.

Submission of models

In order to facilitate the quantitative evaluation of models, we encourage the participants to use the IFC standard. This requires recontructing models as a set of parametric solids.

Submission instructions will be provided soon.