Benchmark on Indoor Modeling

Introduction

Up-to-date spatial models of indoor environments are needed in a growing number of applications, including navigation, emergency response and a range of location-based services. Automated generation of 3D indoor models from point cloud data has been a topic of intensive research in recent years. While results on various datasets have been reported in literature, a comparison of the performance of different methods has not been possible due to the lack of benchmark datasets and a common evaluation framework.

The ISPRS Benchmark on Indoor Modelling aims to address this issue by providing a public benchmark dataset and an evaluation framework for performance comparison of indoor modelling methods.

The Scientific Initiative is already ongoing. If you are interested in participation, instructions on how to download the datasets will be inmediately provided after filling this questionnaire. Participants are invited to submit their models for evaluation. The results will be released in a few weeks and published in the ISPRS WG IV/5 website.

Detailed information about the datasets and the test is provided in the pdf file that can be downloaded here: 

Conditions of use

The download of the datasets is subjected to the following conditions:

  • Datasets must be used for research purposes only. Any other use is prohibited.
  • Datasets must not be used outside the context of this Scientific Initiative.
  • Datastes must not be distributed to third parties. Any person interested in the data may obtain them via ISPRS WG IV/5.
  • If the datasets are used in any publication, please acknowledge the ISPRS WG IV/5 for the provision of the data, and cite the Benchmark paper: Khoshelham, K., Díaz Vilariño, L., Peter, M., Kang, Z., and Acharya, D.: THE ISPRS BENCHMARK ON INDOOR MODELLING, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-2/W7, 367-372, https://doi.org/10.5194/isprs-archives-XLII-2-W7-367-2017, 2017.

Important dates

The scientific initiative is open for submission until 30 June 2018. If you are interested in participating in the test, please submit your models before this date.

Submission of models

The quantitative evaluation is limited to walls, floors, ceilings, doors and windows. Other elements, such as stairs and columns, are excluded from the evaluation.

Participants can submit their models in any format. In addition to a short explanation of the modeling method, a readme file containing instructions on how to visualize the model and access to its components is required.

Please compress your files in a zip file and send it via email to lucia@uvigo.es.