Benchmark on Indoor Modeling

Introduction

Up-to-date spatial models of indoor environments are needed in a growing number of applications, including navigation, emergency response and a range of location-based services. Automated generation of 3D indoor models from point cloud data has been a topic of intensive research in recent years. While results on various datasets have been reported in the literature, a comparison of the performance of different methods has not been possible due to the lack of benchmark datasets and a common evaluation framework.

The ISPRS Benchmark on Indoor Modelling aims to address this issue by providing a public benchmark dataset and an evaluation framework for performance comparison of indoor modelling methods.

The ISPRS Benchmark Test on Indoor Modelling is now closed for submission. This means that we are stopping evaluating and publishing new results on the website. However, the benchmark dataset will continue to be available to download. Moreover, BIM models have also been made available from October 2020. You can request access to the benchmark dataset - point clouds and BIM models- by completing this questionnaire.

Detailed information about the datasets and the benchmark test can be found in these papers:

• The ISPRS Benchmark on Indoor Modelling
• An evaluation framework for benchmarking Indoor Modelling Methods
• The ISPRS Benchmark on Indoor Modelling: preliminary results

Conditions of use

The download of the datasets is subjected to the following conditions:

• Datasets must be used for research purposes only. Any other use is prohibited.
• Datastes must not be distributed to third parties. Any person interested in the data may obtain them via ISPRS WG IV/5.
• If the datasets are used in any publication, please acknowledge the ISPRS WG IV/5 for the provision of the data, and cite the Benchmark paper: Khoshelham, K., Díaz Vilariño, L., Peter, M., Kang, Z., and Acharya, D.: THE ISPRS BENCHMARK ON INDOOR MODELLING, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-2/W7, 367-372, https://doi.org/10.5194/isprs-archives-XLII-2-W7-367-2017, 2017.

Downloads

The ISPRS website for the benchmark dataset was set up in September 2017. Since then, the dataset has been downloaded by 257 researchers from 30 countries. The following figure shows the download statistics of the benchmark dataset (last updated June 10th, 2022)

Important dates

The ISPRS Benchmark test on Indoor Modelling is now closed for submission.This means that we are stopping evaluating and publishing new results on the website. The benchmark dataset will continue to be available for downloading, as well as corresponding BIM models, and we encourage researchers to use the dataset to evaluate their methods on their own.