DeepRadiation:An intelligent augmented reality platform for predicting urban energy performance just through 360 panoramic streetscape images utilizing various deep learning models  

作　　者：Ali Nakhaee Arefe Paydar 

机构地区：[1]Department of Architecture,Architecture School,College of Fine Arts,University of Tehran,Tehran 1415564583,Iran

出　　处：《Building Simulation》2023年第3期499-510,共12页建筑模拟（英文）

摘　　要：Urban energy simulation is critical for understanding and managing energy performance in cities.In this research,we design a novel framework called DeepRadiation,to enable automatic urban environmental performance prediction.By incorporating deep learning strategies,DeepRadiation predicts solar radiation on an urban scale using just panoramic streetscape images without any 3D modeling and simulation.New York City was chosen as the case study for this research.DeepRadiation is comprised of three different deep learning models organized into two stages.The first stage,named DeepRadiation modeling,serves as the framework's brain.At this stage,solar radiation analysis was performed using a Pix2Pix model,a type of conditional generative adversarial networks(GANs).After extracting GIS data and performing energy simulation analysis to prepare the dataset,the Pix2Pix model was trained on 10000 paired panoramic depth images of streetscapes with only building blocks and related panoramic images of streetscapes with only solar radiation analysis.Two GAN generator evaluation measures named qualitative evaluation and quantitative evaluation were used to validate the trained Pix2Pix model.Both demonstrated high levels of accuracy(qualitative evaluation:93%,quantitative evaluation:89%).DeepRadiation application as the DeepRadiation's sescond stage is the framework's eyes.At this stage,two convolutional neural network(CNN)models(DeepLabv3 and MiDaS)were used to perform computer vision tasks on panoramic streetscape images,such as semantic segmentation and depth estimation.The DeepRadiation application stage allows urban designers,architects,and urban policymakers to use the DeepRadiation framework and experience the final output via augmented reality.

关 键 词：automating urban energy simulation solar radiation analysis deep learning Pix2Pix computer vision augmented reality 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程] TP391.41[自动化与计算机技术—控制科学与工程]