基于CLIP嵌入和SVM的阿联酋住宅建筑文化遗产风格分类研究
Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM
这篇论文分享了一个具体的方法，用CLIP模型和SVM来分类阿联酋的建筑风格，准确率很高，对做相关研究的人可能有参考价值。
这篇论文提出了一种多模态机器学习框架，用于分析阿联酋的住宅建筑风格。它结合了OpenAI CLIP模型提取的视觉特征和专家描述的文本特征，将它们整合到一个512维的嵌入向量中。通过降维和聚类，再使用SVM分类器进行自动分类，在八个风格簇上达到了98%的分类准确率，优于现有研究。
Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM
The analysis and classification of cultural heritage architectural styles remain challenging due to the complexity of visual images of buildings, which are highly relied on in traditional CNN-based classification approaches in comparison to textual descriptions, and the relative lack of non-western region-specific datasets. This paper addresses this gap by proposing a multimodal machine learning framework to analyze and classify Emirati residential architecture using OpenAI's CLIP model. We integrate visual features from images and textual features from expert descriptions into a unified 512-dimensional embedding, followed by dimensionality reduction with UMAP for visualization and unsupervised clustering using K-Means. Cluster labels, which are derived from manual analysis of the K-Means clusters, are used to train an SVM classifier for automated architectural style classification. Our approach achieves a classification accuracy of 98% across eight identified style clusters, higher than every other study in the literature, demonstrating the effectiveness of combining visual and textual modalities. Overall, this paper highlights the potential of using multimodal AI to support architectural heritage analysis, offering scalable and interpretable tools for exploring regional architectural identities.