Alignment of Unsupervised Machine Learning with Human Understanding: A Case Study of Connected Vehicle Patents

Abstract

As official public records of inventions, patents provide an understanding of technological trends across the competitive landscape of various industries. However, traditional manual analysis methods have become increasingly inadequate due to the rapid expansion of patent information and its unstructured nature. This paper contributes an original approach to enhance the understanding of patent data, with connected vehicle (CV) patents serving as the case study. Using free, open-source natural language processing (NLP) libraries, the author introduces a novel metric to quantify the alignment of classifications by a subject matter expert (SME) and using machine learning (ML) methods. The metric is a composite index that includes a purity factor, evaluating the average ML conformity across SME classifications, and a dispersion factor, assessing the distribution of ML assigned topics across these classifications. This dual-factor approach, labeled the H-index, quantifies the alignment of ML models with SME understanding in the range of zero to unity. The workflow utilizes an exhaustive combination of state-of-the-art tokenizers, normalizers, vectorizers, and topic modelers to identify the best NLP pipeline for ML model optimization. The study offers manifold visualizations to provide an intuitive understanding of the areas where ML models align or diverge from SME classifications. The H-indices reveal that although ML models demonstrate considerable promise in patent analysis, the need for further advancements remain, especially in the domain of patent analysis.

Using Learning Focal Point Algorithm to Classify Emotional Intelligence

“…In addition to basic image processing functions, OpenCV boasts an array of advanced capabilities, including morphological operations, color space transformations, and an extensive set of computer vision algorithms. These algorithms cover a broad range of applications, including object detection, feature extraction, image stitching, and camera calibration [41], [42], [43]. Moreover, OpenCV seamlessly integrates with popular machine learning frameworks, providing support for essential tasks like classification, clustering, and regression.…”

Corn leaf disease: insightful diagnosis using VGG16 empowered by explainable AI

“…This decision-making process must be transparent so that people can trust AI as a part of their daily routine ( Hagras, 2018 ). Machine learning and interoperability mean presenting machine learning models in a way understandable to humans ( Linardatos et al., 2020 ); Bridgelall, 2024 ). While interpretability ensures the model is transparent before deployment, explainability explains the black box model post hoc .…”