Abstract:Every step we take in the digital world leaves behind a record of our behavior; a digital footprint. Research has suggested that algorithms can translate these digital footprints into accurate estimates of psychological characteristics, including personality traits, mental health or intelligence. The mechanisms by which AI generates these insights, however, often remain opaque. In this paper, we show how Explainable AI (XAI) can help domain experts and data subjects validate, question, and improve models that … Show more
“…In, [14], we gained an understanding of these extracted features by interpreting the dynamics of the RNN state space through a set of attractors. Understanding model behavior is crucial in industries such as personal finance [10]. In their study, [10] extracted rules from three classes of modelslinear regression, logistic regression, and random forests-which not only exposed the spending patterns most indicative of personality traits, but also aided in model improvement.…”
Section: Background and Related Workmentioning
confidence: 99%
“…Explainability and interpretability are key in sensitive industries, such as finance [9]; they form the basis for understanding and trust and have not yet been adequately addressed [10,11]. In short, our agents' policies are regularized by predefined prior action distributions which imprint characteristic behaviors, making their policies inherently interpretable on three levels: (1) they use salient features extracted from customer spending behavior, (2) the affinity of the prototypical agents, and (3) their orchestration to achieve personal investment advice.…”
The common purpose of applying reinforcement learning (RL) to asset management is the maximization of profit. The extrinsic reward function used to learn an optimal strategy typically does not take into account any other preferences or constraints. We have developed a regularization method that ensures that strategies have global intrinsic affinities, i.e., different personalities may have preferences for certain assets which may change over time. We capitalize on these intrinsic policy affinities to make our RL model inherently interpretable. We demonstrate how RL agents can be trained to orchestrate such individual policies for particular personality profiles and still achieve high returns.
“…In, [14], we gained an understanding of these extracted features by interpreting the dynamics of the RNN state space through a set of attractors. Understanding model behavior is crucial in industries such as personal finance [10]. In their study, [10] extracted rules from three classes of modelslinear regression, logistic regression, and random forests-which not only exposed the spending patterns most indicative of personality traits, but also aided in model improvement.…”
Section: Background and Related Workmentioning
confidence: 99%
“…Explainability and interpretability are key in sensitive industries, such as finance [9]; they form the basis for understanding and trust and have not yet been adequately addressed [10,11]. In short, our agents' policies are regularized by predefined prior action distributions which imprint characteristic behaviors, making their policies inherently interpretable on three levels: (1) they use salient features extracted from customer spending behavior, (2) the affinity of the prototypical agents, and (3) their orchestration to achieve personal investment advice.…”
The common purpose of applying reinforcement learning (RL) to asset management is the maximization of profit. The extrinsic reward function used to learn an optimal strategy typically does not take into account any other preferences or constraints. We have developed a regularization method that ensures that strategies have global intrinsic affinities, i.e., different personalities may have preferences for certain assets which may change over time. We capitalize on these intrinsic policy affinities to make our RL model inherently interpretable. We demonstrate how RL agents can be trained to orchestrate such individual policies for particular personality profiles and still achieve high returns.
“…In Maree and Omlin (2022c), we gained an understanding of these extracted features by interpreting the dynamics of the RNN state space through locating the set of attractors that govern the model. Understanding model behavior is crucial in industries such as personal finance (Ramon et al, 2021). In their study, Ramon et al (2021) extracted rules from three classes of models-linear regression, logistic regression, and random forests-which not only exposed the spending patterns most indicative of personality traits, but also aided in model improvement.…”
Section: Background and Related Workmentioning
confidence: 99%
“…Understanding model behavior is crucial in industries such as personal finance (Ramon et al, 2021). In their study, Ramon et al (2021) extracted rules from three classes of models-linear regression, logistic regression, and random forests-which not only exposed the spending patterns most indicative of personality traits, but also aided in model improvement.…”
Section: Background and Related Workmentioning
confidence: 99%
“…Explainability and interpretability form the basis for understanding and trust (Barredo Arrieta et al, 2020). They are imperative for critical industries such as finance, but they have not yet been adequately addressed (Ramon et al, 2021;Cao, 2021). We regularize our agents' policies by predefined prior action distributions, thus imprinting characteristic behaviors that make their policies inherently interpretable on three levels: (1) the salient features extracted from customer spending behavior, (2) the affinities of the prototypical agents, and (3) their orchestration to achieve personal investment advice.…”
The purpose of applying reinforcement learning (RL) to portfolio management is commonly the maximization of profit. The extrinsic reward function used to learn an optimal strategy typically does not take into account any other preferences or constraints. We have developed a regularization method that ensures that strategies have global intrinsic affinities, i.e., different personalities may have preferences for certain asset classes which may change over time. We capitalize on these intrinsic policy affinities to make our RL model inherently interpretable. We demonstrate how RL agents can be trained to orchestrate such individual policies for particular personality profiles and still achieve high returns.
As the range of decisions made by Artificial Intelligence (AI) expands, the need for Explainable AI (XAI) becomes increasingly critical. The reasoning behind the specific outcomes of complex and opaque financial models requires a thorough justification to improve risk assessment, minimise the loss of trust, and promote a more resilient and trustworthy financial ecosystem. This Systematic Literature Review (SLR) identifies 138 relevant articles from 2005 to 2022 and highlights empirical examples demonstrating XAI's potential benefits in the financial industry. We classified the articles according to the financial tasks addressed by AI using XAI, the variation in XAI methods between applications and tasks, and the development and application of new XAI methods. The most popular financial tasks addressed by the AI using XAI were credit management, stock price predictions, and fraud detection. The three most commonly employed AI black-box techniques in finance whose explainability was evaluated were Artificial Neural Networks (ANN), Extreme Gradient Boosting (XGBoost), and Random Forest. Most of the examined publications utilise feature importance, Shapley additive explanations (SHAP), and rule-based methods. In addition, they employ explainability frameworks that integrate multiple XAI techniques. We also concisely define the existing challenges, requirements, and unresolved issues in applying XAI in the financial sector.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.