Markdowns in E-Commerce Fresh Retail: A Counterfactual Prediction and Multi-Period Optimization Approach

Abstract

While markdowns in retail have been studied for decades in traditional business, nowadays e-commerce fresh retail brings much more challenges. Due to the limited shelf life of perishable products and the limited opportunity of price changes, it is difficult to predict sales of a product at a counterfactual price, and therefore it is hard to determine the optimal discount price to control inventory and to maximize future revenue. Traditional machine learning-based methods have high predictability but they can not reveal the relationship between sales and price properly. Traditional economic models have high interpretability but their prediction accuracy is low. In this paper, by leveraging abundant observational transaction data, we propose a novel data-driven and interpretable pricing approach for markdowns, consisting of counterfactual prediction and multi-period price optimization. Firstly, we build a semi-parametric structural model to learn individual price elasticity and predict counterfactual demand. This semi-parametric model takes advantage of both the predictability of nonparametric machine learning model and the interpretability of economic model. Secondly, we propose a multi-period dynamic pricing algorithm to maximize the overall profit of a perishable product over its finite selling horizon. Different with the traditional approaches that use the deterministic demand, we model the uncertainty of counterfactual demand since it inevitably has randomness in the prediction process. Based on the stochastic model, we derive a sequential pricing strategy by Markov decision process, and design a two-stage algorithm to solve it. The proposed algorithm is very efficient. It reduces the time complexity from exponential to polynomial. Experimental results show the advantages of our pricing algorithm, and the proposed framework has been successfully deployed to the well-known e-commerce fresh retail scenario -Freshippo.

GCF: Generalized Causal Forest for Heterogeneous Treatment Effect Estimation in Online Marketplace

“…A series of algorithms have been developed to address the problem of HTE estimation. The earliest solution can date back to when uplift modeling had most appeals as in [25] and recently adoptions in online marketplaces such as [15,31]. However, these implementations fail to discuss how to mitigate confounding bias which is prevalent in observational data.…”

Machine Learning based Framework for Robust Price-Sensitivity Estimation with Application to Airline Pricing

“…Although this architecture was originally proposed for recommender systems, we adapt it for the price-sensitivity estimation problem. Figure 1 shows this architecture for the Poisson semi-parametric model in (1). This method provides a direct way to construct an estimator for the Poisson semi-parametric model and can be implemented relatively easily using packages such as tensorflow, tensorflow-probability, or PyTorch.…”

“…Automated dynamic pricing systems that can enable such functionality typically require estimates of customers' price-sensitivity at this granular level using historical sales transaction data. Although modern IT systems have made it possible to collect and use rich request-specific information from a shopping session, the estimation of price-sensitivity from such feature-rich historical observational data still remains a challenging task in many industries [1,2]. This is especially true when the firm is only able to observe the total quantity sold for a product at a certain price in given time period but is unable to observe customer requests that did not result in a sale.…”

Optimizing E-commerce Inventory to prevent Stock Outs using the Random Forest Algorithm Approach

“…They use a semi-parametric structural approach to model individual price elasticities and optimize perishable product prices over time. This research opens new avenues in designing pricing strategies for fresh products with tight sales deadlines [6]. Research by Wang (2023) proposed an Internet of Things (IoT)-based framework to improve cross-border e-commerce supply chain performance.…”