This course covers the basics of financial impact estimation for machine learning models deployed in business processes. We will discuss the general approaches to financial estimation, consider the applications to credit scoring and marketing response models, and focus on the relationship between statistical model quality metrics and financial results, as well as the concepts of A/B testing and potential biases as they apply to historical data.
提供方
Estimating ML-Models Financial Impact
俄罗斯国家研究型高等经济大学课程信息
Basic experience with binary classification models, statistics and Python
您将学到的内容有
Estimating ML models financial impact for binary classification models
Design and evaluation of A/B tests
Reject inference
您将获得的技能
Basic experience with binary classification models, statistics and Python
提供方

俄罗斯国家研究型高等经济大学
HSE University is one of the top research universities in Russia. Established in 1992 to promote new research and teaching in economics and related disciplines, it now offers programs at all levels of university education across an extraordinary range of fields of study including business, sociology, cultural studies, philosophy, political science, international relations, law, Asian studies, media and communicamathematics, engineering, and more.
教学大纲 - 您将从这门课程中学到什么
Project valuation: valuation metrics, planning and rules
Model development and deployment is always a project. During this week, we will discuss project valuation. We will consider the general financial metrics such as Net Present Value, Internal Rate of Return, and others.
Model quality and decision making. Benefit curve
During the second week, we will focus on decision-making based on model predictions and the relationship between model quality and financial benefit. We will discuss how to plot benefit curves using different threshold decisions and optimize the financial results using threshold tuning.
Estimating model risk discounts
When a model is being used in the production environment for a long time, its quality can deteriorate. During this week, we will learn to calculate confidence intervals for model quality estimates and estimate potential negative financial effects.
A/B testing and financial result verification
A/B testing is a great way to verify our expectations concerning the financial effects. During this week, we will discuss the principles of A/B testing, its design, as well as the ways to assess its outcomes.
常见问题
我什么时候能够访问课程视频和作业?
我购买证书后会得到什么?
Is financial aid available?
完成课程后,我会获得大学学分吗?
还有其他问题吗?请访问 学生帮助中心。