Justin Ding

Principal Researcher

About

Data analysis is crucial for uncovering insights and making informed decisions in both business and everyday life. In order to empower users and organizations with techniques to automatically discover insights in their data, I have been conducting research on insights at the Data, Knowledge, and Intelligence (opens in new tab) (a.k.a., DKI) group of Microsoft Research Asia (now DKI at E+D).

My research focuses on two important topics. One is how to formulate the insight concept into computable data entity, which is the fundamental problem of insight discovery. The other topic is about interpretability and causality which are also essential to make insights explainable and reliable. The insight-related research has also resulted in a series of tech-transfers as AI for analysis features in Microsoft products, including Power BI Quick Insights (opens in new tab), Excel Analyze Data (opens in new tab), and Forms Insights (opens in new tab).

Selective Publications:

Insights

[SIGMOD’19] QuickInsights: Quick and Automatic Discovery of Insights from Multi-Dimensional Data (opens in new tab) first proposes a general formulation of insight along with a systematic insight-mining framework.
[SIGMOD’17] [SIGMOD’21] Extracting Top-K Insights from Multi-dimensional Data (opens in new tab) and MetaInsight: Automatic Discovery of Structured Knowledge for Exploratory Data Analysis (opens in new tab) further extend the framework from the perspectives of compound calculus and compound knowledge, respectively.
[SIGMOD’23] XInsight: eXplainable Data Analysis Through the Lens of Causality (opens in new tab), which provides data analysis with qualitative and quantitative explanations of causal and non-causal semantics to facilitate more accurate data interpretation and decision-making in real-world scenarios.
[EMNLP’23 Demo] InsightPilot: An LLM-Empowered Automated Data Exploration System (opens in new tab), which is an LLM-based, automated data exploration system designed to simplify the data exploration process.

Causality & XAI

[KDD’22] pureGAM: Learning an Inherently Pure Additive Model (opens in new tab) extends Generalized Additive Models (GAMs) to model higher-order interactions across variables. It is the first time for the model to be identifiable and interpretable when modeling both categorical and numerical variables with their interactions
[SDM’23][KDD’22] Regarding causal discovery (a.k.a., causal structure learning), ML4C: Seeing Causality Through Latent Vicinity (opens in new tab) classifies edge orientation on the skeleton of an input causal graph and explores the benefits of supervision in causal discovery. This work is followed by ML4S: Learning Causal Skeleton from Vicinal Graphs (opens in new tab) that discusses how to learn a causal skeleton in a self-supervised learning setting

Project Media Links: