Files and links (1)
Sampson_Max_Dissertation3.40 MB
Embargoed Access, Embargo ends: 08/30/2026
Dissertation
Topics in conformal prediction for regression, with applications to causal inference
University of Iowa
Doctor of Philosophy (PhD), University of Iowa
Summer 2024
DOI: 10.25820/etd.007626
Abstract
In this dissertation, the research focuses on uncertainty quantification to create prediction intervals using exchangeable data for regression in the conformal prediction framework. There are several existing conformal regression methods, however, they fail to account for multimodal errors without partitioning the data.
First, we introduce two methods that attempt to find the highest predictive density sets, one for a conditional homoskedastic error and one for a conditional heteroskedastic error. Both leverage existing methods for finding the highest predictive density sets, allowing the methods to be easily implemented. Simulation studies are included to demonstrate the effectiveness of the methods compared to existing methods in a variety of settings. We establish theoretical asymptotic differences between the oracle highest density set and the estimated density set for the first method.
We then introduce hyperrectangular conformal prediction regions for $p$-dimensional responses for both point and quantile regression. We establish the finite sample coverage guarantees as well as asymptotic balance results. Extensive simulation studies are included to demonstrate how well the method works, and if the method achieves balance. Then we look at how well the method works compared with a Bonferroni correction in a real data application.
Lastly, we combine conformal prediction and conditional density estimation for individualized causal prediction intervals with a continuous treatment. We compare the conformal prediction intervals with unweighted na\"ive prediction intervals to demonstrate the advantages that the conformal prediction method has.
Details
- Title: Subtitle
- Topics in conformal prediction for regression, with applications to causal inference
- Creators
- Max Sampson
- Contributors
- Kung-Sik Chan (Advisor)Joseph Lang (Committee Member)Emily Roberts (Committee Member)Luke Tierney (Committee Member)Boxiang Wang (Committee Member)
- Resource Type
- Dissertation
- Degree Awarded
- Doctor of Philosophy (PhD), University of Iowa
- Degree in
- Statistics
- Date degree season
- Summer 2024
- Publisher
- University of Iowa
- DOI
- 10.25820/etd.007626
- Number of pages
- xiv, 142 pages
- Copyright
- Copyright 2024 Max Sampson
- Language
- English
- Date submitted
- 07/06/2024
- Description illustrations
- illustrations, graphs, tables
- Description bibliographic
- Includes bibliographical references (pages 105-118).
- Public Abstract (ETD)
- Machine learning, specifically deep learning models, has gained considerable popular- ity because of the flexibility they provide to answer different questions. One problem with these models is that they only provide a point estimate without any “wiggle room”, or un- certainty quantification. For example, if we wanted to predict someone’s income based on their age and college education, we could use a neural network. Though, the output would only be a single number that would almost certainly be different than the truth. Instead of a single point estimate, we want to focus on sets that provide a range of plausible values. In this dissertation we develop two methods that provide prediction sets for many types of models, including deep learning models. We then develop a method to provide uncertainty quantification when what we are predicting has multiple dimensions, for example systolic and diastolic blood pressures. Finally, we extend some of these prediction methods from associational relationships to cause and effect relationships. For example, “if you take 75 milligrams of aspirin, the aspirin will cause your fever to decrease between 2 and 3 degrees,” instead of, “when people take 75 milligrams of aspirin, for whatever reason their fevers will decrease an average of 1 to 2 degrees.”
- Academic Unit
- Statistics and Actuarial Science
- Record Identifier
- 9984697941202771
Metrics
1 Record Views