Pharmacogenomics Study Design: Using QTL Mapping to Analyze Drug Response
For Research Use Only. Not for use in diagnostic procedures or clinical decision-making.
Drug response varies between individuals — sometimes dramatically. One patient's tumor shrinks on a standard chemotherapy regimen; another's, with the same diagnosis, continues growing. A preclinical cell line panel shows 100-fold differences in IC50 for the same compound. These differences have a genetic basis, and QTL mapping is the analytical framework that finds the responsible variants.
This guide covers how to design a drug response QTL mapping study from the phenotype up — which metrics to collect, how to handle batch effects, what genotype data work at each budget level, how many samples you need for adequate power, and the four-step interpretation pipeline that turns a QTL interval into a testable candidate locus. It is written for research teams that have drug response phenotype data in hand, or are planning to generate it, and need to scope the genomics component of the project.
Figure 1: The three data pillars of a drug response QTL study — phenotype, genotype, and covariates — must be collected and QC'd in parallel before association testing.
What Drug Response QTL Mapping Measures
A quantitative trait locus (QTL) is a genomic region where genetic variation correlates with variation in a measurable trait. When the trait is drug response — cell viability after compound treatment, change in LDL cholesterol after statin administration, tumor shrinkage in a patient-derived xenograft — the QTL becomes a drug response QTL.
Drug response QTL mapping differs from GWAS in two ways. First, the phenotype is inherently continuous and dose-dependent. A GWAS for "statin efficacy" might compare high vs. low responders as a binary trait; a QTL study would model LDL reduction as a function of genotype at each variant, preserving the full dynamic range of the response. Second, drug response QTLs are explicitly mechanistic — the goal is not just statistical association but identification of variants that explain why some individuals respond and others do not, typically through effects on drug target expression, metabolism, or downstream pathway activity.
The analytical foundation is straightforward: genotype a population, measure a drug response phenotype in each sample, and test for association between each genetic variant and the phenotype. The complexity is in the details — phenotype measurement, batch control, covariate selection, and population structure correction. Each of these details is addressed in the sections below.
For projects that combine drug response phenotypes with genomic data, Drug Response QTL Profiling integrates genotype–phenotype association with cell line panels, animal models, or population cohort data.
Picking Your Phenotype Metric
The single most consequential decision in a drug response QTL study is how you measure and summarize the phenotype. A weak or noisy phenotype defeats even the best-powered genotype study.
Table 1: Drug Response Phenotype Metrics Compared
| Metric | Definition | Strengths | Weaknesses |
| IC50 | Concentration producing 50% inhibition | Intuitive, widely reported | Inestimable if 50% inhibition never reached; right-censored; extrapolation-dependent |
| AUC / AAC | Area Under (or Above) the dose-response curve | Always estimable; integrates potency and efficacy; more reproducible across datasets | Relative to concentration range tested; requires standardized dosing |
| Emax | Viability at maximum tested concentration | Simple, no curve fitting | Ignores curve shape; throws away data from lower concentrations |
| DSS | Drug Sensitivity Score (AUC-based normalization) | Designed for cross-study consistency | Less widely adopted |
AUC/AAC is the recommended primary metric for QTL mapping. Multiple independent analyses comparing the major pharmacogenomic datasets — CCLE, GDSC, CTRP, gCSI — have shown that AUC-based metrics produce more stable gene–drug associations and better cross-dataset generalization than IC50. The reason is straightforward: IC50 can only be estimated when viability drops below 50%, which fails for resistant samples and right-censors values outside the tested concentration range. AUC is always estimable.
Before deriving summary metrics, you need to fit a dose-response curve to each sample's viability measurements across multiple drug concentrations. Three approaches are standard:
- 4-parameter logistic (4PL) model. The traditional sigmoid fit: viability = f(concentration; IC50, Hill slope, Emin, Emax). Works well when dose points capture both the upper and lower plateaus. Fails when 50% inhibition is not reached.
- Gaussian process (GP) regression. A Bayesian nonparametric approach that provides full posterior uncertainty estimates for summary statistics. Recommended when curve shapes are heterogeneous or when you need to propagate curve-fitting uncertainty into downstream QTL testing.
- Linear interpolation (trapezoidal AUC). Simple, assumption-free. Works adequately for dense dose series but throws away information about the curve shape.
For research-stage QTL studies with cell line panels, 4PL or GP regression is appropriate. For population-scale studies with a single drug concentration per sample, Emax at that concentration is the only feasible metric — be explicit about this limitation.
Drug response assays are sensitive to subtle environmental differences. The most effective batch mitigation is randomizing sample placement across plates and including bridge samples — a set of reference samples run on every plate — to quantify and correct for plate-to-plate variation. For population-scale studies, include batch as a covariate in the QTL model. For deeper treatment of batch detection methods, review our cohort-scale QC guide.
Figure 2: From dose-response data to QTL results — the four processing stages, with batch correction applied before association testing.
Genotype Data That Works
The genotype half of the QTL equation is more forgiving than the phenotype half — but only if you choose the right data type for your study design.
Table 2: Genotyping Strategy by Study Type
| Study Type | Recommended Approach | Minimum Sample-Level Coverage | Notes |
| Cell line panel (50–1000 lines) | WGS or WES | ≥10× (WGS), ≥50× (WES) | Deep variant discovery in pharmacogenes is critical; many drug-metabolizing genes (CYPs, UGTs) harbor rare functional variants missed by arrays |
| Animal model cohort (inbred/outbred) | GBS, ddRAD, or low-pass WGS with imputation | ≥2× (GBS), ≥0.5× (low-pass + imputation) | Imputation to a strain-specific reference panel recovers most common variants |
| Human population cohort | SNP array (≥500K markers) with imputation, or low-pass WGS | Array standard; ≥0.5× for low-pass | Imputation to a population-matched reference panel (TOPMed, 1000G) is essential |
| Multi-omics integration | WGS + RNA-seq + methylation array | ≥10× (WGS), ≥30M reads (RNA-seq) | Multi-omics multiplies the power to identify functional QTLs but also multiplies the budget |
For any study design, variant calling quality determines QTL quality. Variants called with GQ < 20 or DP < 5 should be filtered before QTL testing. Low-confidence genotypes at functional pharmacogene positions can produce false-positive QTL signals that are especially difficult to catch because they appear biologically plausible.
Approximately 200 genes have well-established roles in drug absorption, distribution, metabolism, excretion, and targets (ADME-Tox). Many — particularly CYP2D6, CYP2C19, UGT1A1 — contain structural variants, copy number polymorphisms, and hybrid alleles that standard short-read variant calling pipelines systematically miss or miscall. If your study focuses on a drug with a known pharmacogene, ensure your genotyping strategy captures structural variation in that gene. For broader discovery studies, acknowledge that pharmacogene SVs are an unresolved source of missing heritability.
Sizing Your Study for QTL Power
Power in QTL mapping depends on three factors: effect size (proportion of phenotypic variance explained by the QTL), allele frequency of the causal variant, and significance threshold. For a QTL explaining 5% of phenotypic variance in a trait with a common variant (MAF > 5%), you need approximately:
- Cell line panels: 100–500 cell lines for detecting common-variant QTLs explaining ≥5% of variance at genome-wide significance. Most published cell-line pharmacogenomic studies fall in the 200–1000 range.
- Animal model cohorts: 200–1000 individuals for outbred populations; 100–300 for inbred strain panels or recombinant inbred lines, which reduce environmental noise.
- Human population cohorts: 500–5000 individuals for common-variant drug response QTLs. Smaller cohorts (200–500) can detect large-effect QTLs for extreme response phenotypes but lack power for typical polygenic drug response traits.
These are feasibility thresholds, not guarantees. Underpowered QTL studies produce inflated effect size estimates (the "winner's curse") and fail to replicate in independent cohorts. If your sample size is fixed below these thresholds, plan from the outset to frame results as hypothesis-generating and specify how candidates will be validated.
If your study population contains genetic subpopulations — different breeds, strains, or ancestries — population structure must be corrected or it will dominate the QTL results. The mechanism is simple: if Population A differs from Population B both genetically and in mean drug response (for any reason — diet, environment, baseline health), then every variant that differs in frequency between A and B will appear to be a drug response QTL.
Standard correction approaches:
- Principal component (PC) covariates. Run PCA on the genotype matrix and include the top 5–10 PCs as covariates in the QTL model. This is the standard approach for human cohorts and works for most study designs. Population structure analysis provides the PC matrix and ancestry estimates.
- Linear mixed models (LMMs). Include a kinship matrix as a random effect (GEMMA, EMMAX, GCTA). More computationally expensive but more powerful when relatedness is complex (family structures, cryptic relatedness).
- Local ancestry adjustment. For admixed populations, adjust for local ancestry at each locus rather than global ancestry. Essential when studying populations with recent admixture.
Beyond population structure, the minimum covariate set for any drug response QTL study includes treatment batch (plate, assay date, technician), cell passage number (for cell line studies) or age/sex (for population studies), drug concentration range or administered dose, and baseline measurement of the response phenotype (pre-treatment value). List every factor known or suspected to influence the drug response measurement, and specify how each will be handled — measured and adjusted, controlled through randomization, or acknowledged as a limitation.
The Five-Stage QTL Mapping Workflow
A standard drug response QTL workflow proceeds through five stages:
- Stage 1 — Phenotype preprocessing. Fit dose-response curves, compute AUC per sample, quantile-normalize across samples within each drug, and regress out known batch effects. Output: a single normalized phenotype value per sample per drug.
- Stage 2 — Genotype QC. Filter variants by call rate (>95%), MAF (>1% for common-variant QTL, >0.1% for rare-variant aggregate tests), and Hardy-Weinberg equilibrium (p > 1×10−6 in controls). Output: a clean genotype matrix.
- Stage 3 — Covariate preparation. Compute PCs from the genotype matrix. Encode categorical batch variables as dummy variables. Center and scale continuous covariates. Output: a covariate matrix.
- Stage 4 — Association testing. For each variant, fit a linear model: phenotype ~ genotype_dosage + PCs + batch + covariates. For multi-drug studies, run this for each drug independently, then meta-analyze across drugs sharing the same target or pathway. Tools: PLINK2, GEMMA, TensorQTL (for cis-QTL with permutation), FastQTL.
- Stage 5 — Post-hoc filtering. Remove QTLs where the signal is driven by a single extreme sample. Check that residual distributions are approximately normal. Cross-reference significant QTLs with known pharmacogenes. Output: a candidate QTL list.
For researchers working with GWAS summary statistics rather than raw genotypes, GWAS analysis services can re-analyze existing data with drug-response-specific phenotype models.
Figure 3: The five-stage drug response QTL mapping workflow — from raw phenotype and genotype data through association testing to a filtered candidate QTL list.
Interpreting and Triaging QTL Results
A list of significant QTL intervals is a starting point, not a conclusion. The interpretation pipeline answers four questions for each QTL:
- Does the QTL colocalize with a known pharmacogene? Cross-reference the interval against PharmGKB, DrugBank, or ADME gene lists. A QTL overlapping CYP2D6 for a drug known to be metabolized by CYP2D6 is a stronger candidate than a QTL in a gene with no known drug relationship.
- Is the QTL an eQTL, mQTL, or splicing QTL? Overlap the QTL interval with publicly available eQTL catalogs (GTEx, eQTLGen) to check whether the lead variant or its proxies influence expression of a nearby gene in a relevant tissue. A drug response QTL that is also a liver eQTL for a drug-metabolizing enzyme is mechanistically interpretable.
- Does the effect direction make biological sense? If the QTL increases expression of a drug efflux transporter, the associated phenotype should show decreased drug sensitivity — not the reverse. An effect direction inconsistent with known biology does not rule out the QTL (it could reflect an unknown mechanism), but it requires stronger evidence to advance.
- Which variants in the credible set are most likely to be causal? Fine-map the QTL interval using statistical methods (SuSiE, FINEMAP, PAINTOR) to narrow the set of candidate causal variants. Then annotate each variant with functional predictions (CADD, DeepSEA, Enformer) and overlap with regulatory annotations (ENCODE cCREs, tissue-specific chromatin states).
For projects where drug response QTLs need to be integrated with other molecular data types — expression, methylation, protein levels — multi-omics integration provides the analytical framework for connecting variants to regulatory effects to phenotypic outcomes.
Project Readiness Checklist
Before contacting a provider for a drug response QTL study quote, assemble the following:
- Phenotype data: Metric defined (AUC preferred; IC50 or Emax acceptable with justification); number of drug compounds and concentration range per compound specified; number of dose points per dose-response curve (minimum 6 for 4PL fitting; minimum 8 for GP); replicate structure documented (technical replicates, biological replicates, or single measurement); known batch variables listed (plate, assay date, cell passage, serum lot).
- Genotype data: Genotyping platform specified (WGS, WES, array, GBS) or existing data format (FASTQ, BAM, VCF); sample count confirmed or target range provided; reference genome identified (species, assembly version); pharmacogenes of interest flagged for special analysis (CYP family, UGT family, transporters, drug targets).
- Covariates and study design: Population structure assessment — known subpopulations present? Relatedness structure? Covariate list: treatment batch, passage/age, baseline measurement, sex. Study design: cell line panel, animal cohort, human population cohort, or multi-omics integration. Expected deliverables: raw data, processed data, QTL summary statistics, candidate locus reports, interpretation.
- Project scope: Budget range and timeline expectations; target publication venue (informs QC and reporting standards); existing data to be re-analyzed vs. new data to be generated.
A complete checklist shortens provider quote turnaround from weeks to 2–5 business days and ensures all quotes are directly comparable. For a broader pre-contact preparation framework, see the population genomics project quote checklist.
Frequently Asked Questions
Yes, if you have individual-level genotype and phenotype data. GWAS summary statistics alone are insufficient for QTL fine-mapping, colocalization, and conditional analysis. If you have a VCF with per-sample genotypes and a quantitative drug response phenotype, you can run QTL mapping without generating new sequencing data. If your existing data is from a SNP array, imputation to a population-matched reference panel will recover variants not directly genotyped.
The core difference is the phenotype. A standard GWAS often uses a binary or single-time-point trait (disease status, height, biomarker level). A drug response QTL study uses a dose-dependent, quantitative phenotype — IC50, AUC, dose-response curve — that captures the full dynamic range of drug sensitivity. The analysis framework is similar (linear regression with covariates), but the phenotype preprocessing, batch correction, and interpretation steps are specific to drug response data.
Use AUC instead of IC50. AUC is always estimable regardless of whether viability crosses the 50% threshold. If AUC also looks flat (no response at any concentration), classify the sample as resistant and exclude it from QTL mapping for that drug — a QTL for "no response" is uninformative unless non-response itself is the trait of interest.
QTL mapping identifies individual loci with detectable effect sizes. Polygenic drug response — where hundreds or thousands of small-effect variants collectively influence the phenotype — is better modeled with polygenic risk scores (PRS) or variance component methods (GCTA, LDSC). For a study designed primarily for QTL discovery, compute the SNP heritability of your drug response phenotype as a QC step: if heritability is near zero despite adequate sample size, the phenotype measurement or batch correction pipeline needs revisiting.
References:
- Haibe-Kains B, El-Hachem N, Birkbak NJ, et al. Inconsistency in large pharmacogenomic studies. Nature. 2013;504(7480):389–393. doi:10.1038/nature12831
- Rees MG, Seashore-Ludlow B, Cheah JH, et al. Correlating chemical sensitivity and basal gene expression reveals mechanism of action. Nature Chemical Biology. 2016;12(2):109–116. doi:10.1038/nchembio.1986
- Smirnov P, Safikhani Z, El-Hachem N, et al. PharmacoGx: an R package for analysis of large pharmacogenomic datasets. Bioinformatics. 2016;32(8):1244–1246. doi:10.1093/bioinformatics/btv723
- Geeleher P, Gamazon ER, Seoighe C, Cox NJ, Huang RS. Consistency in large pharmacogenomic studies. Nature. 2016;540(7631):E1–E2. doi:10.1038/nature19838
- Sadowski M, Dahl AW, Zaitlen N. Protocol to estimate the heritability of drug response with GxEMM and identify gene-drug interactions with TxEWAS. STAR Protocols. 2025;6(2):103780. doi:10.1016/j.xpro.2025.103780
For Research Use Only. Not for use in diagnostic procedures or clinical decision-making.