跳至主要内容
OpenAI

2026年6月30日

深入探索 Genebench-Pro

深入了解该基准测试、测试问题及其辅助材料。

案例研究

这 10 个案例研究展示了 GeneBench-Pro 中具有代表性的测试问题。每个案例均包含原始提示词 (prompt)、数据集及辅助材料。如需了解该基准测试的概况及核心发现,请参阅发布公告

注:文件预览仅展示完整数据集的节选内容。


案例研究 1

体细胞肿瘤学:基于结构变异的肿瘤治疗获益与风险决策

评估一种合成的 TXR1 靶向抑制剂,在靶点激活由结构变异驱动的肿瘤中,是否具有正向的临床效用。TXR1、TXR1i、DLR1 以及星等位基因 (star-allele) 均为合成的基准测试标签。

在将获益与毒性表现转化为最终的治疗决策之前,必须先从长读长测序 (long-read)、基因表达、肿瘤质量以及药物基因组学证据中识别出目标亚组。

向模型展示的公开提示词

A molecular tumor board registry contains trial-eligible advanced solid-tumor cases considered for a TXR1-directed inhibitor. Estimate, for tumors with SV-driven TXR1 target-mediated activation at time zero, the marginal effect of TXR1i versus non-TXR1 systemic therapy on week-16 clinical benefit as if all patients had an assessable week-16 visit. Also estimate the 8-week treatment-limiting toxicity/discontinuation risk under TXR1i in the same target population. Report net clinical utility = benefit risk difference (percentage points) - 0.35 * toxicity risk (percentage points), and choose therapy_class_code 1 if TXR1i has positive net utility and 0 otherwise. 

Use percentage-point units for all non-code quantities. Positive benefit means TXR1i improves week-16 clinical benefit relative to non-TXR1 systemic therapy.

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"therapy_class_code": <int>,
4
"benefit_rd_pp": <float>,
5
"toxicity_dropout_risk_pp": <float>,
6
"net_clinical_utility_pp": <float>
7
},
8
"reasoning": "<description of method and QC>"
9
}

提供给模型的文件

patient_idanalysis_setagesexsitecalendar_periodecogtumor_burdenprior_linesprior_resistancelineage_classtherapy_classassessed16benefit16tox_stop_8wktime_zero_day
MTB0001173.8MS1P220.78731ATXR1i010
MTB0002155.2MS3P112.63701ATXR1i1000
MTB0003168.8FS4P200.89121ATXR1i1110
MTB0004182.8FS2P224.10100BTXR1i1000
MTB0005165.5FS1P317.011ATXR1i1000

登记协变量、治疗方案、第 16 周评估结果、临床获益以及早期毒性。


案例研究 2

功能基因组学:CRISPR 靶点验证:lncRNA 转录本还是基因组位点?

判定某种显性的 lncRNA 依赖性究竟是转录本特异性的,还是由邻近位点及邻近基因效应所驱动的。

指向转录本层面的证据,必须能够经受住针对局部 DNA 位点扰动、邻近基因抑制、guide RNA 交换 (guide swaps)、GC 毒性以及孔板效应 (plate effects) 的对照检验。

向模型展示的公开提示词

You are given pooled CRISPRi screening data, guide-level local expression measurements, transcript-targeting CasRx follow-up data, and single-guide follow-up growth measurements for a nominated lncRNA program (LINC473) and a nearby coding gene (KIN1). The identifiers LINC473, KIN1, and ANKRD42 are synthetic benchmark labels; any resemblance to real human genes is coincidental.

Estimate the requested quantities.

Definitions:

  • lncrna_specific_lfc: the pooled-screen matched-control day-10 log2 growth effect expected at 100% effective knockdown of the dominant LINC473 transcript, not local DNA-locus effects.
  • neighbor_mediated_lfc: the pooled-screen matched-control day-10 log2 growth effect expected at 100% KIN1 repression in the local LINC473-locus model after accounting for concomitant LINC473 transcript knockdown.
  • advance_target: 1 if the evidence supports advancing LINC473 as a transcript-directed target, else 0.

Conventions:

  • all growth effects are log2(day10/day0) competitive-growth effects relative to matched controls;
  • more negative numbers indicate stronger loss of fitness;
  • set advance_target to 1 only if lncrna_specific_lfc <= -0.08 and neighbor_mediated_lfc > -0.25; otherwise 0.

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"advance_target": <int>,
4
"lncrna_specific_lfc": <float>,
5
"neighbor_mediated_lfc": <float>
6
},
7
"reasoning": "<description of method and QC>"
8
}

提供给模型的文件

guide_idnominal_targetchrcoordstranddist_lnc_tss_bpdist_neighbor_tss_bpguide_gc_frac
g001LINC473chr7100014+14300.624
g002LINC473chr7100035-43670.584
g003LINC473chr7100051+116560.622
g004LINC473chr7100066-59660.617
g005LINC473chr7100088+74770.715

guide RNA 的坐标、靶标、距离及 GC 特征。


案例研究 3

统计遗传学:在相关遗传位点中评估蛋白药物靶点的优先级

在处理检测量标 (assay scale)、等位基因方向、赢家诅咒 (winner's curse)、连锁不平衡 (LD) 以及残余局部多效性的同时,利用顺式多变量孟德尔随机化 (cis-MVMR) 评估两种临近蛋白质对疾病的直接因果效应。

这两种蛋白质共享一个存在连锁相关性的基因座。分析过程必须从边缘关联 (marginal associations) 推进到在统一的蛋白质尺度上,对考虑了 LD 的条件疾病效应进行评估。

向模型展示的公开提示词

You are given association summary statistics and metadata for two nearby proteins (PROTA and PROTB), a binary disease outcome, a locus correlation reference, and protein measurement records.

Goal: estimate the direct log-odds effect of each protein on the disease outcome per +1 SD increase in log10 concentration, conditional on the other protein.

Interpretation: theta_PROTA and theta_PROTB use the same log-odds per-SD scale defined in the goal.

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"theta_PROTA": <float>,
4
"theta_PROTB": <float>
5
},
6
"reasoning": "<description of method and QC>"
7
}

提供给模型的文件

snppos_bpeffect_alleleother_allelemafbetasepval
rs20000050000000AC0.422150.0064386683107068080.0032673300912034120.04876727714241972
rs20000150010126AC0.057090.0110089933375813010.0069552392087504070.11345916603941006
rs20000250020253GT0.090210.0099220147571163190.0056330230270155180.07817048492026045
rs20000350030379GT0.483990.0105692156141645730.00322914197402374450.0010638520681901973
rs20000450040506AG0.377030.0070365513782386540.00332975923212698020.034580976884336506

蛋白质 PROTA 在筛选阶段的关联汇总数据。


案例研究 4

临床基因组学 / 携带者筛查:基于 CNV 与假基因校准的 DRX1 携带者筛查残余风险

基于携带者筛查检测数据,评估特定族群的携带频率、筛查阴性后的残余风险、伴侣的携带频率,以及受累胎儿 (affected-conceptus) 风险。

残余风险的评估依赖于:排除假基因干扰的携带者检出 (pseudogene-aware carrier calls)、奠基者单倍型合并 (founder-haplotype collapse)、针对特定族群的实验校准,以及将已受试伴侣的数据标准化推算至全体伴侣名单。

向模型展示的公开提示词

Using cohort_roster.tsv.gz, partner_roster.tsv.gz, calibration_controls.tsv.gz, target_metadata.tsv.gz, and assay_observations.tsv.gz, estimate residual reproductive risk for an autosomal recessive DRX1 condition. Report all quantities on the probability scale, not as percentages: carrier_frequency_afr and carrier_frequency_eur among screening-roster adults; residual_carrier_risk_afr_negative for an AFR screening-roster adult with a negative DRX1 screen; partner_carrier_frequency_full_roster for a uniformly sampled partner_roster.tsv.gz row; and couple_reproductive_risk for an affected conceptus when the index person is AFR and screen-negative and the partner is drawn from partner_roster.tsv.gz. Assume autosomal recessive inheritance with a 1/4 affected-conceptus risk conditional on both biological parents being carriers. 

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"carrier_frequency_afr": <float>,
4
"carrier_frequency_eur": <float>,
5
"residual_carrier_risk_afr_negative": <float>,
6
"partner_carrier_frequency_full_roster": <float>,
7
"couple_reproductive_risk": <float>
8
},
9
"reasoning": "<description of method and QC>"
10
}

提供给模型的文件

sample_idcollectionancestryfamily_history_tier
S_EUR_0001screeningEUR0
S_EUR_0002screeningEUR0
S_EUR_0003screeningEUR0
S_EUR_0004screeningEUR0
S_EUR_0005screeningEUR1

筛查名单中成年人的族群背景与筛查背景信息。


案例研究 5

单细胞基因组学:环境 RNA 校正后的活化单核细胞 eQTL 分析

在从单细胞 RNA 测序 (scRNA-seq) 数据中去除环境 RNA 与技术污染后,评估基因型对活化单核细胞基因表达的影响。

环境 RNA 会同时影响靶基因的表达以及用于判定细胞活化状态的标志物组合 (marker panel),因此必须在构建 eQTL 模型之前完成校正。

向模型展示的公开提示词

Estimate the per-allele log rate ratio for CXCL10 expression in the activated monocyte subpopulation from the provided single-cell RNA-seq data. 

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"beta_activated": <float>
4
},
5
"reasoning": "<description of method and QC>"
6
}

提供给模型的文件

cell_iddonortotal_umiHBBIFI6ISG15LST1CXCL10
D01_C001D011113734835
D01_C002D01110363311210
D01_C003D0111419812639
D01_C004D01125076043217
D01_C005D0110459125115

标志物基因、污染标志物以及靶基因的单细胞 UMI 计数。


案例研究 6

结构遗传学:嵌套结构变异:表达支持证据与临床关联

评估一个匿名的类倒位 (inversion-like) 基因座内部的嵌套结构子单倍型,是否具有经过校准的临床关联以及可信的表达支持证据。

由于嵌套的拷贝数剂量 (copy-dosage) 信号极易受到更大范围倒位方向的混淆,因此剂量校准、表达支持证据分析以及临床建模必须作为相互独立的步骤分别进行处理。

向模型展示的公开提示词

Analyze the released files for anonymous Locus Q. Estimate the full-cohort source-population clinical association and molecular expression support for the calibrated nested segment-B structural copy dosage, separating the nested segment-B dosage from the broader outer-orientation dosage. Report subhap_log_or as the natural-log source-population total-effect odds ratio for case status per additional calibrated segment-B copy. Report expression_log_fc as the natural-log expression fold-change per calibrated segment-B copy for the expression-supported gene. Report target_support_code as 1 if the supported gene has a positive expression_log_fc and the clinical association is protective (subhap_log_or < 0), otherwise 0. Report n_calibrated_carriers as the number of reliable breakpoint-panel samples carrying at least one segment-B copy. 

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"n_calibrated_carriers": <int>,
4
"target_support_code": <int>,
5
"expression_log_fc": <float>,
6
"subhap_log_or": <float>
7
},
8
"reasoning": "<description of method and QC>"
9
}

提供给模型的文件

sample_idcaseageage_bandsexpc1pc2pc3ancestry_groupclinic_stratumrecruitment_stream
Q00012150.4550_640-1.01514-0.21032-0.08849EURtertiaryclinic
Q00028057.3950_640-1.25987-0.124980.2344EURregionalregistry
Q00029168.465_plus00.915980.621770.01891AFRtertiaryclinic
Q00030174.0765_plus10.21125-0.59634-0.08197EAScommunityregistry
Q00032182.8265_plus0-1.12034-0.243720.14665EURcommunityclinic

完整队列的临床及协变量数据。


案例研究 7

调控基因组学:屏蔽结构变异与比对伪迹后的染色质环强度测量

在从期望接触背景 (expected-contact background) 中去除低可比对性区域 (low-mappability) 与结构变异伪迹后,定量评估特定病例-对照组之间的 Hi-C 染色质环强度差异。

目标染色质环是在 20 kb 分辨率下定义的,但如果不先屏蔽低可比对性的接触信号以及仅在病例组中出现的结构变异 (SV) 条带 (stripe),期望接触模型就会失真。

向模型展示的公开提示词

You are given Hi-C contact matrices at 20 kb and 40 kb resolution plus bin annotations. Estimate the loop enrichment at the 20 kb interaction between `bin_id = 8` and `bin_id = 17` in `bins_20kb.tsv.gz`. Report three quantities: `case_loop_strength` (mean log2(observed/expected) across case replicates), `control_loop_strength` (mean log2(observed/expected) across control replicates), and `delta_loop_strength` (case minus control).

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"case_loop_strength": <float>,
4
"control_loop_strength": <float>,
5
"delta_loop_strength": <float>
6
},
7
"reasoning": "<description of method and QC>"
8
}

提供给模型的文件

bin_idchromstartendgc_contentmappabilityre_sites
0chr84000004200000.461990338215725940.97875742147042735
1chr84200004400000.50441242085346770.89010849434983975
2chr84400004600000.432184515849381940.90568792893267123
3chr84600004800000.47331972826812180.93765298406647893
4chr84800005000000.44449560621507480.86825655179818774

目标分辨率的区间 (bin) 注释。


案例研究 8

统计遗传学:基于奠基者重构的多亲本 QTL 定位

在一个拥有八个奠基者 (founder) 的重组群体中,通过在检测表型关联之前重构奠基者祖源信息,对 1 号染色体上的数量性状位点 (QTL) 进行定位。

观测到的标记数据虽然是双等位基因的,但生物学信号源自奠基者祖源。因此,一个严谨的分析必须先重构奠基者状态,核对标记方向,并将目标 QTL 与一个批次对齐产生的干扰峰值 (nuisance peak) 区分开来。

向模型展示的公开提示词

Map the chromosome 1 QTL in an 8-founder multi-parent population. Report the position (cM) and which founder carries the high-effect allele.

Report high_founder as "F1".."F8".

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"high_founder": "<string>",
4
"qtl_pos_cM": <float>
5
},
6
"reasoning": "<description of method and QC>"
7
}

Data files:

  • markers.tsv.gz: marker metadata
  • founders.tsv.gz: founder alleles at each marker
  • ril_genotypes.npz: observed RIL genotypes (biallelic)
  • phenotypes.tsv.gz: phenotype and covariates

提供给模型的文件

marker_idchrpos_cM
m2_065259.762431265596575
m2_103294.52656615104739
m2_107298.18761427503033
m2_079272.20130244108847
m1_054149.907510212292195

标记标识符、染色体编号及遗传图谱位置。


案例研究 9

群体遗传学:双亲特异性祖源与近期基因混合时间

在修复互反性片段伪迹 (reciprocal artifacts) 及特定染色体标签倒置后,基于定相的局部祖源片段,推断双亲特异性祖源比例及近期基因混合时间。

如果对互反性片段伪迹、染色体局部标签倒置或遗传图谱分母处理不当,祖源比例和混合脉冲时间 (pulse times) 均会发生改变。

向模型展示的公开提示词

You are given phased local-ancestry tracts for one admixed individual. Estimate, for each transmitted parental haplotype, the fraction of ancestry A across the called tract span and the number of generations since a single recent admixture pulse. Label parent1 as the haplotype with the smaller ancestry-A fraction and parent2 as the haplotype with the larger ancestry-A fraction. 

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"parent1_A_fraction": <float>,
4
"parent1_t": <float>,
5
"parent2_A_fraction": <float>,
6
"parent2_t": <float>
7
},
8
"reasoning": "<description of method and QC>"
9
}

提供给模型的文件

chromhapstart_morganend_morganancposteriorlow_complexity_frac
chr1h10.030.505A0.9850.08
chr1h10.5050.535B0.620.92
chr1h10.5351.478849A0.9850.08
chr1h11.5037271.852681B0.9850.08
chr1h11.8526812.422373A0.9850.08

包含坐标、祖源标签、后验概率值及质控 (QC) 注释的定相局部祖源片段。


案例研究 10

群体遗传学:从有噪的古 DNA 时间序列中估计自然选择作用

在考虑等位基因方向、方向性误差、遗传漂变及动态种群规模的前提下,从古等位基因频率时间序列中推断两个单倍型位点中哪一个受到更强的正向选择作用。

在将两个位点转换至相同的衍生等位基因尺度并对提供的样本级测序错误值进行直接建模之前,这些有噪的古代频率演化轨迹无法直接进行比较。

You are given allele-frequency time series data from two haploid loci sampled over multiple generations.

One locus is under stronger positive selection than the other. Estimate the selection coefficient s for the more strongly selected locus, where s > 0 means the derived allele is favored.

Assume instrument-driven sequencing error is ~1%. The seq_error column is the average of the two directional allele-miscall rates for that locus and sample.

The selected_locus value must be "A" or "B".

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"selected_locus": "<string>",
4
"s": <float>
5
},
6
"reasoning": "<description of method and QC>"
7
}

提供给模型的文件

generationalt_readstotal_readsseq_errorsample_year
636400.16-4500
1234450.16-4278
1841550.16-4056
2438700.16-3833
3036900.16-3611

基因座 A 的读取计数时间序列。