Lumaktaw sa pangunahing content
OpenAI

Hunyo 30, 2026

Sa loob ng Genebench-Pro

Mas masusing pagtingin sa benchmark, sa mga tanong nito, at pansuportang materyales.

Mga case study

Itinatampok ng sampung pag-aaral ng kaso na ito ang mga kinatawang tanong mula sa GeneBench-Pro. Kasama sa bawat pag-aaral ng kaso ang orihinal na prompt, mga dataset, at mga pansuportang materyal. Para sa pangkalahatang-ideya ng benchmark at mahahalagang natuklasan, tingnan ang blog ng anunsyo.

Paalala: Nagpapakita ang mga preview ng file ng mga sipi mula sa kumpletong mga dataset.


Pag-aaral ng kaso blg. 1

Somatikong onkolohiya: Pagpapasya sa benepisyo at panganib ng paggamot sa tumor na ginagabayan ng structural variant

Tantiyahin kung ang isang sintetikong inhibitor na nakatuon sa TXR1 ay may positibong klinikal na kapakinabangan sa mga tumor na ang pag-activate ng target ay dulot ng isang structural variant. Ang TXR1, TXR1i, DLR1, at mga label na star-allele ay mga sintetikong label ng benchmark. 

Kailangang matukoy ang target na subgroup mula sa ebidensiyang long-read, ekspresyon, kalidad ng tumor, at pharmacogenomic bago maipakahulugan ang benepisyo at toksisidad bilang isang desisyon sa paggamot.

Inilabas na prompt na ipinakita sa modelo

A molecular tumor board registry contains trial-eligible advanced solid-tumor cases considered for a TXR1-directed inhibitor. Estimate, for tumors with SV-driven TXR1 target-mediated activation at time zero, the marginal effect of TXR1i versus non-TXR1 systemic therapy on week-16 clinical benefit as if all patients had an assessable week-16 visit. Also estimate the 8-week treatment-limiting toxicity/discontinuation risk under TXR1i in the same target population. Report net clinical utility = benefit risk difference (percentage points) - 0.35 * toxicity risk (percentage points), and choose therapy_class_code 1 if TXR1i has positive net utility and 0 otherwise. 

Use percentage-point units for all non-code quantities. Positive benefit means TXR1i improves week-16 clinical benefit relative to non-TXR1 systemic therapy.

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"therapy_class_code": <int>,
4
"benefit_rd_pp": <float>,
5
"toxicity_dropout_risk_pp": <float>,
6
"net_clinical_utility_pp": <float>
7
},
8
"reasoning": "<description of method and QC>"
9
}

Mga file na ibinigay sa modelo

patient_idanalysis_setagesexsitecalendar_periodecogtumor_burdenprior_linesprior_resistancelineage_classtherapy_classassessed16benefit16tox_stop_8wktime_zero_day
MTB0001173.8MS1P220.78731ATXR1i010
MTB0002155.2MS3P112.63701ATXR1i1000
MTB0003168.8FS4P200.89121ATXR1i1110
MTB0004182.8FS2P224.10100BTXR1i1000
MTB0005165.5FS1P317.011ATXR1i1000

Mga covariate ng rehistro, terapiya, pagtatasa sa ika-16 na linggo, benepisyo, at maagang toksisidad.


Pag-aaral ng kaso blg. 2

Functional genomics: Pagpapatunay ng target ng CRISPR: lncRNA transcript o genomic locus?

Magpasya kung ang tila dependensiya sa lncRNA ay partikular sa transkripto o dulot ng mga epekto ng kalapit na locus at karatig na gene.

Kailangang manatiling matibay ang ebidensiyang nakatuon sa transcript sa harap ng mga kontrol para sa lokal na perturbasyon ng DNA locus, represyon ng kalapit na gene, mga pagpapalit ng guide, toksisidad ng GC, at mga epekto ng plate.

Inilabas na prompt na ipinakita sa modelo

You are given pooled CRISPRi screening data, guide-level local expression measurements, transcript-targeting CasRx follow-up data, and single-guide follow-up growth measurements for a nominated lncRNA program (LINC473) and a nearby coding gene (KIN1). The identifiers LINC473, KIN1, and ANKRD42 are synthetic benchmark labels; any resemblance to real human genes is coincidental.

Estimate the requested quantities.

Definitions:

  • lncrna_specific_lfc: the pooled-screen matched-control day-10 log2 growth effect expected at 100% effective knockdown of the dominant LINC473 transcript, not local DNA-locus effects.
  • neighbor_mediated_lfc: the pooled-screen matched-control day-10 log2 growth effect expected at 100% KIN1 repression in the local LINC473-locus model after accounting for concomitant LINC473 transcript knockdown.
  • advance_target: 1 if the evidence supports advancing LINC473 as a transcript-directed target, else 0.

Conventions:

  • all growth effects are log2(day10/day0) competitive-growth effects relative to matched controls;
  • more negative numbers indicate stronger loss of fitness;
  • set advance_target to 1 only if lncrna_specific_lfc <= -0.08 and neighbor_mediated_lfc > -0.25; otherwise 0.

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"advance_target": <int>,
4
"lncrna_specific_lfc": <float>,
5
"neighbor_mediated_lfc": <float>
6
},
7
"reasoning": "<description of method and QC>"
8
}

Mga file na ibinigay sa modelo

guide_idnominal_targetchrcoordstranddist_lnc_tss_bpdist_neighbor_tss_bpguide_gc_frac
g001LINC473chr7100014+14300.624
g002LINC473chr7100035-43670.584
g003LINC473chr7100051+116560.622
g004LINC473chr7100066-59660.617
g005LINC473chr7100088+74770.715

Gabay sa mga koordinado, target, distansya, at mga tampok ng GC.


Pag-aaral ng kaso blg. 3

Istatistikal na genetika: Pagbibigay-priyoridad sa mga target na protina ng gamot sa nakaugnay na genetic locus

Tantiyahin ang mga direktang epekto ng sakit para sa dalawang magkalapit na protina gamit ang cis multivariable Mendelian randomization (cis-MVMR), habang pinangangasiwaan ang sukatan ng assay, oryentasyon ng allele, winner’s curse, LD, at natitirang lokal na pleiotropy.

Ang dalawang protina ay may magkaugnay na locus. Kailangang lumipat ang pagsusuri mula sa mga marginal na asosasyon tungo sa mga kondisyunal na epekto ng sakit na isinasaalang-alang ang LD, sa iisang iskala ng protina.

Inilabas na prompt na ipinakita sa modelo

You are given association summary statistics and metadata for two nearby proteins (PROTA and PROTB), a binary disease outcome, a locus correlation reference, and protein measurement records.

Goal: estimate the direct log-odds effect of each protein on the disease outcome per +1 SD increase in log10 concentration, conditional on the other protein.

Interpretation: theta_PROTA and theta_PROTB use the same log-odds per-SD scale defined in the goal.

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"theta_PROTA": <float>,
4
"theta_PROTB": <float>
5
},
6
"reasoning": "<description of method and QC>"
7
}

Mga file na ibinigay sa modelo

snppos_bpeffect_alleleother_allelemafbetasepval
rs20000050000000AC0.422150.0064386683107068080.0032673300912034120.04876727714241972
rs20000150010126AC0.057090.0110089933375813010.0069552392087504070.11345916603941006
rs20000250020253GT0.090210.0099220147571163190.0056330230270155180.07817048492026045
rs20000350030379GT0.483990.0105692156141645730.00322914197402374450.0010638520681901973
rs20000450040506AG0.377030.0070365513782386540.00332975923212698020.034580976884336506

Mga buod ng ugnayan ng protina sa yugto ng screening para sa PROTA.


Pag-aaral ng kaso blg. 4

Klinikal na genomics/carrier screening: Natitirang panganib sa carrier screening ng DRX1 sa ilalim ng CNV at pseudogene calibration

Tantiyahin ang dalas ng carrier na partikular sa lahi, natitirang panganib matapos ang negatibong screening, ang dalas ng carrier ng kapareha, at ang panganib na magkaroon ng apektadong conceptus batay sa data mula sa pagsusuri ng carrier-screening assay.

Ang pagtataya ng natitirang panganib ay nakasalalay sa mga carrier call na may pagsasaalang-alang sa pseudogene, pagbagsak ng founder-haplotype, kalibrasyon ng assay na partikular sa pinagmulan, at pag-standardize mula sa mga nasuring kapareha pabalik sa buong talaan ng mga kapareha.

Inilabas na prompt na ipinakita sa modelo

Using cohort_roster.tsv.gz, partner_roster.tsv.gz, calibration_controls.tsv.gz, target_metadata.tsv.gz, and assay_observations.tsv.gz, estimate residual reproductive risk for an autosomal recessive DRX1 condition. Report all quantities on the probability scale, not as percentages: carrier_frequency_afr and carrier_frequency_eur among screening-roster adults; residual_carrier_risk_afr_negative for an AFR screening-roster adult with a negative DRX1 screen; partner_carrier_frequency_full_roster for a uniformly sampled partner_roster.tsv.gz row; and couple_reproductive_risk for an affected conceptus when the index person is AFR and screen-negative and the partner is drawn from partner_roster.tsv.gz. Assume autosomal recessive inheritance with a 1/4 affected-conceptus risk conditional on both biological parents being carriers. 

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"carrier_frequency_afr": <float>,
4
"carrier_frequency_eur": <float>,
5
"residual_carrier_risk_afr_negative": <float>,
6
"partner_carrier_frequency_full_roster": <float>,
7
"couple_reproductive_risk": <float>
8
},
9
"reasoning": "<description of method and QC>"
10
}

Mga file na ibinigay sa modelo

sample_idcollectionancestryfamily_history_tier
S_EUR_0001screeningEUR0
S_EUR_0002screeningEUR0
S_EUR_0003screeningEUR0
S_EUR_0004screeningEUR0
S_EUR_0005screeningEUR1

Mga nasa hustong gulang sa talaan ng screening na may impormasyon sa pinagmulan at konteksto ng screening.


Pag-aaral ng kaso blg. 5

Single-cell genomics: eQTL ng activated monocyte pagkatapos ng pagwawasto ng ambient RNA

Tantiyahin ang epekto ng genotype sa ekspresyon ng aktibadong monocyte matapos alisin ang ambient RNA at teknikal na kontaminasyon mula sa data ng single-cell RNA-seq.

Naaapektuhan ng ambient RNA kapuwa ang ekspresyon ng target at ang panel ng marker na ginagamit upang tukuyin ang estado ng aktibasyon, kaya kailangang mangyari ang pagwawasto bago ang modelo ng eQTL.

Inilabas na prompt na ipinakita sa modelo

Estimate the per-allele log rate ratio for CXCL10 expression in the activated monocyte subpopulation from the provided single-cell RNA-seq data. 

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"beta_activated": <float>
4
},
5
"reasoning": "<description of method and QC>"
6
}

Mga file na ibinigay sa modelo

cell_iddonortotal_umiHBBIFI6ISG15LST1CXCL10
D01_C001D011113734835
D01_C002D01110363311210
D01_C003D0111419812639
D01_C004D01125076043217
D01_C005D0110459125115

Mga bilang ng UMI kada cell para sa mga marker gene, mga marker ng kontaminasyon, at target gene.


Pag-aaral ng kaso blg. 6

Genetikang istruktural: Nakapugadd na structural variant: suporta sa ekspresyon at klinikal na asosasyon

Tantiyahin kung ang isang nakapaloob na estruktural na subhaplotype sa loob ng isang hindi pinangalanang locus na kahalintulad ng inversion ay may naka-calibrate na klinikal na ugnayan at kapani-paniwalang suporta sa ekspresyon.

Ang isang nakapaloob na signal ng dami ng kopya-ay maaaring magdulot ng kalituhan dahil sa mas malawak na oryentasyon ng pagbabaligtad (inversion orientation), kaya kailangang manatiling magkahiwalay ang pagsasaayos ng dosis, suporta sa ekspresyon, at klinikal na pagmomodelo.

Inilabas na prompt na ipinakita sa modelo

Analyze the released files for anonymous Locus Q. Estimate the full-cohort source-population clinical association and molecular expression support for the calibrated nested segment-B structural copy dosage, separating the nested segment-B dosage from the broader outer-orientation dosage. Report subhap_log_or as the natural-log source-population total-effect odds ratio for case status per additional calibrated segment-B copy. Report expression_log_fc as the natural-log expression fold-change per calibrated segment-B copy for the expression-supported gene. Report target_support_code as 1 if the supported gene has a positive expression_log_fc and the clinical association is protective (subhap_log_or < 0), otherwise 0. Report n_calibrated_carriers as the number of reliable breakpoint-panel samples carrying at least one segment-B copy. 

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"n_calibrated_carriers": <int>,
4
"target_support_code": <int>,
5
"expression_log_fc": <float>,
6
"subhap_log_or": <float>
7
},
8
"reasoning": "<description of method and QC>"
9
}

Mga file na ibinigay sa modelo

sample_idcaseageage_bandsexpc1pc2pc3ancestry_groupclinic_stratumrecruitment_stream
Q00012150.4550_640-1.01514-0.21032-0.08849EURtertiaryclinic
Q00028057.3950_640-1.25987-0.124980.2344EURregionalregistry
Q00029168.465_plus00.915980.621770.01891AFRtertiaryclinic
Q00030174.0765_plus10.21125-0.59634-0.08197EAScommunityregistry
Q00032182.8265_plus0-1.12034-0.243720.14665EURcommunityclinic

Mga klinikal at covariate data para sa buong grupo.


Pag-aaral ng kaso blg. 7

Genomika ng regulasyon: Pagsukat ng lakas ng chromatin loop pagkatapos ng pagtatago sa mga structural variant at pagmamapa ng artifact

Kuwantipikahin ang nakapokus na pagkakaiba sa lakas ng Hi-C loop sa pagitan ng kaso at kontrol matapos alisin mula sa background ng inaasahang contact ang mga artifact na mahirap ihanay (low-mappability) at mga structural variant.

Ang target loop ay tinutukoy sa 20 kb na resolusyon, ngunit nadidistort ang modelo ng inaasahang contact maliban kung itago muna ang mga contact na mahirap ihanay at case-only SV stripe.

Inilabas na prompt na ipinakita sa modelo

You are given Hi-C contact matrices at 20 kb and 40 kb resolution plus bin annotations. Estimate the loop enrichment at the 20 kb interaction between `bin_id = 8` and `bin_id = 17` in `bins_20kb.tsv.gz`. Report three quantities: `case_loop_strength` (mean log2(observed/expected) across case replicates), `control_loop_strength` (mean log2(observed/expected) across control replicates), and `delta_loop_strength` (case minus control).

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"case_loop_strength": <float>,
4
"control_loop_strength": <float>,
5
"delta_loop_strength": <float>
6
},
7
"reasoning": "<description of method and QC>"
8
}

Mga file na ibinigay sa modelo

bin_idchromstartendgc_contentmappabilityre_sites
0chr84000004200000.461990338215725940.97875742147042735
1chr84200004400000.50441242085346770.89010849434983975
2chr84400004600000.432184515849381940.90568792893267123
3chr84600004800000.47331972826812180.93765298406647893
4chr84800005000000.44449560621507480.86825655179818774

Mga anotasyon ng bin sa target na resolusyon.


Pag-aaral ng kaso blg. 8

Genetikang istatistikal: Multi-parent QTL Mapping na may founder reconstruction

I-mapa ang quantitative-trait locus ng chromosome-1 sa isang populasyong recombinant na may walong tagapagtatag sa pamamagitan ng muling pagbubuo ng pinagmulang lahi (founder ancestry) bago subukin ang ugnayan ng phenotype.

Ang nakikitang data ng marker ay biallelic, ngunit ang biyolohikal na signal ay pinagmulang lahi. Samakatuwid, ang isang pagsusuring maipagtatanggol ay kailangang muling buuin ang estado ng tagapagtatag, suriin ang oryentasyon ng marker, at ihiwalay ang QTL mula sa isang nuisance peak na nakaayos ayon sa batch.

Inilabas na prompt na ipinakita sa modelo

Map the chromosome 1 QTL in an 8-founder multi-parent population. Report the position (cM) and which founder carries the high-effect allele.

Report high_founder as "F1".."F8".

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"high_founder": "<string>",
4
"qtl_pos_cM": <float>
5
},
6
"reasoning": "<description of method and QC>"
7
}

Data files:

  • markers.tsv.gz: marker metadata
  • founders.tsv.gz: founder alleles at each marker
  • ril_genotypes.npz: observed RIL genotypes (biallelic)
  • phenotypes.tsv.gz: phenotype and covariates

Mga file na ibinigay sa modelo

marker_idchrpos_cM
m2_065259.762431265596575
m2_103294.52656615104739
m2_107298.18761427503033
m2_079272.20130244108847
m1_054149.907510212292195

Mga pantukoy ng marker, chromosome, at mga posisyon sa henetikong mapa.


Pag-aaral ng kaso blg. 9

Genetika ng populasyon: Lahi mula sa partikular na magulang (Parent-specific ancestry) at tiyempo ng kamakailang paghahalo ng lahi (recent admixture timing)

Tantiyahin ang mga proporsyon ng lahi mula sa partikular na magulang at ang tiyempo ng kamakailang paghahalo ng lahi mula sa mga naka-phase na lokal na pinagmulan ng lahi matapos ayusin ang mga reciprocal artifact at isang chromosome-specific na inversion ng label.

Parehong nagbabago ang mga ancestry fraction, at pulse time, kung mali ang paghawak sa mga reciprocal tract artifact, chromosome-local label inversion, o mga denominator ng mapa.

Inilabas na prompt na ipinakita sa modelo

You are given phased local-ancestry tracts for one admixed individual. Estimate, for each transmitted parental haplotype, the fraction of ancestry A across the called tract span and the number of generations since a single recent admixture pulse. Label parent1 as the haplotype with the smaller ancestry-A fraction and parent2 as the haplotype with the larger ancestry-A fraction. 

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"parent1_A_fraction": <float>,
4
"parent1_t": <float>,
5
"parent2_A_fraction": <float>,
6
"parent2_t": <float>
7
},
8
"reasoning": "<description of method and QC>"
9
}

Mga file na ibinigay sa modelo

chromhapstart_morganend_morganancposteriorlow_complexity_frac
chr1h10.030.505A0.9850.08
chr1h10.5050.535B0.620.92
chr1h10.5351.478849A0.9850.08
chr1h11.5037271.852681B0.9850.08
chr1h11.8526812.422373A0.9850.08

Mga naka-phase na tract ng lokal na lahi na may mga coordinate, mga label ng lahi, mga posterior value, at mga anotasyon ng QC.


Mga case study 10

Genetika ng populasyon: Pagtatantiya ng seleksyon mula sa sunud-sunod na datos ng maingay na sinaunang DNA

Ipagpalagay kung alin sa dalawang haploid na loci ang nasa ilalim ng mas malakas na positibong pagpili mula sa sinaunang serye ng dalas ng allele habang isinasaalang-alang ang oryentasyon ng allele, direksiyonal na pagkakamali, pag-iba-iba, at nagbabagong laki ng populasyon.

Hindi direktang maihahambing ang maingay na sinaunang mga landas hanggang mailagay ang parehong mga locus sa iisang sukat ng derived allele at direktang maimodelo ang mga ibinigay na halaga ng sequencing error sa antas ng sample.

You are given allele-frequency time series data from two haploid loci sampled over multiple generations.

One locus is under stronger positive selection than the other. Estimate the selection coefficient s for the more strongly selected locus, where s > 0 means the derived allele is favored.

Assume instrument-driven sequencing error is ~1%. The seq_error column is the average of the two directional allele-miscall rates for that locus and sample.

The selected_locus value must be "A" or "B".

These data came from a real experiment; you will be graded not just on numerical correctness but the quality of analytical reasoning you exhibit; do not attempt to take any shortcuts.

Return your final answer as exactly one JSON object.
Do not wrap the JSON in markdown.
Do not add prose before or after the JSON.
Do not omit any keys shown in the example.
Return the JSON object in your final answer:

JSON

1
{
2
"answer": {
3
"selected_locus": "<string>",
4
"s": <float>
5
},
6
"reasoning": "<description of method and QC>"
7
}

Mga file na ibinigay sa modelo

henerasyonalt_readstotal_readsseq_errorsample_year
636400.16-4500
1234450.16-4278
1841550.16-4056
2438700.16-3833
3036900.16-3611

Serye ng bilang ng read para sa locus A.