The final project

 

The final project 

How much does LLM "know" about statistical analysis

1. Identify a set of original data from your research lab, either generated by you or other members, whose goal is to explore the relationship between at least TWO variables. For unpublished data, the data and your analysis will be kept strictly confidential and will not be shared with anybody including the TAs.  If you have trouble access the original data, you can use some recently published data from your lab.  Prepare for a brief description of the background and hypothesis, a clear description of the study design and data collection, to be present to the LLM. 

2. Use a LLM, ChatGPT, Gemini, Llama, etc., present your question, and the data, and see how they respond. You should try different prompt and push it to test the limit. You may use multiple LLMs. 

3. Follow the instruction by the LLM to carry out the analysis. Feed the results back to them and ask them to interpret. 

4. Write a short report discussing the capability and limitation of the LLM(s) you tested on your particular data and question. With your conversation log with LLM as the supplement. There is no hard limit on number of words, but 400-600 is appropriate. The report should include the description of your data/problem, whether it is original or published and when, which LLM and version is tested. 

Due Day

It should be submitted no later than mid-night of Oct 30th by email.  The subject of the email and the file name should both in the format of QSBRII_FinalExam_FirstName_LastName.


Comments

Post a Comment

Popular posts from this blog

Syllabus

Image
   qsbrii2025.blogspot.com Policy on video recording or remote access 1. All lectures are in-person. Students are strongly encouraged to attend, especially for R-sessions.  2. The video recordings of the lectures will NOT be available for any personal or professional reasons. However, all lecture notes and homework are available online, and the students are encouraged to schedule (remote or in-person) office hours with me.  3. Remote access by zoom will be available. However, all attendees will be muted but you can communicate through chat . I expect that you will join zoom from a private and quiet environment.  Canvas vs blogspot.com 1. ALL lecture notes, homework assignments, and other teaching material are only available on qsbrii2025.blogspot.com. 2. Canvas will be used for class announcement ONLY.   Time and Location  MW 1:20-2:40 F 1:20-3:00 Foch 3rd floor Lecture Hall  or ED Center lower floor (10/1, 10/17) GOAL:  Build ...
Read more

Lecture 3

Lecture 3, Oct 3, 2025 Slides Jupyter Notebook The dataset I used in the Lecture can be downloaded  here .  HW 3 (Due Oct 10, Friday).  1 .  A SNP locus is genotyped for a total of 1000 individuals, among which 485 is AA, 421 is Aa, and 94 is aa. Compute the $X^2$  statistic for Hardy-Weinberg Equilibrium, and find the P-val. You can either use function  pchisq  or use your simulated reference distribution. 2. Genetic Association Test Genetic Association studies have been very popular in last two decades. Billions of dollars have been spent and tens of millions individuals have their genomes genotyped. They all look for a simple signal. That is, the distribution of genotypes differ among people with different phenotypes. Consider a study with diabetes. Say we recruited 1000 diabetes patients, and 1500 controls. Assume that they are from the same genetic background, which is very important. If the patients are recruited in US, and co...
Read more

Lecture 2 + Lab

Slides  Jupyter Notebook  for the lab.  Jupyter Notebook  for detailed notes, R code and results Homework 2 1. Finish Task 4 of the Lab. Show your code and results. 2 . Do a numerical experiment to generate the sampling distribution of $X^2$  statistics for HWE (the more realistic one with estimated allele frequency), but choose different allele frequencies and sample sizes, to determine if the sampling distribution is approximately  $X^2$  regardless of the underlying allele frequencies.
Read more