LLM Researcher and Software Engineer
Zheyuan Xiao
Auckland, New Zealand
M.S. candidate in Computer Science at The University of Texas at Austin researching reliable LLM evaluation, data-centric post-training, social simulation, and agentic systems. Alongside research, I build automated verification systems for firmware and cloud-connected products at Resideo.
Education
The University of Texas at Austin · M.S. in Computer Science
GPA: 4.0/4.0
The University of Auckland · B.E. (Hons.) in Software Engineering
First Class Honours · GPA: 7.029/9
Research Experience
Allen Institute for AI (Ai2) · Research Collaborator
Microsoft Research Asia · Research Collaborator, TalentScope Copilot
LLM-driven autonomous web agents for evidence-grounded academic talent discovery.
- Built a browser agent that searches, navigates, collects evidence, and synthesizes candidate profiles.
- Developed multi-agent orchestration, provenance tracking, and evaluation with AutoGen, Playwright, TypeScript, and Python.
Microsoft Research Asia · Research Collaborator, LLM Knowledge Inheritance
Studied how domain knowledge is retained and transferred during language-model fine-tuning.
- Built data and training pipelines for domain-specific QA across multiple knowledge areas.
- Fine-tuned Qwen2.5, Llama 3.1, and Mistral 7B models with LoRA and supervised fine-tuning on multi-node 8×A100 clusters.
- The resulting work was published at the NeurIPS 2025 Main Conference.
HKUST(GZ) · Research Assistant
LLM preference evaluation, post-training data selection, and social simulation.
- Investigated desirability and information mass as drivers of length bias in LLM-based evaluation.
- Contributed to work published at Findings of EMNLP 2025 and accepted to EMNLP 2026 Main Conference.
Industry Experience
Resideo (Honeywell Home) · Software Engineer II
- Built an end-to-end automated test system spanning GitHub Actions, a cloud camera platform, and MQTT-based device validation.
- Designed reliability and reporting architecture for NVR and camera ecosystems across firmware and cloud services.
- Developed synthetic-data and edge-inference workflows with Qwen-Image, CLIP, CNNs, and Ambarella CV72S hardware.
Fisher & Paykel Appliances · Intermediate Software Engineer
- Led development of an automated testing platform integrating hardware, firmware, and higher-level software.
- Developed embedded C software and core control algorithms for refrigerator systems.
- Maintained Docker, Make, Azure DevOps, and Jenkins CI/CD workflows.
The University of Auckland · Teaching Assistant
- Supported courses in advanced databases, object-oriented software development, functional programming, and distributed services.
Intellifusion · Machine Learning Intern
- Developed and optimized face-recognition models for security and surveillance products.
Publications
- Advances in Neural Information Processing Systems 39, 2026. Forthcoming.
Builds representative persona sets by aligning LLM-generated profiles with real population-level psychometric distributions.
- Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, 2026. * Equal contribution.
Selects verified teacher answers by student-specific learning cost instead of assuming the strongest teacher always teaches best.
- Findings of the Association for Computational Linguistics: EMNLP 2025, 2025.
Explains length bias through desirability and information mass, then introduces a length-aligned evaluation protocol.
- Advances in Neural Information Processing Systems 38, 2025.
Introduces a cognitive framework for testing how language models learn from instructors, concepts, and experience.
Honors and Awards
First in Course Award in Computer Graphics and Image Processing
The University of Auckland. Awarded for the top course performance in semester one of 2020.
Skills
LLM evaluation, post-training, LLM agents, social simulation, computer vision, ML systems
Python, TypeScript, C, GitHub Actions, Docker, Playwright, AutoGen