Merging Visual Perspectives: Designing Human-AI Interaction for Multimodal Image Generation

Description

Large models are becoming increasingly popular for supporting everyday tasks, e.g., answering questions, recognizing uploaded images, and generating visuals based on user prompts. However, the ways in which humans interact with large language and vision-language models remain underexplored. For instance, we still have a limited understanding of how users can effectively guide these models to generate meaningful text or visuals.

This project focuses on multimodal models, with a particular interest in how users might generate images based on multiple visual references. Specifically, we aim to investigate how to support the merging of several images into a coherent visual output while maintaining a user-centered interaction experience.

Research Field

- Generative AI
- Computer Vision
- Human-Computer Interaction
- Visualization
- Multimodal Model

Research Supervisor

Jiayi Hong

Research Environment

Department of Computer Science and Software Engineering

We are a newly established research group with international collaborations. Our work focuses on exploring human-LLM (Large Language Model) interaction, aiming to better understand and support effective collaboration between humans and AI systems.

Web Site

Financial Aid Available by Program of Study

Master's Degree in Computer Science with thesis

Program description

Financial Aid Available*

Financial Aid Related to Research Project

$25000 per year for 2 years.

Program-Specific Financial Aid

Graduate Studies Awards

Université Laval: Student Financial Aid

Sources de financement	Montant
Leadership and Comittment Scholarship (Canadians & permanent residents)	$10,000
Citizens of the World Scholarship (International students)	$20,000
Mobility Grant for Out-of-Province Internships or Research Visits (in French)	$1,500 to $3,000
Graduate Scholarships from Granting Agencies	$20,000 to $27,000
Online Directory of Graduate Scholarships (in French)	$500 to $50,000

_{* Amounts shown represent maximum financial aid available. Certain conditions apply. Subject to change without prior notice. For further information, contact sponsoring organizations directly.}

Desired Profile

- Computer Software
- Software Engineering
- Bioinformatics
- Artificial intelligence

Required Documentation

- Curriculum vitæ
- Student transcript

Find Out More

Jiayi Hong
Professeure adjointe
Département d'informatique et de génie logiciel
jiayi.hong@ift.ulaval.ca