Tianyu Qiu

Example Talk

Sat, 01 Jun 2030 13:00:00 +0000

Click on the Slides button above to view the built-in slides feature.

Slides can be added in a few ways:

Create slides using Hugo Blox Builder’s Slides feature and link using slides parameter in the front matter of the talk file
Upload an existing slide deck to static/ and link using url_slides parameter in the front matter of the talk file
Embed your slides (e.g. Google Slides) or presentation video on this page using shortcodes.

Further event details, including page elements such as image galleries, can be added to the body of this page.

[2026-03] New preprint: "Linear-Quadratic Gaussian Games with Distributed Sparse Estimation"

Tue, 17 Mar 2026 00:00:00 +0000

Our preprint Linear-Quadratic Gaussian Games with Distributed Sparse Estimation is now available on arXiv.

Linear-Quadratic Gaussian Games with Distributed Sparse Estimation

Tue, 17 Mar 2026 00:00:00 +0000

[2026-02] Our paper "Efficiently Solving Mixed-Hierarchy Games with Quasi-Policy Approximations" has been accepted to WAFR 2026!

Sun, 01 Feb 2026 00:00:00 +0000

Our paper Efficiently Solving Mixed-Hierarchy Games with Quasi-Policy Approximations has been accepted.

Efficiently Solving Mixed-Hierarchy Games with Quasi-Policy Approximations

Sun, 01 Feb 2026 00:00:00 +0000

[2025-05] Our paper "PSN Game: A Player Selection Network for Scalable Game-Theoretic Prediction and Planning" has been accepted to TMLR!

Thu, 01 May 2025 00:00:00 +0000

Our paper PSN Game: A Player Selection Network for Scalable Game-Theoretic Prediction and Planning has been accepted.

PSN Game: A Player Selection Network for Scalable Game-Theoretic Prediction and Planning

Thu, 01 May 2025 00:00:00 +0000

Dense Dynamics-Aware Reward Synthesis: Integrating Prior Experience with Demonstrations

Wed, 01 Jan 2025 00:00:00 +0000

Inferring Occluded Agent Behavior in Dynamic Games from Noise Corrupted Observations

Sun, 01 Dec 2024 00:00:00 +0000

[2024-10] Our paper "Inferring Occluded Agent Behavior in Dynamic Games from Noise Corrupted Observations" has been accpeted to Robotics & Automation Letters!

Tue, 22 Oct 2024 00:00:00 +0000

Our paper “Inferring Occluded Agent Behavior in Dynamic Games from Noise Corrupted Observations” has been accpeted to Robotics & Automation Letters!

[2024-07] We submitted paper "Inferring Occluded Agent Behavior in Dynamic Games from Noise Corrupted Observations" to ICML 2024.

Sun, 21 Jul 2024 00:00:00 +0000

We submitted paper “Inferring Occluded Agent Behavior in Dynamic Games from Noise Corrupted Observations” to RA-L.

Inferring Occluded Agent Behavior in Dynamic Games from Noise Corrupted Observations

Sat, 13 Jul 2024 00:00:00 +0000

In mobile robotics and autonomous driving, it is natural to model agent interactions as the Nash equilibrium of a noncooperative, dynamic game. These methods inherently rely on observations from sensors such as lidars and cameras to identify agents participating in the game and, therefore, have difficulty when some agents are occluded. To address this limitation, this paper presents an occlusion-aware game-theoretic inference method to estimate the locations of potentially occluded agents, and simultaneously infer the intentions of both visible and occluded agents, which best accounts for the observations of visible agents. Additionally, we propose a receding horizon planning strategy based on an occlusion-aware contingency game designed to navigate in scenarios with potentially occluded agents. Monte Carlo simulations validate our approach, demonstrating that it accurately estimates the game model and trajectories for both visible and occluded agents using noisy observations of visible agents. Our planning pipeline significantly enhances navigation safety when compared to occlusion-ignorant baseline as well.

Dense Dynamics-Aware Reward Synthesis: Integrating Prior Experience with Demonstrations

Thu, 01 Feb 2024 00:00:00 +0000

Many continuous control problems can be formulated as sparse-reward reinforcement learning tasks. In principle, online reinforcement learning methods can automatically explore the state space to solve each new task. However, discovering sequences of actions which lead to a non-zero reward becomes exponentially more difficult as the task horizon increases. Manually shaping rewards can accelerate learning for a fixed task, but it can be an arduous process that must be repeated for each new environment. This work introduces a systematic reward-shaping framework which distills the information contained in 1) a task-agnostic prior data set and 2) a small number of task-specific expert demonstrations, and then uses these priors to synthesize dense dynamics-aware rewards for the given task. This supervision substantially accelerates learning in our experiments, and we provide analysis demonstrating how the approach can effectively guide online learning agents to faraway goals.

Scientific Computing

Mon, 25 Dec 2023 00:00:00 +0000

I worked as the teaching assistant of COE322 Scientific Computing lectured by Prof. Victor Eijkhout and Prof. Susan Lindsey in 2023 Fall at UT Austin. Check Course Contents for more details.

[2023-03] I'm glad to announce that I've graduated with Master of Engineering degree in Electronic Information from Shanghai Jiao Tong University! Thank you all for the help in my seven years' journey!

Wed, 15 Mar 2023 00:00:00 +0000

I’m glad to annouce that I’ve successfully defend my Master’s Thesis in February 2023 and graduated with Master of Engineering in Electronic Information from Shanghai Jiao Tong University in March 2023. Thank you all for the seven years’ journey!

Pedestrian Trajectory Prediction and Mobile Robot Navigation Based on Inverse Dynamic Games

Wed, 15 Mar 2023 00:00:00 +0000

With the development of relevant techniques in robotics and the maturity of application solutions, mobile robots are capable of working in more complicated scenarios and their application fields are enormously expanded. Service mobile robots tend to navigate in human-rich environments. Comparing with static obstacles, pedestrians are highly dynamic and tend to disturb the navigation of mobile robots. Navigating among pedestrians is thus challenging to mobile robots.

To tackle the inaccuracy of modelling pedestrian behaviors due to their high dynamic and randomness, we proposed an inverse dynamic game method based on model predictive control (MPC-GPred) to model pedestrians’ individual and group behavior.

For the high time complexity of solving for pedestrians’ trajectories caused by the nonlinear cost function, we did linear quadratic approximation and analytically solve for Nash strategy as pedestrian trajectory prediction. To achieve best prediction performance, we apply inverse dynamic game technique to identify weighting parameters according to trajectory observations. We tested our method with open-source algorithms RVO and CADRL on prediction performance and results indicate the effectiveness of our method.

In practical navigation tasks, to tackle the inaccuracy of modelling pedestrian behaviors due to interactions between pedestrians and robots, we proposed a dynamic game navigation method based on model predictive control (MPC-GNav) for mobile robots. we add the mobile robot as the new agent in dynamic games and solve for Nash strategy as the control for mobile robots. Consider the difference of dynamic model between mobile robots and the dynamic game model, we applied feedback linearization to achieve the control of robot platforms. To tackle the problem of incapability of control mobile robots in large scenarios, we proposed a layered planning method to obtain local goals. Mobile robots complete the entire navigation tasks by navigating to each local We compared our method with open-source algorithms RVO and CADRL in simulated scenarios and results indicate the effectiveness of our method in collision avoidance.

We implemented MPC-GNav on “Jiao Long” smart wheelchair in pedestrian-rich scenarios such as corridors and halls and did navigation experiments among pedestrians and compared the results with open-source method DWA. Results indicate the effectiveness of our method in improving navigation safeness.

[2023-02] I'm glad to annouce that I'm joining University of Texas at Austin as an Aerospace Engineering Ph.D. student in 2023 Fall. See you in Austin, TX!

Sun, 12 Feb 2023 00:00:00 +0000

I’m glad to announce that I will join UT Austin as a Ph.D. student in 2023 Fall. I’m going to work as a research assistant in CLeAR Lab, under supervison of Prof. David Fridovich-Keil. My reseach focus includes reinforcement learning, game theory, social navigation and SLAM.

Nash Pursuit Strategy for Nonzero-Sum MPC Game via Inverse Optimal Control

Wed, 20 Jul 2022 00:00:00 +0000

Scientific Writing (Graduate-level)

Fri, 31 Dec 2021 00:00:00 +0000

I worked as a teaching assistant for Scientific Writing lectured by Prof. Han Zhang in 2021 Fall at Shanghai Jiao Tong University.

Science and Technology Innovation

Sat, 01 May 2021 00:00:00 +0000

I worked as the teaching assistant of Science and Technology Innovation lectured by Prof. Jingchuan Wang in 2021 Spring at Shanghai Jiao Tong University.

Discrete Maths

Sat, 15 Aug 2020 00:00:00 +0000

I worked as a teaching assistant for VE203 Discrete Maths lectured by Prof. Zach Mckenzie in 2019 Summer and Prof. Heidi Anderson in 2020 Summer at Shanghai Jiao Tong University, respectively. I was nominated as an outstanding teaching assistant for the course. Check the following links for recitation notes for the course.

2019 Summer:
- RC Week1
- RC Week2
- RC Week3
- RC Week4
- RC Week5
- RC Week6
- RC Week7
- RC Week8
- RC Week9
- Mid-term 1 Review
- Mid-term 2 Review
2020 Summer:
- RC1
- RC2
- RC3
- RC4
- RC5
- RC6

Healthcare Telepresence Robot for the Elderly

Wed, 25 Dec 2019 00:00:00 +0000

This is our Capstone Design Project in 2019 Fall. We designed and built a healthcare telepresence robot for the elderly, which enables remote video chat and remote control of medicine dispensation.

Intro to Engineering

Sun, 15 Dec 2019 00:00:00 +0000

I worked as a teaching assistant for VG100 Intro to Engineering lectured by Prof. Shane Johnson and Prof. Irene Wei in 2018 Fall and 2019 Fall at Shanghai Jiao Tong University. Check the following links for more details.

Deployable Bridge Project:
- Project Description
- Selected Projects: Team7 vg100 UMJI, ZQ Rong, Legineerss, Meta XIII, the alligators, Trinity, SA so cool, L^4.
2018 Lab Slides:
- Lab 1
- Lab 2
2019 Fall:
- Lab 1
- Lab 2
- Lab 3

7th Grade Geography

Tue, 15 Jan 2019 00:00:00 +0000

In 2018 Winter, I went to Sanhe Junior High School (Yunnan Province, China) as a member of UMJI Volunteer Teaching team. We taught Maths, Chinese, Geography, English, Music courses for 7th and 8th grade students. Besides teaching, our team actively organized and participated in the Sports Meeting, the School’s Soccer Match and the New Year’s Gala. We made good friends with the students there. Check Video for more details.