Advanced Mobility & Augmented Intelligence Lab

News

[Spring 2025]
[Fall 2024]
[Spring 2024]
[Fall 2023]
  • Undergraduate researchers from AMAI lab won the 1st Place of Fall 23 CS SHOWCASE. Congrats Saraswathi Katabattula, Janou Milligan, Tyler Wilkerson!
  • Our paper titled “DeepEn2023: Energy Datasets for Edge Artificial Intelligence” led by Xiaolong has been accepted by Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS ’23) Workshop on Tackling Climate Change with Machine Learning. This achievement aligns with our series of contributions (SEC ’23, CCAI@NeurIPS ’23) aimed at assessing and reducing energy consumption and carbon footprint of on-device deep learning. Kudos to my students for their outstanding work and dedication!
  • Xiaolong was selected as one of the three recipients of the 2023 Martin D. Fraser Graduate Student Conference Travel Award, which is a merit-based accolade that supports CS PhD students at GSU with conference travel. Congratulations!
  • Our paper titled “Real-Time Object Substitution for Mobile Diminished Reality with Edge Computing” led by Hongyu has been accepted by SEC’ 23 Poster/Demo Track.
  • Our paper titled “Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devices” led by Xiaolong has been accepted by The Eighth ACM/IEEE Symposium on Edge Computing (SEC’ 23). SEC is a new top conference in edge computing. The acceptance rate of this year is 25.3% (18 of 71 accepted). This paper presents the first measurement study that uncovers the energy consumption characteristics of on-device deep learning across edge devices. This study results in the creation of three extensive energy datasets for edge devices, covering a wide range of kernels, state-of-the-art DNN models, and popular AI applications. Based on our datasets, we design and implement the first kernel-level energy predictors for edge devices, which achieves an average prediction accuracy of 86.2%. The datasets and code will be released soon at here. Stay tuned!
[Summer 2023]
[Spring 2023] 

Research

MamBEV: Enabling State Space Models to Learn Birds-Eye-View Representations

Automatically generating a bird’s-eye-view (BEV) of an object’s surrounding environment is critical for applications like autonomous driving and advanced driver-assistance systems. These systems rely on integrating signals from multiple cameras to construct a top-down view of the environment. Prominent examples include the BEV systems deployed in Tesla cars. However, many existing methods heavily depend on Transformers, which employ computationally expensive attention mechanisms to learn accurate representations.

In this work, we introduce Spatial Cross Mamba, an innovative approach analogous to standard cross-attention in Transformers. Our method leverages the efficiency of state space models (SSMs) to significantly reduce the computational overhead associated with Transformers, enabling more efficient and scalable BEV systems without compromising representation accuracy.

Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devices

Despite the remarkable advances in edge device capabilities such as functionality, computation power, and storage capacity, the limited energy capacity has been the major bottleneck in promoting advanced edge AI applications. For instance, mobile and edge devices are typically powered solely by embedded batteries, so their energy capacity is significantly constrained by form factor requirements, safety considerations, manufacturing costs, and concerns on the environmental impact of the battery technology used.

In this work, we studied the problem of accurate energy measurement, prediction, and understandable scoring of on-device deep learning across edge hardware. We created kernel-, model-, and application-level datasets for on-device deep learning. We designed and implemented the first kernel-level energy predictors on both mobile CPU and GPU. It can provide consistently accurate energy estimation on unseen DNN models.

GreenAuto: Advancing Efficient AI Model Design for Edge Hardware

As AI-driven applications become more prevalent, their cumulative energy consumption across billions of devices will have a significant impact on global carbon emissions. Addressing this pressing issue requires a deeper understanding of how AI models consume energy during runtime and how to optimize their energy efficiency for specific edge hardware. This optimization is crucial for reducing the environmental impact of AI at scale. 

To this end, we propose GreenAuto, an end-to-end automated platform designed for sustainable AI model exploration, generation, deployment, and evaluation. GreenAuto demonstrates the efficient identification of sustainable AI models without the need for human intervention through automating performance measurements and iteratively refining the search process.

Mobile Augmented/Virtual Reality (AR/VR) Systems

The goal of this research pillar is to improve system performance, especially latency and energy efficiency, of mobile AR/VR devices. We primarily focus on adapting the system configurations of mobile AR devices to address the trade-offs between user preferences and performance requirements.

We are also recently interested in prototyping systems for emerging AR applications including: collaborative AR, mobile AR with generative AI, AR for scientific data exploration, etc.

Digital Twins for Future Mobility

The goal of this research pillar is to conduct pioneering study on digital twins for connected and automated vehicles (CAVs). Our vision is to create fair, affordable, and efficient mobility solutions by leveraging digital twins and edge computing.

We are primarily interested in: Visualization of mobility digital twin with NeRF, cooperative perception, security in CAVs, etc.

Academia Research Partners

Sponsors