Loading Events

Title

SoC-FoS Joint workshop -AI Research Grant Call 2022-

Date & Time

4 Jan 2023, Wednesday (8.30am to 1:00pm)

Venue

COM2-04-02 Executive Classroom and COM2-04-01 Multipurpose Space

Abstract

While true AR/MR consumers devices are probably still years away, devices like HoloLens2 already have compelling applications in industry today. In this talk we will review what devices can do today and then present ongoing research expanding those capabilities. We will discuss how egocentric activity recognition can be used to enable devices to better assist users in learning and performing tasks. We will also see how combining edge devices with cloud compute capabilities can provide much more powerful solutions. We’ll briefly look at remote rendering as an option to remove constraints on 3D model complexity. Next, we’ll focus on spatial computing. While mixed reality devices typically build their own 3D map of the environment on device, many high value scenarios require to be able to reliably share and persist spatially localized information with respect to a common coordinate system. We will see how distributed cloud mapping and localization can enable these type of scenarios. We will present results involving HMDs, but also robots as well as 3D reality capture devices. Our goal is to enable seamless collaboration between on-site and remote people, as well as autonomous robots, through mixed reality.

Speaker’s Bio

Dr Marc Pollefeys is a Professor of Computer Science at ETH Zurich and the Director of the Microsoft Mixed Reality and AI Lab in Zurich where he works with a team of scientist and engineers to develop advanced perception capabilities for HoloLens and Mixed Reality. He was elected Fellow of the IEEE in 2012. He obtained his PhD from the KU Leuven in 1999 and was a professor at UNC Chapel Hill before joining ETH Zurich. He is best known for his work in 3D computer vision, having been the first to develop a software pipeline to automatically turn photographs into 3D models, but also works on robotics, graphics and machine learning problems. Other noteworthy projects he worked on are real‐time 3D scanning with mobile devices, a real‐time pipeline for 3D reconstruction of cities from vehicle mounted‐cameras, camera‐based self‐driving cars and the first fully autonomous vision‐based drone. Most recently his academic research has focused on combining 3D reconstruction with semantic scene understanding.

Organizer: NUSAiL

Hosted at NUS Computing, the NUS Artificial Intelligence Laboratory’s (NUSAIL) mission is to be centre of excellence in AI research, education, and practice, focusing on the three pillars of human-centred AI technology: embodied AI, interactive AI, and trustworthy AI. Its members include faculty, staff, and students from NUS Computing, as well as affiliated members from other faculties and organisations, both locally and internationally. Visit https://ai.nus.edu.sg/ for more info.

Copyright @2023 – All Right Reserved, NUS AI Lab

COM1, 13 Computing Drive Singapore 117417