HAI Weekly Seminar with Jiajun Wu
Learning to See the Physical World
Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.
Sign Up For Latest News
Learning to See the Physical World
An AI Measurement Science (AIMS) Seminar Series

An AI Measurement Science (AIMS) Seminar Series
Phil Lewis from the National Center for O*NET Development will talk about data infrastructure the US Department of Labor provides, and how AI is used to update it. A panel with Diyi Yang from the Stanford Computer Science Department and DEL’s Erik Brynjolfsson will discuss the opportunities of a new partnership between Stanford and the National Center for O*NET Development.

Phil Lewis from the National Center for O*NET Development will talk about data infrastructure the US Department of Labor provides, and how AI is used to update it. A panel with Diyi Yang from the Stanford Computer Science Department and DEL’s Erik Brynjolfsson will discuss the opportunities of a new partnership between Stanford and the National Center for O*NET Development.
In the last year, AI models have rapidly improved on public benchmarks measuring their ability to carry out research tasks autonomously. Such performance suggests that models may be capable of automating parts of the AI R&D process itself, thereby accelerating the pace of AI progress.

In the last year, AI models have rapidly improved on public benchmarks measuring their ability to carry out research tasks autonomously. Such performance suggests that models may be capable of automating parts of the AI R&D process itself, thereby accelerating the pace of AI progress.
Human intelligence is beyond pattern recognition. From a single image, we're able to explain what we see, reconstruct the scene in 3D, predict what's going to happen, and plan our actions accordingly. In this talk, I will present our recent work on physical scene understanding---building versatile, data-efficient, and generalizable machines that learn to see, reason about, and interact with the physical world. The core idea is to exploit the generic, causal structure behind the world, including knowledge from computer graphics, physics, and language, in the form of approximate simulation engines, and to integrate them with deep learning. Here, deep learning plays two major roles: first, it learns to invert simulation engines for efficient inference; second, it learns to augment simulation engines for constructing powerful forward models. I'll focus on a few topics to demonstrate this idea: building scene representation for both object geometry and physics; learning expressive dynamics models for planning and control; perception and reasoning beyond vision.