2023 — today
Media that come alive
Generative AI as an interactive, living medium.
Why it matters
Chat unlocked the first wave of AI adoption. But a text box is a narrow window onto models that can now generate images, video, interfaces, and entire worlds. The next wave will come from mediums people can touch, steer, and reshape continuously. When AI becomes interactive, more people can use it, for more of their work, and with real control over the result.
Impact & influential work
I push AI beyond the chat box, toward generated content you can touch, steer, and reshape. I proved it in research, with three CHI and UIST Honorable Mentions, eight patent filings, and live demos to Microsoft leadership. I proved it in product too, leading image generation in the Copilot app, the generative pipeline behind Xbox Design Lab controllers, and image understanding in Copilot.
At EPIC I turned this vision into infrastructure: a common codebase and 20+ containerized generative models that take researchers and interns from idea to working prototype in days.



Key papers
- ImaginationVellumUIST 2025 ★ Honorable Mention
An ideation canvas where spatial layout, generative strokes, and history become the prompt.
- AI-InstrumentsCHI 2025 ★ Honorable Mention
Prompts become reusable instruments you apply directly to content, like tools.
- TexterialCHI 2026 ★ Honorable Mention
Text as a material you shape with gestures, with an LLM in the loop.
- Intent TaggingCHI 2025
Micro-prompts attached to parts of a work to steer generation precisely.
- Live Artifacts2026
Dynamic media built from live layers that keep their generative specification.
- Brushing & Interpretive LinkingGI 2026
Brushing and linking, reinvented for knowledge work with LLMs.
Product impact
- Copilot · Drawing in the Copilot app
Principal investigator for image generation in the Copilot app. I drove the Stable Diffusion technology end to end, ramped up the engineering team, and led responsible-AI communication for sketch-to-image.
- Microsoft Paint · Cocreator
Shaped the live AI sketching canvas that turns scribbles into art in Paint.
- Copilot · Image understanding
Led the analysis of how people use image input in Copilot, and shipped a small vision-language model to analyze images and suggest actions.
- Copilot · Computer-using agent
Built a computer-using agent that runs in a custom Linux container, and took it from leadership demo to product.
- Copilot Notebooks
Our hackathon with the Loop design team, on creating pages from existing assets and AI summaries, shaped Copilot Notebooks.
- Xbox · Design Lab
Principal investigator of the generative image pipeline that lets people design custom Xbox controllers.
Talks, demos & showcases
- 2026MLADS · Generative UI and the next interactive AI experiences
- 2026UX for Generative AI conference · Making AI interactive
- 2025Microsoft Research Showcase · Vibe Gaming, plus an 8-person hackathon on generative games presented to Xbox leadership
- 2025Microsoft Research Fair · ImaginationVellum, with private demos to Office AI and Gaming AI leaders
- 2024Research Demo Fair · Intent Tagging and micro-prompting with Copilot
- 2024New Future of Work report · AI-Instruments, Intent Tagging, and the intelligent canvas featured
- 2025–26Organizer · Generative UI workshop (Project Green) and the GUIDE Forum
Building the future
Five directions I’m building toward. Explore them in What if…
Pixel UI
Interfaces become generated, adaptive, and infinitely malleable. Every pixel can respond.
Kinetic Diffusion
Media becomes something you shape, not just consume. Artifacts stay alive and explorable.
Flowing Diffusion
Creation keeps pace with human intent. Interfaces emerge and evolve alongside thought.
Flux Diffusion
Reality becomes an editable canvas. Generative AI transforms the physical world in real time.
Coalescence
Intelligence becomes a place, not a tool. Agents, people, and artifacts share a living workspace.

































