In this talk, we'll dive into Client-Side Semantic Caching. I'll show you how to intercept user prompts in the browser, run a tiny open-source AI model locally to understand the "meaning" of the text, and serve previously cached answers instantly. We will look at real code using Transformers.js and IndexedDB to drop your AI latency to 0ms, save API tokens, and build a greener web

Powerful generative AI features are quickly becoming a baseline in modern development. Potential blockers include privacy concerns, the need for a stable connection, and the costs associated with using or hosting models. However, we can now leverage generative AI directly in the browser on the user's device using emerging Web APIs like WebNN, combined with higher-level frameworks, for a better developer experience. In my session, I’ll discuss the current state of in-browser ML and AI features, compare the main players, and show you how to start building an offline-ready, future-proof, standards-based web application.

With the rapid adoption of AI models in software products, Chrome’s introduction of local-first, on-device AI models offers developers a powerful new way to build intelligent and fast AI features directly within the browser. This talk will explore Chrome’s Built-in AI models, their architecture, APIs, developer tooling, and also demonstrate how it supports low-latency AI experiences without relying solely on cloud-deployed models.

We’ll walk through the architecture behind Chrome’s on-device models, discuss real-world edge cases and common concerns from integrating the built-in AI APIs, and outline key system and compatibility requirements that every developer should know. This talk will also mention the evolution of Chrome’s AI ecosystem, from its early releases to current capabilities, along with a preview of upcoming features and insights from its developer community.

For advanced listeners in the audience, this talk will include Chrome’s hybrid AI support pairing with Firebase to extend applications with cloud-backed storage and processing, enabling developers to blend on-device intelligence with online workflows.

To keep this talk interactive and practical, I will use my open-source Chrome extension project built during the recently concluded Chrome AI hackathon as a demo, highlighting how the Prompt and Summariser APIs are being used in the Chrome extension.

Chat interfaces are everywhere, but what challenges are there to overcome to create a truly joyful user experience? In this talk, we’ll explore the key problems and solutions across the entire stack: from the tools you can give your agent to better respond to real human behaviour, to the underlying infrastructure and optimisations required to handle client disconnects, cancellations, and multi-device usage gracefully.