Performant Architecture for a Fast Gen AI User Experience

More and more developers are being asked to build Generative AI experiences into their web applications everywhere. However, the user's experience with Generative AI can sometimes be slow and frustrating. It’s been years since we would gladly wait over 10 seconds for a response to anything online. As AI processing gets faster, there are new limiting factors that could be negatively affecting your AI user experience.

In this talk, we will cover different ways to minimise laggy experiences in web applications when interacting with third-party Generative AI tools. We’ll be using a practical demonstration to show how you can reduce latency as we build one of my favourite sci fi gadgets, the babel fish.

When the backend can reason, what does that mean for the frontend?
Let's take a look at how we can create UI's that can handle the reasoning capabilities of LLMs and adapt to perform any task.

It's pretty common to evaluate new changes with a vibe check but that makes it difficult to really know what's up with your system. We'll talk a bit about how to build more complex apps.

Movies have promised the future where we can talk to AI Assistants with natural language and have them respond with all the nuances of humans. However for years we've been stuck with really "stupid" AI experiences over voice. With the advent of LLMS this is finally a reality!

Lots of different technologies have come together to create amazing audio experiences. However, there are some technical problems that we need to solve. In this talk we will learn how to chain these technologies, solve some of the common problems and build a new JARVIS together, powered by the LLM of your choice.