Reimagining Kafka for Node.js

Presentation byPaolo Insogna

Kafka has become a go-to for powering real-time, event-driven apps.
If you’re building with Node.js, dealing with Kafka hasn’t exactly been smooth sailing: the developer experience is not ideal and native libraries are not supporting all the new Node.js features like multithreading.
So, we built something new. It’s fast, it’s built with TypeScript in mind, and it cuts through the mess to give you a clean, reliable way to work with Kafka in Node.js. Oh, and it’s 100% open source, as usual.
In this talk, we’ll share the journey, show what it can do, and help you level up your Kafka game without the usual headaches.

8:23 AM

Paolo’s bio: Node.js TSC Member, Principal Engineer at Platformatic, Polyglot Developer. RPG and LARP addicted and nerd on lot more. Surrounded by lovely chubby cats.

Similar Presentations
Cover Photo for High-Performance Node.js: From Event Loop Mastery to Production Observability

High-Performance Node.js: From Event Loop Mastery to Production Observability

What You'll Learn:

Event Loop Optimization & Performance - Understand how the event loop really works and learn Matteo Collina's proven techniques for preventing blocking operations. We'll explore the perf_hooks module for identifying performance bottlenecks, plus practical strategies for handling CPU-intensive tasks without freezing your application.

Strategic Caching Patterns - Implement multi-layered caching strategies using Redis, in-memory stores, and HTTP caching headers. Learn when to cache, what to cache, and how to invalidate cache effectively in distributed systems.

Promise Pitfalls & Alternatives - Discover when promises become performance liabilities and explore alternatives like streams and async iterators. We'll cover memory management and the hidden costs of promise chains in high-throughput scenarios.

Worker Threads & Multithreading - Master Node.js worker threads for CPU-bound tasks, following best practices for thread pool management and data sharing. Learn when to use worker threads versus child processes, and how to architect applications that leverage multiple cores effectively.

Production Metrics & Monitoring - Implement comprehensive application metrics using Prometheus and learn to instrument your code for meaningful observability. We'll cover custom metrics, histograms, and performance-tracking patterns used in production environments.

OpenTelemetry Integration - Setup distributed tracing with OpenTelemetry to track requests across microservices. Learn to integrate with distributed systems while maintaining performance and gaining deep insights into your application's behavior through standardized telemetry collection.

By the end of this workshop, you'll have the tools and knowledge to build Node.js applications that perform well under pressure, scale horizontally, and provide the observability needed for production operations.

Prerequisites: Solid understanding of JavaScript, Node.js fundamentals, and basic async/await patterns.

Matteo Collina

Reimagining Kafka for Node.js

Presentation byPaolo Insogna

Kafka has become a go-to for powering real-time, event-driven apps.
If you’re building with Node.js, dealing with Kafka hasn’t exactly been smooth sailing: the developer experience is not ideal and native libraries are not supporting all the new Node.js features like multithreading.
So, we built something new. It’s fast, it’s built with TypeScript in mind, and it cuts through the mess to give you a clean, reliable way to work with Kafka in Node.js. Oh, and it’s 100% open source, as usual.
In this talk, we’ll share the journey, show what it can do, and help you level up your Kafka game without the usual headaches.

8:23 AM

Paolo’s bio: Node.js TSC Member, Principal Engineer at Platformatic, Polyglot Developer. RPG and LARP addicted and nerd on lot more. Surrounded by lovely chubby cats.

Similar Presentations
Cover Photo for High-Performance Node.js: From Event Loop Mastery to Production Observability

High-Performance Node.js: From Event Loop Mastery to Production Observability

What You'll Learn:

Event Loop Optimization & Performance - Understand how the event loop really works and learn Matteo Collina's proven techniques for preventing blocking operations. We'll explore the perf_hooks module for identifying performance bottlenecks, plus practical strategies for handling CPU-intensive tasks without freezing your application.

Strategic Caching Patterns - Implement multi-layered caching strategies using Redis, in-memory stores, and HTTP caching headers. Learn when to cache, what to cache, and how to invalidate cache effectively in distributed systems.

Promise Pitfalls & Alternatives - Discover when promises become performance liabilities and explore alternatives like streams and async iterators. We'll cover memory management and the hidden costs of promise chains in high-throughput scenarios.

Worker Threads & Multithreading - Master Node.js worker threads for CPU-bound tasks, following best practices for thread pool management and data sharing. Learn when to use worker threads versus child processes, and how to architect applications that leverage multiple cores effectively.

Production Metrics & Monitoring - Implement comprehensive application metrics using Prometheus and learn to instrument your code for meaningful observability. We'll cover custom metrics, histograms, and performance-tracking patterns used in production environments.

OpenTelemetry Integration - Setup distributed tracing with OpenTelemetry to track requests across microservices. Learn to integrate with distributed systems while maintaining performance and gaining deep insights into your application's behavior through standardized telemetry collection.

By the end of this workshop, you'll have the tools and knowledge to build Node.js applications that perform well under pressure, scale horizontally, and provide the observability needed for production operations.

Prerequisites: Solid understanding of JavaScript, Node.js fundamentals, and basic async/await patterns.

Matteo Collina

Get in touch!

hi@guild.host