Simple Platform Engineering and Simply High Cardinality Observability

Platform engineering transforms repetitive Engineering requirements into standardised and dependable services, or "paved roads". These paved roads offer engineering teams a smooth way to develop and deploy business logic layers continuously. Monitoring and Observability is one such platform workflow.

Compared to other components like Kafka, Spark, HDFS, etc., observability and monitoring have not had the luxury of warehouse-grade infrastructure components that can scale with the Engineering needs. In the absence of this "paved road", teams end up with a patchwork of solutions and siloed data or, worse, no solutions at all.

Observability heavily relies on metrics as a crucial aspect, providing a quick and cost-effective approach to addressing software health and SDLC queries. However, as the needs increase, so does the cardinality. This talk discusses building Observability platforms and workflows to manage the pulse of High Cardinality to solve use cases like combating Noisy Neighbors and being able to observe performance across millions of concurrent users.


Speaker

Piyush Verma

Co-Founder and CTO @Last9

Piyush Verma is co-founder and CTO at https:/last9.io. Earlier, he led SRE @ TrustingSocial.com to produce 600 million daily credit scores across 4 countries. In his past life, he built Oogway.in (exit to TrustingSocial.com), datascale.io (exit to Datastax), and siminars.com.

Read more

Session Sponsored By

Last9 provides tools to improve Reliability in large-scale cloud-native environments.

Date

Wednesday Oct 4 / 02:45PM PDT ( 50 minutes )

Location

Pacific LM

Video

Video is not available

Share

From the same track

Session

Introduction to Real-Time Training and Scoring in AI/ML

Wednesday Oct 4 / 01:35PM PDT

In the rapidly evolving landscape of AI/ML, the shift from batch to real-time data processing is significant. It impacts how quickly and dynamically we can learn from data, leading to more responsive AI applications.

Speaker image - Wes Wagner

Wes Wagner

Solutions Engineer @Redpanda

Session

Can’t Apps and Databases All Just Get Along?

Wednesday Oct 4 / 11:45AM PDT

Availability is a tricky thing. In order for your tier 0 endpoints to be available all their hard dependencies have to be available. For Stytch that means basically network, compute, database, and messaging providers.

Speaker image - Joshua Hight

Joshua Hight

Software Engineer @Stytch

Session

LLMs + Knowledge Graphs = Better Together

Wednesday Oct 4 / 03:55PM PDT

LLMs are often like the know-it-all at a bar - they can quickly and confidently produce realistic sounding answers to just about any question - even if the answers are complete fabrications.

Speaker image - Mark Quinsland

Mark Quinsland

Senior Field Engineer @Neo4j

Session

Designing AI Agents with System Thinking

Wednesday Oct 4 / 10:35AM PDT

AI agents are a perfect fit for serverless environments, as they can leverage the power of the cloud and the edge for fast and accurate decision making.  It is often the case that AI applications do not require the costly vector database and compute solutions which are often used today, to s

Speaker image - Logan Grasby

Logan Grasby

Founder @Azule.ai