Data Engineering Summit 2024

[WHEN]

MAY. 30 31
2024

DES is Organized by AIM

Hotel Radisson Blu
Bengaluru India

Focused on data engineering innovation, this 2-day conference will give attendees direct access to top engineers & innovators from leading tech companies who will talk about the software deployment architecture of ML systems, how to produce the latest data frameworks, frameworks and solutions for business use cases.

1000+ Attendees

50+ Speakers

3rd Edition

India's first & only conference dedicated to the emerging field of Data Engineering.

2024 SCHEDULE

We are in the process of finalizing the schedule for 2024. Please check back this space again. Expect more than 50 speakers to speak at DES 2024. To explore speaking opportunities with DES, write to info@analyticsindiamag.com

Expand All +
  • Day 1 | HALL 2 - Practical Insights and Best Practices


  • Embeddings are a ubiquitous term in discussions surrounding AI models, particularly in GenAi. While numerous resources explore the mathematical and theoretical underpinnings of embeddings and their significance in training Transformers or ML models in general, there remains a scarcity of material exploring their practical applications. Embeddings serve as data structures containing contextual information essential for executing intelligent tasks. Among the myriad applications of AI, semantic search stands out as one of the most prominent, directly influenced by the quality and scale of embeddings. The selection of embeddings significantly impacts search capabilities and the supported modalities, ranging from text-only to image search or even a fusion of both, known as Multi-Modality search. Recognizing embeddings as pivotal data structures, devising efficient storage mechanisms is imperative. Vector databases emerge as specialized solutions optimized for storing and retrieving embeddings. In this presentation, I will delineate establishing a reference architecture using Vector Database & Embeddings for intelligent search, encompassing options for text, image, and multi-modal searches. Also, I will highlight a few applications leveraging this architecture and outline potential avenues for future exploration.

  • Day 1 | Main Hall - Thought Leadership and Strategic Insights


  • We haven't found any session that matches you're criteria
  • Day 2 | HALL 2 - Practical Insights and Best Practices


  • ata observability has garnered considerable interest in recent times. It has evolved from Observability, which relied on monitoring, logging, tracing, etc. However, the expectations associated with data observability and its key tenets have shifted significantly from traditional ways of thinking and implementing it. This session will delve into more practical aspects of Data Observability and how individuals, organisations, and platforms should think differently to gain maximum value from it in a cost-efficient manner.

  • Day 2 | Main Hall - Thought Leadership and Strategic Insights


  • We haven't found any session that matches you're criteria

Schedule from last Year

  • Future of LLMops: Deployment and Scaling
  • Engineering Practices for Data Resilience
  • Building Resilient Data Pipelines
  • Real-time Streaming for Enterprise Data Lakes
  • Conceptualizing Data as a Product
  • Real-time Dashboards and Unified Databases on Cloud
  • The Emergence of Data Mesh Architecture
  • Real-Time Data Processing with Apache Kafka
  • From Data Chaos to Organized Value Generation
  • Architecting Data Pipelines for Generative AI Models
  • Generative AI’s Role in Data Engineering
  • Designing Real-time Data Stream Processing Architectures
  • Data Modeling and Schema Design for Business Efficiency
  • Ensuring Data Trust and Quality in Modern Data Stacks
  • The Value of Operations Data
  • Modernizing the Data Access Layer
  • Monetizing Data at Scale
  • Evolving ETL Practices for Modern Data Integration
  • Operationalizing Foundational Models
  • Optimizing Big Data with Probabilistic Data Structures
  • The Importance of a Data Semantic Layer 
  • Data Fabric vs. Data Mesh for Future-Proofed Platforms
  • Building Efficient Data Lakes and Warehouses
  • Leveraging DataOps for Effective Data Management
  • Transitioning to Real-Time Data with Streaming Pipelines
  • Managing Data Noise and Subjectivity

Register for DES 2024

  • Regular Pass

    Available from 12th Apr 2024 to 10th May 2024
  • All access, 2 day passes
  • Group Discount available
  • 4999
  • Late Pass

    Available from 11 May 2024 onwards
  • All access, 2 day passes
  • No Group Discount available
  • 6999

What to expect?

Get ready for the 3rd Edition of the Data Engineering Summit in 2024, a not-to-be-missed event spanning two action-packed days, featuring two distinct tracks designed to cater to a wide array of interests and expertise in the field of data engineering. This summit promises to be an immersive experience, combining enlightening keynote speeches, interactive workshops, and in-depth panel discussions led by renowned industry leaders and innovators.

Alongside the learning tracks, attendees will have the unique opportunity to explore exhibitions showcasing the latest technologies, tools, and services in data engineering.

Topics covered

The Data Engineering Summit will feature a range of presentations, panel discussions, and workshops. Our speakers at the Data Engineering Summit 2024 will cover a wide array of vital topics, including the complexities of big data architectures and the best practices for managing streaming data pipelines.

Topics to be explored encompass the entire lifecycle of data pipelines, the journey of data models from experimentation to production, the integration and utility of data fabric, and the critical aspects of Data Provenance & Governance.