Informatica announces new product innovations and enterprise-grade generative AI blueprint for Databricks

The expanded partnership includes four new capabilities:

• GenAI Solution Blueprint for Databricks DBRX – Informatica’s genAI blueprint for Databricks provides a roadmap for customers to develop Retrieval Augmented Generation (RAG)-based genAI applications using Databricks DBRX. Databricks DBRX is an open, general-purpose large language model (LLM) designed to enable users to develop enterprise-grade genAI applications. The blueprint allows customers to build RAG-based genAI solutions, leveraging Informatica’s IDMC no-code/low-code interface and metadata-driven intelligence and Databricks Vector Database for embedding data, enabling access to trusted and actionable data insights at scale.

Key benefits of the blueprint include:

• Grounding of generative AI application inferencing and summaries with enterprise data providing high-fidelity, trusted responses.
• Enrichment of prompts with comprehensive enterprise data and metadata to ensure prompts and responses are contextualised based on the unique industry and organisational semantics.
• Integration of data quality metrics to prioritise data set selection for grounding to ensure genAI applications are based on trusted data.
• No-code orchestration and definition of RAG chain and agent-based genAI applications ensuring customers can rapidly develop, maintain and scale genAI applications.
• Comprehensive data governance to provide transparency and trust in genAI applications by enforcing data access and use policies to deliver enterprise-compliant applications.

• Native Databricks SQL ELT – Native SQL ELT will enable users to perform in-database transformations with full pushdown capabilities on Databricks SQL, the intelligent data warehouse, leveraging native Databricks functions, such as the AI-powered Assistant, and serverless compute. This will allow customers to develop ETL pipelines to run on Databricks compute for AI-optimised performance, scalable data transformations and integrations.
• Cloud Data Integration-Free Service (CDI-Free) on Databricks Partner Connect – Informatica’s CDI-Free offering is now available via Databricks Partner Connect, giving customers quick and easy access to Informatica’s cloud data ingestion and transformation capabilities at no cost. CDI-Free via Partner Connect offers users ELT processing of up to 20 million rows of data or 10 ELT compute hours per month for free.
• Full IDMC Support via Unity Catalog – The Informatica IDMC platform is now fully validated with Databricks Unity Catalog, a unified governance layer for data and AI within the Databricks platform. The integration with Unity Catalog includes all critical IDMC services and greatly enhances Informatica’s ability to manage data lineage and governance on the IDMC Platform. 

“We are excited to expand our innovation and collaboration with Databricks with complete support for Unity Catalog and our enhanced comprehensive genAI solution blueprint,” said Informatica CEO Amit Walia. “Together, we can deliver an AI-powered foundation for data management and data intelligence in the cloud to accelerate our joint customers into the era of genAI with truly transformative applications.”

“At KPMG, we are thrilled about the new product offerings and innovations from Informatica and their inclusion in Databricks Partner Connect. This partnership enables us to leverage cutting-edge technologies from both market leaders to drive innovation and deliver tangible business value not only to our internal IT but also to the solutions offered to our clients,” said KPMG managing director Dennis Tally. “With Informatica’s leading AI-powered data management solutions integrated seamlessly into the Databricks ecosystem, we can accelerate our data-driven initiatives, build trusted AI models and unlock actionable insights at scale. We look forward to further collaboration with Informatica and Databricks to drive digital transformation and help our clients thrive in today’s data-driven world.”

“In the era of genAI, access to trusted, high-quality data is becoming more essential than ever, especially for RAG implementations,” said Databricks senior vice president of products Adam Conway. “The addition of Informatica’s low-code/no-code CDI-Free solution to Databricks Partner Connect, plus the integration of IDMC with Unity Catalog and new analytical data metadata exploration capabilities for RAG-based GenAI, accelerates access to high-quality data for customers building AI solutions and applications on the Databricks Data Intelligence Platform.”

Join Informatica and Databricks at booth #121 at the Data + AI Summit 2024 or visit our website to learn more about how Informatica and Databricks’ innovations can help harness the power of Generative AI.