Informatica and Databricks Expand AI Data Capabilities

Enterprise cloud data management leader Informatica has announced an expanded partnership with Databricks.  The goal is to bring together the full range of Informatica’s AI-powered Intelligent Data Management Cloud (IDMC) platform capabilities within the Databricks Data Intelligence Platform.

The expanded partnership also aims to enable customers to deploy enterprise-level generative AI (Gen AI) applications at scale, based on a foundation of high-quality, trusted data and metadata. Likewise, the companies have launched a full Unity Catalogue to support Informatica’s Intelligent Data Management Cloud platform, in addition to a free data integration service via Databricks Partner Connect.

The news comes in the wake of Informatica having launched its AI model, CLAIRE GPT, in May 2024. The model is designed to help businesses use their data for Gen AI applications, using large amounts of data to create new content.

Additionally, Databricks has been partnering with other notable organisations such as KPMG to help clients get the most out of their data and empower them to innovate with AI at a faster pace.

Developing enterprise-grade Gen AI applications

The expanded partnership between both organisations includes four new capabilities, including a Gen AI solution blueprint for Databricks DBRX, the company’s open, general-purpose large language model (LLM). 

Informatica’s Gen AI blueprint provides a roadmap for customers to develop Retrieval Augmented Generation (RAG)-based Gen AI applications using the power of Databricks DBRX. The company’s blueprint is designed to allow customers to build RAG-based solutions by leveraging Informatica’s no-code/low-code interface and metadata-driven intelligence and the Databricks Vector Database for embedding data. 

With this, the companies can also allow access to trusted and actionable data insights at scale, ensuring that customers can harness the full potential of AI technologies.

“We are excited to expand our innovation and collaboration with Databricks with complete support for Unity Catalogue and our enhanced comprehensive Gen AI solution blueprint,” comments Amit Walia, Chief Executive Officer at Informatica. “Together, we can deliver an AI-powered foundation for data management and data intelligence in the cloud to accelerate our joint customers into the era of GenAI with truly transformative applications.” 

As part of the offering, Native Databricks SQL ELT will enable users to perform in-database transformations, leveraging the power of an AI Assistant and serverless compute. Likewise, the Cloud Data Integration-Free Service (CDI-Free) on Databricks Partner Connect - Informatica’s CDI-Free offering is now available, giving customers quick and easy access to Informatica’s cloud data ingestion and transformation capabilities at no cost.

AI innovation and the importance of clear data

As enterprise Gen AI demand continues to surge worldwide, having high-quality data that businesses can trust is essential. This is particularly the case when it comes to RAG implementations, as SVP of Products at Databricks, Adam Conway, explains.

“The addition of Informatica’s low-code/no-code CDI-Free solution to Databricks Partner Connect, plus the integration of IDMC with Unity Catalog and new analytical data metadata exploration capabilities for RAG-based GenAI, accelerates access to high-quality data for customers building AI solutions and applications on the Databricks Data Intelligence Platform,” he says.

Informatica have been working to expand upon their AI offerings in recent months, having recently launched CLAIRE AI. The AI model is designed to redefine the future of data management, providing a natural language interface to the Informatica Intelligent Data Management Cloud (IDMC). This allows users of the AI to engineer and govern their data through simple conversational interactions.

Likewise, as a leading AI brand, teams at Databricks are able to combine the best of data warehouses and data lakes to offer an open and unified platform for data and AI. The company’s machine learning capabilities enable business customers to process data easily and standardise their AI use, ranging from experimentation to production.

Comprehensive data governance can offer businesses greater transparency and trust in Gen AI applications by enforcing data access and use policies to deliver enterprise-compliant applications. 

******

Make sure you check out the latest edition of Technology Magazine and also sign up to our global conference series - Tech & AI LIVE 2024

******

Technology Magazine is a BizClik brand