Databricks and Informatica join hands to sail through hybrid data

Must Read

Over 50% candidates with Hindi, regional languages clears UPSC civil service exam in 2018

In 2018, a total of 812 candidates were recommended for central civil services, among them 485 candidates were those who had chosen Hindi or other regional languages as mother tongue

Modi govt to amend IT Act to trace rogue messages on WhatsApp

The Union government said that to trace rogue messages on platforms such as WhatsApp, it has proposed to amend the Information Technology (Intermediaries Guidelines) Rules, 2011 of the IT Act, 2000
Tech Observer Desk
Tech Observer Desk
TechObserver.in covers e-governance, enterprise IT, startups, telecom and consumer electronics.

Databricks and Informatic have partnered to introduced product integrations that can provide efficient data ingestion, simplified creation of high-volume data pipelines, and integrated for data discovery and end-to-end lineage.

The company said that data engineering and data science teams depend on many sources that make finding the right datasets and tracing the lineage of data through pipeline processing impossible. Bringing the capabilities for discovery, lineage, ingestion and preparation together with Databricks’ Unified Analytics Platform provides an analytics solution for intelligent data pipelines that leverages the correct datasets and provides end-to-end data lineage for analytics and machine learning implementations.

Informatica also announced support for Delta Lake, the new open source project from Databricks, to provide an analytics-ready place to store massive amounts of data. Delta Lake provides ACID transactions and schema enforcement that brings reliability at scale to data lakes and makes high-quality datasets ready for downstream analytics.

“This seamless integration between Databricks and Informatica enables data engineers to easily discover the right datasets and ingest high volumes of data from multiple sources into Delta Lakes,” said Ali Ghodsi, co-founder and CEO, Databricks.

“This means joint customers can use the reliability and performance at scale from Databricks to make data ready for analytics and machine learning – and get intelligent governance to find, track and audit that data from end to end.”

“Trusted, high-quality data and efficient use of data users’ time are critical success factors for analytics and data science projects,” said Chakravarthy, CEO, Informatica.

“Informatica’s support for Databricks allows data engineers to rapidly build serverless pipelines to ingest and govern data from a variety of sources at scale while empowering data scientists using Databricks to quickly find and prepare the data for their analytics and data science projects in a self-service fashion.”

- Advertisement -
avatar
1000
  Subscribe  
Notify of
- Advertisement -

Latest in TECH

Modi govt mulling to bring national level blockchain framework

While replying to question in the Lok Sabha, the Union minister of state for electronics and IT Sanjay Dhotre said that an approach paper on National Level Blockchain Framework is being prepared
- Advertisement - ESDS eNight Cloud Hosting

Related Articles