Big Data News Hubb
Advertisement
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
Big Data News Hubb
No Result
View All Result
Home News

Data Mesh Creator Takes Next Data Step

admin by admin
February 4, 2023
in News


Zhamak Dehghani, who is credited with popularizing the data mesh concept, announced earlier this month the founding of Nextdata. The new outfit will develop software designed to help customers implement “data product containers” that live in this data mesh environment.

Dehghani was the director of next tech incubation at Thoughtworks North America when originally conceived her ideas about the data mesh. The core ideas revolve around the knowledge that top-down centralization of data, vis a vis the data warehouses of old, is an impossibility in today’s massive and fragmented data environments. Instead, data will remain decentralized and exist in silos and will never be fully unified. In place of that old-style of data management, a more agile and modern concept is needed, and that’s where Dehghani’s idea of the data mesh comes in.

“The value promised from data hasn’t been realized, primarily because today’s ways of managing data for analytics, AI, and machine learning were conceived in a paradigm where data was treated like oil: as a precious resource to be extracted, pumped via pipelines to a storage facility, processed, and consumed,” Dehghani writes in a Medium article. “This creates a compounding series of problems. Fragile data pipelines break. Processes are fragmented. Data producers spend their time on low-value processes–mostly moving data between systems–without ever fully considering how data can and should be used.”

As we have previously written, Dehghani’s key insight was that data transformation cannot be hardwired into the data by engineers, but should work more like a filter applied against a common set of data. By enabling teams of developers to access decentralized data in a self-service manner with federated governance, they can take ownership of the data and build compelling products that scale, adhere to governance policies, and don’t perpetuate the chaos of the data pipeline world.

The data mesh concept spread widely over the past couple of years as a potentially valuable pattern to help with the management and exploitation of big data. During that time, Dehghani, who wrote the O’Reilly book on data mesh, has become a much sought-after speaker. She left Thoughtworks in 2022 and started work on a stealth startup, which we now know is Nextdata.

Nextdata will build tools that enable users to reach the full potential of a data mesh, according to Dehghani. “Data mesh has transformed our mental model of what a thriving data ecosystem looks like,” she writes in the Medium piece. “But our tools and techniques leave us with a large capability gap that makes data mesh implementations difficult, expensive, and full of compromises. My cofounders and I are building Nextdata to fill that gap.”

Deghani, who is a 2022 Datanami Person to Watch, is joined at Nextdata by three big data veterans, including Founding CTO Raghotham Murthy, Founding Head of Product Sina Jahan, and Founding Principal Engineer Dan Siwiec. Murthy is an Apache Hive PMC member and formerly a corporate with Cloudera. Jahan hails from ThoughtWorks, where he was the head of the data mesh practice. Siwiec was director of software engineering at Slalom and retains his position as principal architect at Kambr, which is owned by European travel giant Amadeus.

“Nextdata OS is the data mesh toolset designed to decentralize analytical data at a large scale–within and across organizations,” Deghani writes in her Medium piece. “We are introducing the data product container, a new unit of data value designed to be responsibly shared and used at scale. We are reimagining a new developer and user experience, native to data mesh and centered around data products.”

We have reached out to Dehghani and hope to catch up with her soon to hear more about the new venture.

Related Items:

Meet Zhamak Dehghani, a 2022 Datanami Person to Watch

Data Mesh Vs. Data Fabric: Understanding the Differences

Data Mesh: What’s In It For The Business?



Source link

Previous Post

Getting Started with Cloudera Stream Processing Community Edition

Next Post

AWS Lake Formation 2022 year in review

Next Post

AWS Lake Formation 2022 year in review

Recommended

Habib Bank manages data at scale with Cloudera Data Platform

November 19, 2022

Top 11 Flutter Open Source Apps To Take Advantage Of

April 13, 2023

Upskill with instructor-led training and save 20% off today

September 2, 2023

Don't miss it

Big Data

Announcing General Availability of Model Registry

November 30, 2023
Big Data

Sophos Anticipates AI-Based Attack Techniques and Prepares Detections

November 30, 2023
Big Data

Automating Governance of PHI Data in Healthcare

November 30, 2023
News

How Eightfold AI implemented metadata security in a multi-tenant data analytics environment with Amazon Redshift

November 30, 2023
News

Altman’s Back As Questions Swirl Around Project Q-Star

November 30, 2023
Big Data

Cloudera’s QATS Certification for Dell PowerScale Unleashes a New Era of Data Management

November 29, 2023
big-data-footer-white

© Big Data News Hubb All rights reserved.

Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Privacy Policy and Terms & Conditions.

Navigate Site

  • Home
  • Big Data
  • News
  • Contact us

Newsletter Sign Up

No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us

© 2022 Big Data News Hubb All rights reserved.