Big Data News Hubb
Advertisement
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
Big Data News Hubb
No Result
View All Result
Home News

Data Mesh Creator Takes Next Data Step

admin by admin
February 4, 2023
in News


Zhamak Dehghani, who is credited with popularizing the data mesh concept, announced earlier this month the founding of Nextdata. The new outfit will develop software designed to help customers implement “data product containers” that live in this data mesh environment.

Dehghani was the director of next tech incubation at Thoughtworks North America when originally conceived her ideas about the data mesh. The core ideas revolve around the knowledge that top-down centralization of data, vis a vis the data warehouses of old, is an impossibility in today’s massive and fragmented data environments. Instead, data will remain decentralized and exist in silos and will never be fully unified. In place of that old-style of data management, a more agile and modern concept is needed, and that’s where Dehghani’s idea of the data mesh comes in.

“The value promised from data hasn’t been realized, primarily because today’s ways of managing data for analytics, AI, and machine learning were conceived in a paradigm where data was treated like oil: as a precious resource to be extracted, pumped via pipelines to a storage facility, processed, and consumed,” Dehghani writes in a Medium article. “This creates a compounding series of problems. Fragile data pipelines break. Processes are fragmented. Data producers spend their time on low-value processes–mostly moving data between systems–without ever fully considering how data can and should be used.”

As we have previously written, Dehghani’s key insight was that data transformation cannot be hardwired into the data by engineers, but should work more like a filter applied against a common set of data. By enabling teams of developers to access decentralized data in a self-service manner with federated governance, they can take ownership of the data and build compelling products that scale, adhere to governance policies, and don’t perpetuate the chaos of the data pipeline world.

The data mesh concept spread widely over the past couple of years as a potentially valuable pattern to help with the management and exploitation of big data. During that time, Dehghani, who wrote the O’Reilly book on data mesh, has become a much sought-after speaker. She left Thoughtworks in 2022 and started work on a stealth startup, which we now know is Nextdata.

Nextdata will build tools that enable users to reach the full potential of a data mesh, according to Dehghani. “Data mesh has transformed our mental model of what a thriving data ecosystem looks like,” she writes in the Medium piece. “But our tools and techniques leave us with a large capability gap that makes data mesh implementations difficult, expensive, and full of compromises. My cofounders and I are building Nextdata to fill that gap.”

Deghani, who is a 2022 Datanami Person to Watch, is joined at Nextdata by three big data veterans, including Founding CTO Raghotham Murthy, Founding Head of Product Sina Jahan, and Founding Principal Engineer Dan Siwiec. Murthy is an Apache Hive PMC member and formerly a corporate with Cloudera. Jahan hails from ThoughtWorks, where he was the head of the data mesh practice. Siwiec was director of software engineering at Slalom and retains his position as principal architect at Kambr, which is owned by European travel giant Amadeus.

“Nextdata OS is the data mesh toolset designed to decentralize analytical data at a large scale–within and across organizations,” Deghani writes in her Medium piece. “We are introducing the data product container, a new unit of data value designed to be responsibly shared and used at scale. We are reimagining a new developer and user experience, native to data mesh and centered around data products.”

We have reached out to Dehghani and hope to catch up with her soon to hear more about the new venture.

Related Items:

Meet Zhamak Dehghani, a 2022 Datanami Person to Watch

Data Mesh Vs. Data Fabric: Understanding the Differences

Data Mesh: What’s In It For The Business?



Source link

Previous Post

Getting Started with Cloudera Stream Processing Community Edition

Next Post

AWS Lake Formation 2022 year in review

Next Post

AWS Lake Formation 2022 year in review

Recommended

How Infomedia built a serverless data pipeline with change data capture using AWS Glue and Apache Hudi

March 15, 2023

Top 5 benefits of using a travel expense management software

February 20, 2023

5 Ways to to Accelerate your Cloud Data Warehouse Migration

January 2, 2023

Don't miss it

News

Bill Gates Says the Age of AI Has Begun, Bringing Opportunity and Responsibility

March 25, 2023
Big Data

Techniques for training large neural networks

March 25, 2023
Big Data

O’Reilly 2023 Tech Trends Report Reveals Growing Interest in Artificial Intelligence Topics, Driven by Generative AI Advancement

March 24, 2023
Big Data

Democratizing the magic of ChatGPT with open models

March 24, 2023
News

Introducing native support for Apache Hudi, Delta Lake, and Apache Iceberg on AWS Glue for Apache Spark, Part 2: AWS Glue Studio Visual Editor

March 24, 2023
News

ChatGPT Puts AI At Inflection Point, Nvidia CEO Huang Says

March 24, 2023

big-data-footer-white

© 2022 Big Data News Hubb All rights reserved.

Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Privacy Policy and Terms & Conditions.

Navigate Site

  • Home
  • Big Data
  • News
  • Contact us

Newsletter Sign Up

No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us

© 2022 Big Data News Hubb All rights reserved.