Big Data News Hubb
Advertisement
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
Big Data News Hubb
No Result
View All Result
Home Big Data

Databricks for GxP – The Databricks Blog

admin by admin
April 6, 2023
in Big Data


What is GxP?

GxP stands for “Good x Practices,” where x refers to a specific discipline, such as clinical, manufacturing, or laboratory. The goal of GxP compliance is to ensure that a compliant process runs reliably, can survive failures and human error, and can be relied upon. For example, there are a collection of guidelines, standards, and regulations that govern the creation and manufacture of drugs, and it’s important to all of us that the final product provided to consumers can be relied upon. In the United States, many GxP guidelines are described in Federal regulations such as 21CFR Part 11.

When data is being processed in a workflow that falls under GxP, the data processing infrastructure generally also falls under GxP. The infrastructure that stores and processes that data may need to be qualified to verify that the software/infrastructure is properly installed and configured. Qualification can be achieved by defining Standard Operating Procedures (SOP) for system installation or deployment, and by monitoring and auditing the configuration of the installed infrastructure.

Any software algorithms used may also need to be validated to verify that the algorithm robustly produces a correct result. For software, validation is normally achieved through strong software development lifecycle (SDLC) processes.

The requirements imposed by GxP are similar to the requirements imposed in other regulated settings, such as CLIA/CAP requirements for validating results returned in clinical laboratories.

Overview of GxP-compliant workloads on Databricks

Databricks supports GxP-compliant workloads, with many customers now running GxP-compliant workloads, particularly in manufacturing and R&D.

The majority of GxP-compliance relates to the design of the workloads that the customer chooses to run. As Databricks is a compute platform, customers will leverage SOPs for deployment and monitoring along with a strong SDLC for their development pipeline. Databricks is well suited to support both these, due to the abundance of API support, log availability, and common integration with the continuous integration / continuous development (CI/CD) pipelines that support a strong SDLC.

Databricks recently has released documentation that provides guidance to how customers can install, configure, and validate Databricks in GxP-compliant environments.

Please learn more at our Security and Trust Center, here!



Source link

Previous Post

How Morningstar used tag-based access controls in AWS Lake Formation to manage permissions for an Amazon Redshift data warehouse

Next Post

The Truth Behind Why Most ML Projects Still Fail and What to Do About It

Next Post

The Truth Behind Why Most ML Projects Still Fail and What to Do About It

Recommended

Build the next generation, cross-account, event-driven data pipeline orchestration product

November 5, 2022

Video Highlights: Generative AI with Large Language Models

July 26, 2023

How Providence Health Built a Model marketplace using Databricks

October 27, 2023

Don't miss it

Big Data

Heard on the Street – 12/4/2023

December 5, 2023
News

Unlocking the value of data as your differentiator

December 5, 2023
News

AWS Launches High-Speed Amazon S3 Express One Zone

December 5, 2023
Big Data

PwC’s 2023 Emerging Technology Survey

December 4, 2023
Big Data

Databricks Wins AWS ISV Partner of the Year Award in NAMER

December 4, 2023
News

Amazon Redshift announcements at AWS re:Invent 2023 to enable analytics on all your data

December 4, 2023
big-data-footer-white

© Big Data News Hubb All rights reserved.

Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Privacy Policy and Terms & Conditions.

Navigate Site

  • Home
  • Big Data
  • News
  • Contact us

Newsletter Sign Up

No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us

© 2022 Big Data News Hubb All rights reserved.