Fiddler, a pioneer in Model Performance Management (MPM), launched a powerful set of capabilities in analytics, diagnostics, and vector monitoring to help monitor, explain, analyze, and improve trustworthy models.
The proliferation of headline-grabbing news on Generative AI has helped advance the adoption of AI within organizations. In fact, according to McKinsey, the average number of AI capabilities that organizations use, such as natural-language generation and computer vision, has doubled — from 1.9 in 2018 to 3.8 in 2022. As organizations continue to run a greater number of models in production, it is growing increasingly important that data scientists and machine learning (ML) practitioners resolve model issues quickly, reduce operational costs, and increase business impact by improving model outcomes.
Delivering Advanced Actionable Insights and Diagnostics for ML Models with New Capabilities
Fiddler is helping practitioners create a continuous feedback loop in ML lifecycles and gain contextual insights in a single, unified view. Advanced analytics will surface actionable insights, making it easy to map model performance to business KPIs. Data Science and MLOps teams can help organizations save time, effort, and money through sharp prioritization while focusing on delivering better business outcomes. Fiddler’s new capabilities include:
- Customizable Charts and Dashboards for Better Decision Making: A collection of shareable reports with monitoring insights, dashboards increase team collaboration and alignment between ML practitioners and business stakeholders. In a single custom chart, teams can track as many as six metric queries and up to twenty inputs and outputs for one or more models at a time and compare multiple models in real-time.
- Diagnostics and Root Cause Analysis (RCA) for Quick Resolution: Users can surgically drill down into problem areas by performing RCA and pinpoint the underlying reason that caused a model to underperform or drift. Once the problem metric is identified, the user can drill down into feature impact and importance, like data quality or errors, in order to improve the model.
- Alerts Dashboard for Issue Prioritization: Powerful and flexible alerts are fully customizable and accessible through a central dashboard. Users will have full control over the type of issues they want to be alerted on along with the timing for such alerts to reduce alert fatigue. Based on the severity of the alerts, MLOps teams can prioritize the most important issues across models in testing and production.
- 3D UMAP Visualization for NLP and CV models to Diagnose Complex Drift: Data scientists can locate and identify complex data drift occurring in high dimensional space and visualize where and how the drift happened using the interactive 3D UMAP visualizer. A 3D UMAP reduces the number of dimensions, making analysis easier. For example, due to an uptick in orders on out-of-stock products, an online retailer can view the product images within the UMAP visualizer and notice that some products are mislabeled or misclassified, causing data drift.
With the introduction of the NIST framework, model governance has become increasingly important for all organizations. Fiddler’s new capabilities will be incredibly valuable in auditing model governance as the platform will automatically generate custom charts that contain performance metrics needed to validate the model. These reports can then be shared to develop business narratives, provide compliance teams with data-backed model insights and enhanced visibility, and build company-wide trust in model performance.
Democratizing Access to Responsible AI with the new Fiddler Free Trial
MPM solutions, like Fiddler, play a critical role in enabling businesses to build trustworthy and responsible AI solutions. Now, anyone interested in experiencing the power of Fiddler can do so via the company’s new free, 14-day self-service trial. The free trial beta includes ready-to-use model examples, quick start guides, an intuitive product tour, and ‘how-to’ videos, creating frictionless access to MPM.
“As organizations continue to launch more models into production, it becomes increasingly challenging to effectively monitor, diagnose, and improve those models. Else it creates ripple effects in the form of model degradation, bias, non-compliance, and consumer mistrust,” said Krishna Gade, Co-founder and CEO of Fiddler. “Fiddler was created to make ML models easier to manage and trust. We want everyone to be able to use AI to its full potential, in a manner that is both fair and reliable, and the free trial will give anyone interested in achieving that goal to do so quickly.”
New Simple and Transparent Pricing Plans
Fiddler has also launched a new transparent pricing plan that enables more AI-first companies to kickstart their ML operations and meet organizations where they are on their AI journey. Fiddler’s pricing methodology provides a frictionless experience for customers to only pay for what they need using four simple metrics: data ingestion, number of models, number of explanations, and data retention. Fiddler is the first MPM solution to offer data ingestion as its primary pricing metric. This resembles a consumption pricing model where predictions from a model with fewer features are cheaper than one with many features.
Enterprise-Ready Compliance
Fiddler is also now compliant with SOC2 Type II – which covers the trust service categories of security, confidentiality, and availability – and HIPAA. Organizations operating under HIPAA can now securely leverage Fiddler to offer better patient experiences and faster and more accurate medical diagnoses and reduce fraudulent health insurance claims.
Sign up for the free insideBIGDATA newsletter.
Join us on Twitter: https://twitter.com/InsideBigData1
Join us on LinkedIn: https://www.linkedin.com/company/insidebigdata/
Join us on Facebook: https://www.facebook.com/insideBIGDATANOW
