Big Data News Hubb
Advertisement
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
Big Data News Hubb
No Result
View All Result
Home Big Data

Harness Unstructured Data with AI to Improve Investigative Intelligence 

admin by admin
March 9, 2023
in Big Data


In this special guest feature, Jordan Dimitrov, Product Manager, Unstructured Data Analytics, Cognyte, addresses the importance of unstructured data, why AI is an invaluable tool and how to move beyond legacy approaches to data management. Jordan is responsible for the unstructured data analytics in NEXYTE, Cognyte’s decision intelligence platform. Before transitioning to investigative analytics, he was a Product Analyst in cybersecurity, dealing with asset visibility and threat detection. His educational background is in Marketing & Business.

Until now, investigation and intelligence teams have largely focused their efforts on expanding their data collection capabilities to include more and more data sources. But for these teams – in domains including law enforcement, financial crimes, immigration management, national security, port/airport authorities and more – this growing stockpile of data often produces very little actionable insight. 

For smaller teams making do with fewer data sources, the core challenge is to extract more meaningful insights from the limited data available to them. Every detail must be thoroughly mined to complete the fullest possible investigative picture. 

For investigative teams large and small, data collection on its own is simply not enough. The focus has now shifted to fusing these disparate data sources for more effective, automated analytics that improve decision intelligence. 

The inability to synthesize unstructured data with conventional structured data has emerged as a major stumbling block in this effort, however. A recent survey of 200 chief investigators and senior analysts confirms this lingering challenge, among other valuable data points.

THE IMPORTANCE OF UNSTRUCTURED DATA

Unstructured data – including images, video and multimedia, hand-written criminal reports, etc. – accounts for a fast-growing percentage of today’s available intelligence content. Unstructured data including cyber data and criminal records already comprises the majority of data being used today for investigations by governmental organizations. And the volume of this data is growing exponentially, sourced from CCTV cameras, social media and other forums and formats. 

Investigators need the ability to efficiently ingest and analyze this media-based, unstructured data, and moreover, they need the ability to cross reference and correlate unstructured data with their structured databases. This is achievable with AI technology. 

Valuable insight can be extracted from unstructured data when it’s synthesized and analyzed properly with AI. Details embedded in photographs and hacker forums, for example, can reveal relationships between bad actors and other important contextual information. Textual analysis of police records is another important target application for unstructured/structured data synthesis.

ARTIFICIAL INTELLIGENCE IS INVALUABLE

AI is critical to this effort, and ultimately helps to transform unstructured data into structured data that can be analyzed easily. The AI-driven process begins with the automated extraction of identifiers inside the unstructured data – this could include faces, objects, text elements, location context and more. 

Leveraging comprehensive text, audio, image and video data analytics, AI can help surface previously hidden relationships and patterns emerging from the unstructured data. Analysts ultimately gain a clearer overall picture based on these linkages, significantly improving their decision intelligence. With a deluge of unstructured data now upon us, it would be impossible to do all of this manually at scale. 

AI is crucial for enrichment purposes throughout the process. This includes establishing, ingesting and indexing the available metadata accompanying the unstructured data. Additionally, AI enables the extracting, structuring and correlating of valuable ‘object’ data contained in media-based unstructured data (photos, videos, etc.).

BREAKING THE BARRIERS OF LEGACY APPROACHES

There are several limitations to the ad hoc approaches commonly employed today when managing unstructured data. When it comes to AI enrichment, it’s cumbersome to outsource this to multiple third parties for text, video, image, facial recognition enrichment, etc. Third-party access to sensitive information can also introduce obvious security and privacy concerns – and in secure ‘air gap’ environments, access to cloud-based data and services is often disallowed.

The challenges with third-party outsourcing extend downstream throughout the workflow. Offline, third-party enrichments introduce issues with data reingestion and other process bottlenecks. The multiplication of files and queries across multiple third-party services can also add considerable extra expense over time.

While many solutions have come to market in recent years, they typically are limited to handling specific unstructured data formats and/or they offer partial capabilities in a limited selection of supported languages. There are major benefits to managing these enrichments and processes via a single unified solution leveraging AI. Key advantages can include sophisticated capabilities for fusing structured and unstructured data streams and establishing and analyzing important correlations and patterns amid the data.

Unstructured data comprises the majority of data being used for investigations by governmental organizations today and will play an increasingly vital role in investigative analytics going forward. 

To ensure a holistic, data-driven intelligence assessment, unstructured data fusion and analysis are essential. 

A comprehensive, unified solution can fuse all data sources – structured and unstructured – together in one place, with all the cost and workflow efficiencies that entails. Most importantly, this approach can dramatically improve overall decision intelligence, yielding more precise and complete insights faster than what’s possible with legacy approaches. As more investigative teams tap AI-based solutions to automate these processes at scale, they’ll be well equipped to handle the flood of unstructured data that’s only just begun. 

Sign up for the free insideBIGDATA newsletter.

Join us on Twitter: https://twitter.com/InsideBigData1

Join us on LinkedIn: https://www.linkedin.com/company/insidebigdata/

Join us on Facebook: https://www.facebook.com/insideBIGDATANOW





Source link

Previous Post

Announcing the Winners for the Inaugural Databricks ASEAN Data Team Awards

Next Post

Inside Nextdata’s Plans for a Data Mesh Offering

Next Post

Inside Nextdata’s Plans for a Data Mesh Offering

Recommended

2023 Trends in Cloud Computing  

December 21, 2022

The Field of Data Science Continues to Change the World for the Better

October 22, 2022

Heard on the Street – 3/8/2023

March 8, 2023

Don't miss it

News

Bill Gates Says the Age of AI Has Begun, Bringing Opportunity and Responsibility

March 25, 2023
Big Data

Techniques for training large neural networks

March 25, 2023
Big Data

O’Reilly 2023 Tech Trends Report Reveals Growing Interest in Artificial Intelligence Topics, Driven by Generative AI Advancement

March 24, 2023
Big Data

Democratizing the magic of ChatGPT with open models

March 24, 2023
News

Introducing native support for Apache Hudi, Delta Lake, and Apache Iceberg on AWS Glue for Apache Spark, Part 2: AWS Glue Studio Visual Editor

March 24, 2023
News

ChatGPT Puts AI At Inflection Point, Nvidia CEO Huang Says

March 24, 2023

big-data-footer-white

© 2022 Big Data News Hubb All rights reserved.

Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Privacy Policy and Terms & Conditions.

Navigate Site

  • Home
  • Big Data
  • News
  • Contact us

Newsletter Sign Up

No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us

© 2022 Big Data News Hubb All rights reserved.