Welcome to insideBIGDATA’s “Heard on the Street” round-up column! In this regular feature, we highlight thought-leadership commentaries from members of the big data ecosystem. Each edition covers the trends of the day with compelling perspectives that can provide important insights to give you a competitive advantage in the marketplace. We invite submissions with a focus on our favored technology topics areas: big data, data science, machine learning, AI and deep learning. Enjoy!
The Power of Data and the Airline Industry. Commentary by CEO and co-founder of DataScalp, Dwight Harris Jr.
We have seen the power that data has to make large-scale changes in business operations. It is imperative that the next area that needs this large-scale change is the airline industry. For decades, customers have been at the mercy of major airlines. From massive corporations like United Airlines and JetBlue to small carriers like Spirit and Frontier, the belief in delivering a positive travel experience to customers has fallen to the wayside. Rich crowdsourced data is the key to drive a major overhaul in flight experience. Through data collected by those who are actually experiencing travel issues like delays, cancellations, lost baggage, or slow refund time, these airlines can fully understand where they are lacking. Airlines must pay attention to what customers are saying in these channels and adjust their operations accordingly. Otherwise, a competitor is just one click away.
The importance of data quality in benefits. Commentary by Peter Nagel, VP of Engineering, Noyo
The benefits industry brings together a wide range of business models in varying states of modernization. As a result, data quality issues are a persistent and pervasive problem. With EDI still the most common method for collecting enrollment and eligibility data, many companies have learned how to work around its limitations. That’s now beginning to change with growing adoption of API-enabled data exchange. Building ETL capabilities that clean and standardize benefits data on top will help address the quality issues that impact everyone in the industry — drastically reducing coverage-impacting issues and opening up new pathways for innovation.
Intersection of AI and Staffing: How to Scale Your Business Without Adding Headcount. Commentary by Rebecca Jones, general manager of Mosaicx
Operating a business is a balancing act. Businesses are navigating a complex labor market that impacts how they scale their businesses and optimize their existing resources. AI-enabled tools allow business leaders to introduce automation to reduce the burden on understaffed teams and identify growth opportunities. Intelligent virtual agents and other AI tools automate internal and external operations and communications. For example, these conversational tools can automate shift scheduling, reporting, and payroll discrepancies, and they can also identify opportunities to generate revenue. Companies that turn to these solutions reduce the burden on team members, which improves employee retention, while also saving the company money and scaling services.
Hybrid cloud workflows remain key. Commentary by David Feller, Vice President of Product Management and Solutions Engineering, Spectra Logic
Bandwidth, access and cost concerns mean that very large and active data lakes will remain on-premises for sectors such as genomics, life sciences, university institutes, and government research, that generate and store massive volumes of data. In other environments, hybrid cloud workflows remain key. The media and entertainment industry leads the way here, in part due to its distributed workflows and the huge public cloud investment made by AWS to support this market. And with data backup rapidly transitioning to cloud interfaces (S3) and leveraging the combination of cloud compute, databases, and long-term storage, on-premises solutions will need to adapt for cloud interoperability.
Apache Arrow Makes Data Move, Which Makes The World Move. Commentary by Alex Merced, Developer Advocate at Dremio
Whether a for-profit, nonprofit or any other type of entity, an organization’s use of data will make or break its growth and impact. The Apache Arrow project has transformed the way our applications talk to data by creating standards on how to represent that data in-memory and transport it between applications. When I use a tool that leverages Apache Arrow not only will I see better performance, but I also know that the room for interoperability with other tools is likely—making it easier for me to create the workflows I need with the tools right for the job. Performance and interoperability are becoming the cornerstone of what open-source projects like Apache Arrow, Apache Parquet and Apache Iceberg bring to the modern data stack.
Vertical Industries Slow to Innovate in the Cloud. Commentary by Jeff Robbins, Founder and CEO, LiveData
Several risks are facing businesses today including the threat imposed on specific vertical industries if they don’t innovate in the cloud to take advantage of the benefits and solve long-standing problems with on-premises computing. Looking to 2023, some highly regulated vertical industries will continue to experience dynamic tensions inherent in a high-performance cloud-native data strategy. However, few verticals are impacted like healthcare. For example, enabling hospital decision-makers with current and accurate data while navigating the many security and privacy constraints (e.g., those imposed by HIPAA) is often still somewhat aspirational, but the trend is underway. Hospitals need to do more with the resources they have. Moving actionable analytics to the cloud gives hospital administrators the platform to improve many factors in a nurse’s workplace, contributing to job satisfaction and, critically, retention. CIOs and data teams in vertical industry markets need to partner with that industry’s experts who can harness broadly accepted horizontal technologies (e.g., Tableau) in a safe way for their vertical. Failing to prepare risks your organization getting left behind the curve as your peers and competitors enhance their workplaces to keep pace with the heightened expectations of today’s (and tomorrow’s) workforce. While cybersecurity, governance, regulatory compliance, and other facets of avoiding risk make it tempting to adopt a cloud native strategy slowly, the rapid changes in our world require some purposeful initiatives to make a real impact on what working at your organization means to your employees.
Don’t Miss the Real-time Wave. Commentary by Gary Hagmueller, CEO of Arcion Labs
Businesses that miss the real-time wave will undoubtedly experience competitive disadvantages when compared to adopting firms. These disadvantages will grow over time. Real-time data availability is an innovation phase or wave, and as has been seen many times before, such waves tend to create material winners and losers. It’s well known that adopting an innovation wave early in such a cycle can create a material separation between the fortunes of early adopters and those that adopt in the mainstream (or later). Think Walmart vs. Sears, Airbnb vs Hilton, and Netflix vs. Blockbuster. Smart technology-aware executives from the winners noted above had cemented unsurmountable leads by the time their more mainstream competitors even realized something needed to change. Aside from competitive factors, firms that fail to adopt these techniques face the risk of feeling and appearing old very quickly. In the modern data age, it’s getting easier by the day to detect a data leader and a data laggard. And tolerance of the laggards will begin to decline precipitously as the leaders enhance their pace. You don’t want the threat of becoming a data laggard.
Regulating AI – Ensuring fair practices and integrity. Commentary by Alan Cross, Chief Commercial Officer, Diveplane
The provisions in the EU AI Act, especially the all-important Article 13 requirement that users be able to understand and interpret AI, are essential for a future in which AI is accountable to its users. Regulatory requirements for auditable, explainable, interpretable technology are urgently needed to prevent unalignable “black box” neural networks from being deployed on socially critical systems. For similar reasons, the goals of the US AI Bill of Rights Blueprint are important. In particular, the fourth principle asserts that users should be able to understand the automated systems that affect their lives, and this is of critical importance to protecting the public from the real risks that uninterpretable AI will become unaligned AI. However, Diveplane has some concerns about whether the Blueprint is the best path forward for AI regulation in the United States. We believe that a more robust regulatory structure will be required to promote enterprise best practices and protect consumers. Companies need the reliability afforded by clear and objective regulations that can allow them the confidence to invest resources in innovative systems. Consumers need the security of legal protection for their data, privacy, and safety. We believe the American public would be better off if the United States created a comprehensive, balanced framework that both businesses and consumers could rely on. We hope that the next step forward in the development of the Blueprint for an AI Bill of Rights will work toward that.
AI – The Future of eCommerce Accounting. Commentary by Rohan Thambrahalli, CEO and founder of DimeTyd
Amazon is a primary channel for B2C and B2B vendors, yet the e-commerce giant’s accounting systems can result in significant lost profit and inefficiency. Amazon’s accounting is complicated, and there are virtually no software platforms designed for vendors to manage the volume and complexity of transactions. With up to 5% loss on the line with every $100,000 generated through Amazon, sellers and vendors need to catch up and meet Amazon with the same advanced technology. Amazon has long recognized the benefits of artificial intelligence (AI), machine learning and related technologies, but vendors have struggled to match its complexity for true clarity in invoicing and reconciliation. Advanced accounting solutions leveraging AI and automation can match computation to computation, including creating accurate invoices, tracking shipping, and automatically determining what should and should not be invoiced. Ultimately, Amazon vendors are turning to accounting solutions featuring AI technology that is able to process millions of data points – and play a vital role in making the accounting and reconciliation process error-free, cost-efficient, and logistically seamless.
How will AI implementation grow in 2023? Commentary by Ganesh Shankar, CEO and Co- Founder of RFPIO
AI shows immense promise in 2023. As we finally get away from the pandemic haze, companies are buckling down and refocusing on how to do more with less – especially amid a recession. We are confident knowing that AI implementation has made a new mark for the tech industry trend, but some businesses are curious where AI is going. Factors such as advancements in AI research and development, increased access to data sets and more robust computing power, as well as changing economic and regulatory environments will all impact how far AI reaches in 2023. More businesses will invest in AI implementation due to its popularity and success as companies shift to a permanent, hybrid workforce. Due to this, AI will become more accessible to employees globally. Especially in industries like healthcare, financial services, and manufacturing, AI adoption can create more efficiency. Businesses will learn to utilize AI more and will also encourage their employees to embrace it daily. AI is set to see significant growth across computer vision, natural language processing and reinforcement learning in the next few years and will forever impact how employees work. By embracing AI, the future of work will evolve, and employees will be able to be more efficient and up-level their skills and knowledge base.
Sign up for the free insideBIGDATA newsletter.
Join us on Twitter: https://twitter.com/InsideBigData1
Join us on LinkedIn: https://www.linkedin.com/company/insidebigdata/
Join us on Facebook: https://www.facebook.com/insideBIGDATANOW