Big Data News Hubb
Advertisement
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us
No Result
View All Result
Big Data News Hubb
No Result
View All Result
Home Big Data

A research agenda for assessing the economic impacts of code generation models

admin by admin
March 28, 2023
in Big Data


OpenAI is developing a research program to assess the economic impacts of code generation models and is inviting collaboration with external researchers. Rapid advances in the capabilities of large language models (LLMs) trained on code have made it increasingly important to study their economic impacts on individuals, firms, and society. Codex – an LLM developed by OpenAI by fine-tuning GPT-3 on billions of lines of publicly available code from GitHub – has been shown to generate functionally correct code 28.8% of the time on a sample of evaluation problems (Chen et al. 2021). This may have important implications for the future of coding and the economics of the industries that depend on it. In this document, we lay out a research agenda to assess the effects of Codex on economic factors of interest to policymakers, firms, and the public. We make a case for this research agenda by highlighting the potentially broad applicability of code generation models to software development, the potential for other LLMs to create significant social and economic impact as model capabilities advance, and the value of using Codex to generate evidence and establish methodologies that may be applicable to research on the economic impacts of future models. We propose that academic and policy research focus on studying code generation models and other LLMs so that evidence on their economic impacts can be used to inform decision-making in three key areas: Deployment policy, AI system design, and public policy. To help guide this research, we outline six priority outcome areas within the realm of economic impacts that we intend to use Codex to study: Productivity, Employment, Skill Development, Inter-firm Competition, Consumer Prices, and Economic Inequality. For each area, we briefly discuss previous literature on the impacts of artificial intelligence on each of these outcomes, describe questions that we believe to be key inputs to the three decision-making areas mentioned above, and provide examples of research that could be conducted with Codex. To catalyze work that builds off of this initial research agenda, we are announcing a Call for Expressions of Interest from external researchers to collaborate with OpenAI researchers and customers to better measure the economic impacts of code generation models and other LLMs.



Source link

Previous Post

Trusted Data: Alchemy For Misinformation

Next Post

Apache Flink 1.17 Update Drives Streaming Data Warehouses

Next Post

Apache Flink 1.17 Update Drives Streaming Data Warehouses

Recommended

Discover the Secret to Building Effective ML Teams

October 20, 2022

What Is Information Security & What Should Employees Know About It?

October 26, 2022

The Real Value of Data Observability

February 5, 2023

Don't miss it

News

Five AWS Predictions as re:Invent 2023 Kicks Off

December 1, 2023
News

Top 9 Mind Map Makers Online & Offline for Brainstorming

December 1, 2023
Big Data

Sam Altman returns as CEO, OpenAI has a new initial board

December 1, 2023
Big Data

Announcing General Availability of Model Registry

November 30, 2023
Big Data

Sophos Anticipates AI-Based Attack Techniques and Prepares Detections

November 30, 2023
Big Data

Automating Governance of PHI Data in Healthcare

November 30, 2023
big-data-footer-white

© Big Data News Hubb All rights reserved.

Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Privacy Policy and Terms & Conditions.

Navigate Site

  • Home
  • Big Data
  • News
  • Contact us

Newsletter Sign Up

No Result
View All Result
  • Home
  • Big Data
  • News
  • Contact us

© 2022 Big Data News Hubb All rights reserved.