CRYPTOREPORTCLUB
  • Crypto news
  • AI
  • Technologies
Monday, July 7, 2025
No Result
View All Result
CRYPTOREPORTCLUB
  • Crypto news
  • AI
  • Technologies
No Result
View All Result
CRYPTOREPORTCLUB

AI that mimics human problem solving is a big advance, but comes with new risks and problems

November 25, 2024
159
0

November 25, 2024

Editors' notes

Related Post

AI system brings new precision to basketball foul detection and analysis

AI system brings new precision to basketball foul detection and analysis

July 7, 2025
LLMs display different cultural tendencies when responding to queries in English and Chinese, study finds

LLMs display different cultural tendencies when responding to queries in English and Chinese, study finds

July 7, 2025

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

fact-checked

trusted source

written by researcher(s)

proofread

AI that mimics human problem solving is a big advance, but comes with new risks and problems

ai
Credit: CC0 Public Domain

OpenAI recently unveiled its latest artificial intelligence (AI) models, o1-preview and o1-mini (also referred to as "Strawberry"), claiming a significant leap in the reasoning capabilities of large language models (the technology behind Strawberry and OpenAI's ChatGPT). While the release of Strawberry generated excitement, it also raised critical questions about its novelty, efficacy and potential risks.

Central to this is the model's ability to employ "chain-of-thought reasoning"—a method similar to a human using a scratchpad, or notepad, to write down intermediate steps when solving a problem.

Chain-of-thought reasoning mirrors human problem solving by breaking down complex tasks into simpler, manageable sub-tasks. The use of scratchpad-like reasoning in large language models is not a new idea.

The ability to perform chain-of-thought reasoning by AI systems not specifically trained to do so was first observed in 2022 by several research groups. These included Jason Wei and colleagues from Google Research and Takeshi Kojima and colleagues from the University of Tokyo and Google.

Before these works, other researchers such as Oana Camburu from the University of Oxford and her colleagues investigated the idea of teaching models to generate text-based explanations for their outputs. This is where the model describes the reasoning steps that it went through in order to produce a particular prediction.

Even earlier than this, researchers including Jacob Andreas from the Massachusetts Institute of Technology had explored the idea of language as a tool for deconstructing complex problems. This enabled models to break down complex tasks into sequential, interpretable steps. This approach aligns with the principles of chain-of-thought reasoning.

Strawberry's potential contribution to the field of AI could lie in scaling up these concepts.

A closer look

Although the exact method used by OpenAI for Strawberry is shrouded in mystery, many experts think that it uses a procedure known as "self-verification".

This procedure improves the AI system's own ability to perform chain-of-thought reasoning. Self-verification is inspired by how humans reflect and play out scenarios in their minds to make their reasoning and beliefs consistent.

Most recent AI systems based on large language models, such as Strawberry, are built in two stages. They first go through a process called "pre-training," where the system acquires its basic knowledge by running through a large general dataset of information.

They can then undergo fine-tuning, where they are taught to perform specific tasks better, typically by being provided with additional, more specialized data.

This additional data is often curated and "annotated" by humans. This is where a person provides the AI system with additional context to aid its understanding of the training data. However, Strawberry's self-verification approach is thought by some to be less data-hungry. Yet, there are indications that some of the o1 AI models were trained on extensive examples of chain-of-thought reasoning that have been annotated by experts.

This raises questions about the extent to which self-improvement, rather than expert-guided training, contributes to its capabilities. In addition, while the model may excel in certain areas, its reasoning proficiency does not surpass basic human competence in others. For example, versions of Strawberry still struggle with some mathematical reasoning problems that a capable 12-year-old can solve.

Risks and opacity

One primary concern with Strawberry is the lack of transparency surrounding the self-verification process and how it works. The reflection that the model performs upon its reasoning is not available to be examined, depriving users of insights into the system's functioning.

The "knowledge" relied upon by the AI system to answer a given query is not available for inspection either. This means there is no way to edit or specify the set of facts, assumptions, and deduction techniques to be used.

Consequently, the system may produce answers that appear to be correct, and reasoning that appears sound, when in fact they are fundamentally flawed, potentially leading to misinformation.

Finally, OpenAI has built in protections to prevent undesirable uses of o1. But a recent report by OpenAI, which evaluates the system's performance, did uncover some risks. Some researchers we have spoken to have shared their concerns, particularly regarding the potential for misuse by cyber-criminals.

The model's ability to intentionally mislead or produce deceptive outputs—outlined in the report—adds another layer of risk, emphasizing the need for stringent safeguards.

Provided by The Conversation

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Citation: AI that mimics human problem solving is a big advance, but comes with new risks and problems (2024, November 25) retrieved 25 November 2024 from https://techxplore.com/news/2024-11-ai-mimics-human-problem-big.html This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

AI researcher discusses the new version of ChatGPT's advances in math and reasoning shares

Feedback to editors

Share212Tweet133ShareShare27ShareSend

Related Posts

AI system brings new precision to basketball foul detection and analysis
AI

AI system brings new precision to basketball foul detection and analysis

July 7, 2025
0

July 7, 2025 The GIST AI system brings new precision to basketball foul detection and analysis Lisa Lock scientific editor Robert Egan associate editor Editors' notes This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:...

Read moreDetails
LLMs display different cultural tendencies when responding to queries in English and Chinese, study finds

LLMs display different cultural tendencies when responding to queries in English and Chinese, study finds

July 7, 2025
Approach improves how new skills are taught to large language models

Approach improves how new skills are taught to large language models

July 7, 2025
From position to meaning: How AI learns to read

From position to meaning: How AI learns to read

July 7, 2025
AI robots fill in for weed killers and farm hands

AI robots fill in for weed killers and farm hands

July 6, 2025
Chatbots are on the rise, but customers still trust human agents more

Chatbots are on the rise, but customers still trust human agents more

July 5, 2025
AI designs new underwater gliders with shapes inspired by marine animals

AI designs new underwater gliders with shapes inspired by marine animals

July 4, 2025

Recent News

Jack Dorsey just released a Bluetooth messaging app that doesn’t need the internet

Jack Dorsey just released a Bluetooth messaging app that doesn’t need the internet

July 7, 2025
AI system brings new precision to basketball foul detection and analysis

AI system brings new precision to basketball foul detection and analysis

July 7, 2025
Arkane founder calls Game Pass an ‘unsustainable model’ that’s wrecking the industry

Arkane founder calls Game Pass an ‘unsustainable model’ that’s wrecking the industry

July 7, 2025
Prime Day deal: Get $100 off the Apple Watch Series 10

Prime Day deal: Get $100 off the Apple Watch Series 10

July 7, 2025

TOP News

  • Top 5 Tokenized Real Estate Platforms Transforming Property Investment

    Top 5 Tokenized Real Estate Platforms Transforming Property Investment

    536 shares
    Share 214 Tweet 134
  • AI-driven personalized pricing may not help consumers

    535 shares
    Share 214 Tweet 134
  • Our favorite power bank for iPhones is 20 percent off right now

    535 shares
    Share 214 Tweet 134
  • God help us, Donald Trump plans to sell a phone

    536 shares
    Share 214 Tweet 134
  • Investment Giant 21Shares Announces New Five Altcoins Including Avalanche (AVAX)!

    535 shares
    Share 214 Tweet 134
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms of Use
Advertising: digestmediaholding@gmail.com

Disclaimer: Information found on cryptoreportclub.com is those of writers quoted. It does not represent the opinions of cryptoreportclub.com on whether to sell, buy or hold any investments. You are advised to conduct your own research before making any investment decisions. Use provided information at your own risk.
cryptoreportclub.com covers fintech, blockchain and Bitcoin bringing you the latest crypto news and analyses on the future of money.

© 2023-2025 Cryptoreportclub. All Rights Reserved

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Crypto news
  • AI
  • Technologies

Disclaimer: Information found on cryptoreportclub.com is those of writers quoted. It does not represent the opinions of cryptoreportclub.com on whether to sell, buy or hold any investments. You are advised to conduct your own research before making any investment decisions. Use provided information at your own risk.
cryptoreportclub.com covers fintech, blockchain and Bitcoin bringing you the latest crypto news and analyses on the future of money.

© 2023-2025 Cryptoreportclub. All Rights Reserved