21st Century Artificial Intelligence Computing & Technology

Artificial Intelligence: A Short History of Thinking Machines

Artificial Intelligence: A Short History of Thinking Machines
History storyLong read · 10 min · interactive

Artificial intelligence has been “ten years away” for about seventy years, and then, quite suddenly, it was in everyone’s pocket. This guide tells the real story: the question Alan Turing asked, the summer workshop that named the field, the booms and the winters, the machines that beat world champions, and the simple learning loop that sits at the heart of today’s systems. You can even train a tiny neuron yourself on this page.

1950Turing asks if machines can think
1956the term AI is coined at Dartmouth
1997Deep Blue beats Kasparov
2017the transformer architecture is published
Quick facts
Term coined1956, Dartmouth workshop (John McCarthy and colleagues)
Founding questionAlan Turing, 1950: “Can machines think”
Two long “winters”Mid-1970s and late 1980s to early 1990s
Modern turning pointsDeep learning (2012), transformers (2017), public chatbots (2022)
Core idea todayLearn patterns from data instead of writing every rule by hand
Reading time10 min read
A short note
AI is changing fast. This guide focuses on the history and the core ideas, which stay stable. For the newest products and rules, check recent news and official sources.
In this guide

    The question: can machines think

    Modern AI starts with a question. In 1950 the British mathematician Alan Turing published a paper, “Computing Machinery and Intelligence”, that opened with: can machines think? Because “think” is hard to define, he proposed a game. A human judge chats by text with two hidden partners, one human and one machine. If the judge cannot reliably tell which is which, the machine has passed what we now call the Turing test.

    Turing’s real point was not the test itself but a way of making the question concrete: look at behaviour, not at philosophy. He also predicted machines that could learn from experience, which was remarkably far-sighted for 1950.

    1956: a summer workshop names the field

    In the summer of 1956 a small group gathered at Dartmouth College in New Hampshire for a workshop proposed by John McCarthy, Marvin Minsky, Nathaniel Rochester and Claude Shannon. McCarthy coined the term “artificial intelligence” for the proposal. Their optimism was breathtaking: they thought a summer of work might make significant progress on getting machines to use language, form concepts and improve themselves.

    Progress was slower than hoped, but the first programs were exciting. Some proved mathematical theorems, some played checkers and learned from their mistakes, and in 1966 Joseph Weizenbaum’s ELIZA imitated a psychotherapist by turning the user’s words into questions. Users were often convinced it understood them, though it did only simple text matching.

    Try it: train a tiny neuron

    In 1958 Frank Rosenblatt built the perceptron, a simple model of a neuron that learns from examples. It multiplies each input by a weight, adds a bias, and fires if the total is above zero. When it gets an example wrong, it nudges the weights toward the right answer. Pick a task and press “Train one epoch” to watch it learn. An epoch is one pass through all four examples.

    Interactive: a perceptron

    AND and OR can be learned: the perceptron quickly finds weights that give every answer correctly. XOR cannot. In 1969 Marvin Minsky and Seymour Papert showed in their book Perceptrons that a single layer of neurons cannot learn functions like XOR, where the right answer is not separable by a straight line. That result helped cool enthusiasm for neural networks for years. The fix, layers of neurons trained together, was known by the 1980s but needed much more data and computing power to shine.

    The perceptron in Python

    data = [((0, 0), 0), ((0, 1), 0), ((1, 0), 0), ((1, 1), 1)]   # the AND function
    w1 = w2 = b = 0.0
    lr = 0.1
    
    for epoch in range(1, 11):
        errors = 0
        for (x1, x2), target in data:
            out = 1 if w1 * x1 + w2 * x2 + b > 0 else 0
            err = target - out
            if err:
                w1 += lr * err * x1
                w2 += lr * err * x2
                b += lr * err
                errors += 1
        print(f"epoch {epoch}: errors={errors}  w1={w1:.1f} w2={w2:.1f} b={b:.1f}")
        if errors == 0:
            break

    Output:

    epoch 1: errors=1  w1=0.1 w2=0.1 b=0.1
    epoch 2: errors=3  w1=0.2 w2=0.1 b=0.0
    epoch 3: errors=3  w1=0.2 w2=0.1 b=-0.1
    epoch 4: errors=2  w1=0.2 w2=0.2 b=-0.1
    epoch 5: errors=1  w1=0.2 w2=0.1 b=-0.2
    epoch 6: errors=0  w1=0.2 w2=0.1 b=-0.2

    After six passes there are no mistakes. This is the same loop used inside the biggest systems today, just with billions of weights instead of three.

    Boom, bust and the “winters”

    Early AI promised more than it could deliver. Computers of the 1960s and 1970s had tiny memories and slow processors, and problems that looked easy, such as understanding a photograph or a spoken sentence, turned out to be monstrous. A critical British report in 1973 led to funding cuts, and the field entered its first “AI winter” in the mid-1970s.

    In the 1980s, expert systems revived interest. These programs stored the rules of specialists, such as how to diagnose a disease or configure computers, and companies spent heavily on them. But they were costly to maintain and brittle when faced with new situations. When the market for specialised AI hardware collapsed, a second winter followed in the late 1980s and early 1990s.

    Machines that beat champions

    AI milestones

    1950: Turing’s paper

    Poses the question “can machines think” and proposes the imitation game.

    1956: Dartmouth workshop

    The field gets its name, artificial intelligence.

    1958: The perceptron

    Frank Rosenblatt builds a learning neuron.

    1966: ELIZA

    Weizenbaum’s chatbot imitates a therapist with simple rules.

    1997: Deep Blue

    IBM’s chess computer defeats world champion Garry Kasparov.

    2011: Watson

    IBM’s system wins the quiz show Jeopardy.

    2012: AlexNet

    A deep neural network wins the ImageNet image recognition contest by a wide margin.

    2016: AlphaGo

    DeepMind’s program beats Go champion Lee Sedol.

    2017: Transformers

    Google researchers publish “Attention Is All You Need”, introducing the transformer architecture.

    2022: Public chatbots

    Large language model chatbots reach millions of people within weeks.

    2024: Nobel Prizes

    Awards in physics (Hopfield and Hinton) and chemistry (including the AlphaFold team) recognise AI work.

    Chess fell first. In May 1997 IBM’s Deep Blue beat the reigning world champion Garry Kasparov in a six-game match. Deep Blue relied on huge numbers of calculations and chess knowledge written by humans. Go, a far larger game, was thought to be out of reach until 2016, when DeepMind’s AlphaGo beat Lee Sedol 4 to 1. AlphaGo combined neural networks with search and learned from both human games and self-play.

    How modern AI learns

    The learning loop

    Gather data

    Thousands to billions of examples: photos with labels, sentences, game positions.

    Make a prediction

    A model, which is a large set of numbers called weights, turns an input into an output.

    Measure the error

    A loss function scores how wrong the prediction was compared with the right answer.

    Adjust the weights

    An algorithm called gradient descent nudges each weight in the direction that reduces the error.

    Repeat at scale

    The loop runs millions or billions of times on powerful chips until the model performs well on examples it has not seen.

    Three ingredients lined up around 2012. First, huge labelled datasets such as ImageNet. Second, graphics processors (GPUs) that could do the vast number of calculations needed. Third, improved training methods. The result was deep learning, networks with many layers. It transformed image recognition, speech recognition and translation. In 2017 the transformer design made it practical to train very large language models on text, and by 2022 chatbots built on them were used by many millions of people. Chips made of billions of transistors power all of it.

    Limits worth knowing
    Language models predict likely text. They can be wrong while sounding confident, they can reflect biases in their training data, and they do not understand things the way a person does. Good practice is to check important facts against reliable sources.

    AI in India

    Indian-born researchers have shaped the field. Raj Reddy, born in India and working in the United States, shared the 1994 Turing Award, computing’s highest honour, for work on large-scale AI systems. Today India has a huge pool of software engineers and a special challenge and opportunity: 22 scheduled languages and hundreds of dialects.

    The government’s IndiaAI Mission, approved in March 2024, aims to build computing capacity and datasets for AI in the country. A related public effort, Bhashini, works on translation and speech technology for Indian languages. Examples in everyday life include voice assistants that understand Hindi and other languages, crop advice for farmers, and tools that help read and translate government documents.

    Mind map: AI at a glance

    Artificial intelligence
    • Artificial intelligence: Machines that learn patterns instead of following fixed rules.
      • Foundations: 1940s to 1950s.
        • Turing, 1950: Asks “Can machines think”, proposes the imitation game.
        • Dartmouth, 1956: The term “artificial intelligence” is coined.
        • Perceptron, 1958: A simple learning neuron.
      • Ups and downs: Hype, then winters.
        • ELIZA, 1966: A chatbot that fakes understanding.
        • First AI winter: Funding cuts in the mid-1970s.
        • Expert systems: Rule-based programs of the 1980s.
        • Second winter: Late 1980s and early 1990s.
      • Game players: Machines beat champions.
        • Deep Blue, 1997: Beats Kasparov at chess.
        • Watson, 2011: Wins at Jeopardy.
        • AlphaGo, 2016: Beats Lee Sedol at Go.
      • Deep learning: 2012 onwards.
        • AlexNet, 2012: Image recognition leap.
        • Transformers, 2017: The architecture behind modern language models.
        • Chatbots, 2022: Language models reach the public.
        • AlphaFold: Predicts protein shapes.
      • How it learns: The core loop.
        • Data: Examples to learn from.
        • Model: Numbers (weights) that make predictions.
        • Loss: Measures how wrong it is.
        • Gradient descent: Adjusts weights to reduce error.
      • India: Language and public services.
        • Raj Reddy: Turing Award, 1994.
        • IndiaAI Mission: National compute and data effort.
        • Bhashini: Translation across Indian languages.
    Click a branch to open it. Drag to move the map. Use Ctrl and the mouse wheel, or the + and minus buttons, to zoom.

    Common myths

    • Myth: AI appeared suddenly in 2022. The field is about seventy years old; 2022 was when chatbots reached the public.
    • Myth: AI understands like a human. Current systems find patterns in data; whether that amounts to understanding is debated.
    • Myth: Passing the Turing test means a machine is conscious. The test measures behaviour only.
    • Myth: AI is one technology. It is a family: rule-based programs, search, statistics and neural networks.

    Key takeaways

    • AI began with a question from Turing in 1950 and a name from Dartmouth in 1956.
    • Progress came in waves, with winters when promises outran technology.
    • Modern AI learns from data by repeating a simple loop: predict, measure error, adjust.
    • Data, powerful chips and better methods came together around 2012, and chatbots reached the public in 2022.
    Test yourself

    Frequently asked questions

    Is AI the same as machine learning?

    Machine learning is the most successful branch of AI today: programs that learn from data. AI also includes other approaches such as search and rule-based systems.

    What is a neural network?

    A computer model made of layers of simple units, loosely inspired by neurons, whose connection strengths are adjusted during training.

    What is a large language model?

    A neural network trained on huge amounts of text to predict the next word, which lets it write, summarise and answer questions.

    Will AI take my job?

    It will change many jobs, automating some tasks and creating others. Learning to work with AI tools is a sensible response.

    Sources

    Featured image: Image: Elliott & Fry, via Wikimedia Commons, Public domain. Dates are as commonly reported.

    1 Comment

    Leave a Reply

    Your email address will not be published. Required fields are marked *