How to Scrape Yahoo Finance Stock Pricing Data (+ No code)

Introduction

Yahoo Finance (finance.yahoo.com) is a media property that is part of the Yahoo! network.
It provides financial news, data, and commentary including stock quotes, press releases, financial reports, and original content.

In this article you will read about the easiest way to scrape stock prices and price changes from Yahoo Finance with Page2API.

You will find code examples for Ruby, Python, PHP, NodeJS, cURL, and a No-Code solution that will import stock pricing data into Google Sheets.

Prerequisites

To start scraping stock prices, we will need the following things:

A Page2API account
A stock name (or a list of stocks) that we are interested in.
In our case, the stocks that we are interested in are Alphabet Inc. (GOOG), Amazon.com, Inc. (AMZN), Apple Inc. (AAPL), and Tesla, Inc. (TSLA).

How to scrape Yahoo Finance Stock Prices

First what we need is to open the URL for a stock price, ex: Apple Inc. (AAPL).

For this stock, the URL will be:

  
    https://finance.yahoo.com/quote/AAPL

We will use this URL as the first parameter we need to start the scraping process.

The page that you see must look like the following one:

If you inspect the page HTML, you will find out that it looks like this:

From the Yahoo Finance Stock Price page, we will scrape the following attributes:

Name
Price
Change
Change Percent

Now, let's define the selectors for each attribute.

  
    /* Parent: */ (We will use it to scrape multiple stocks at once)
    #quote-header-info

    /* Name */
    #quote-header-info h1

    /* Price */
    #quote-header-info [data-field='regularMarketPrice']

    /* Change */
    #quote-header-info [data-field='regularMarketChange']

    /* Change Percent */
    #quote-header-info [data-field='regularMarketChangePercent']

Now it's time to build the request that will scrape the stock prices.

The following examples will show how to scrape the data for a single stock: Apple Inc. (AAPL)

  
    {
      "api_key": "YOUR_PAGE2API_KEY",
      "url": "https://finance.yahoo.com/quote/AAPL",
      "parse": {
        "name": "#quote-header-info h1 >> text",
        "price": "#quote-header-info [data-field=regularMarketPrice] >> text",
        "change": "#quote-header-info [data-field=regularMarketChange] >> text",
        "change_percent": "#quote-header-info [data-field=regularMarketChangePercent] >> text"
      }
    }

Code examples (single stock)

      
    require 'rest_client'
    require 'json'

    api_url = 'https://www.page2api.com/api/v1/scrape'
    payload = {
      api_key: 'YOUR_PAGE2API_KEY',
      url: 'https://finance.yahoo.com/quote/AAPL',
      parse: {
        name: '#quote-header-info h1 >> text',
        price: '#quote-header-info [data-field=regularMarketPrice] >> text',
        change: '#quote-header-info [data-field=regularMarketChange] >> text',
        change_percent: '#quote-header-info [data-field=regularMarketChangePercent] >> text'
      }
    }

    response = RestClient::Request.execute(
      method: :post,
      payload: payload.to_json,
      url: api_url,
      headers: { "Content-type" => "application/json" },
    ).body

    result = JSON.parse(response)

    puts(result)

      
    import requests
    import json

    api_url = 'https://www.page2api.com/api/v1/scrape'
    payload = {
      "api_key": "YOUR_PAGE2API_KEY",
      "url": "https://finance.yahoo.com/quote/AAPL",
      "parse": {
        "name": "#quote-header-info h1 >> text",
        "price": "#quote-header-info [data-field=regularMarketPrice] >> text",
        "change": "#quote-header-info [data-field=regularMarketChange] >> text",
        "change_percent": "#quote-header-info [data-field=regularMarketChangePercent] >> text"
      }
    }

    headers = {'Content-type': 'application/json', 'Accept': 'text/plain'}
    response = requests.post(api_url, data=json.dumps(payload), headers=headers)
    result = json.loads(response.text)

    print(result)

      
    <?php

    $api_url = 'https://www.page2api.com/api/v1/scrape';
    $payload = [
      'api_key' => 'YOUR_PAGE2API_KEY',
      'url' => 'https://finance.yahoo.com/quote/AAPL',
      'parse' => [
        'name' => '#quote-header-info h1 >> text',
        'price' => '#quote-header-info [data-field=regularMarketPrice] >> text',
        'change' => '#quote-header-info [data-field=regularMarketChange] >> text',
        'change_percent' => '#quote-header-info [data-field=regularMarketChangePercent] >> text'
      ]
    ];

    $postdata = json_encode($payload);
    $ch = curl_init($api_url);
    curl_setopt($ch,CURLOPT_POST, true);
    curl_setopt($ch,CURLOPT_POSTFIELDS, $postdata);
    curl_setopt($ch, CURLOPT_HTTPHEADER, array('Content-Type:application/json'));
    curl_setopt($ch,CURLOPT_RETURNTRANSFER, true);
    $result = curl_exec($ch);
    curl_close($ch);

    echo $result;

    ?>

      
    const axios = require('axios');
    const api_url = 'https://www.page2api.com/api/v1/scrape';
    const payload = {
      api_key: 'YOUR_PAGE2API_KEY',
      url: 'https://finance.yahoo.com/quote/AAPL',
      parse: {
        name: '#quote-header-info h1 >> text',
        price: '#quote-header-info [data-field=regularMarketPrice] >> text',
        change: '#quote-header-info [data-field=regularMarketChange] >> text',
        change_percent: '#quote-header-info [data-field=regularMarketChangePercent] >> text'
      }
    };

    axios.post(api_url, payload)
      .then((res) => {
        console.log(JSON.stringify(res.data, null, "  "));
      }).catch((err) => {
         console.error(err);
      });

      
    curl -XPOST -H "Content-type: application/json" -d '{
      "api_key": "YOUR_PAGE2API_KEY",
      "url": "https://finance.yahoo.com/quote/AAPL",
      "parse": {
        "name": "#quote-header-info h1 >> text",
        "price": "#quote-header-info [data-field=regularMarketPrice] >> text",
        "change": "#quote-header-info [data-field=regularMarketChange] >> text",
        "change_percent": "#quote-header-info [data-field=regularMarketChangePercent] >> text"
      }
    }' 'https://www.page2api.com/api/v1/scrape' | python -mjson.tool

The result

  
    {
      "result": {
        "name": "Apple Inc. (AAPL)",
        "price": "149.64",
        "change": "+5.86",
        "change-percent": "(+4.08%)"
      }
    }

If we decide to go scrape multiple stocks at once, we will go with the batch scraping approach.

In this case, our payload will look like:

  
    {
      "api_key": "YOUR_PAGE2API_KEY",
      "batch": {
        "urls": [
          "https://finance.yahoo.com/quote/TSLA",
          "https://finance.yahoo.com/quote/AAPL",
          "https://finance.yahoo.com/quote/GOOG",
          "https://finance.yahoo.com/quote/AMZN"
        ],
        "concurrency": 1,
        "merge_results": true
      },
      "parse": {
        "stocks": [
          {
            "_parent": "#quote-header-info",
            "name": "h1 >> text",
            "price": "[data-field=regularMarketPrice] >> text",
            "change": "[data-field=regularMarketChange] >> text",
            "change_percent": "[data-field=regularMarketChangePercent] >> text"
          }
        ]
      }
    }

Code examples (multiple stocks)

      
    require 'rest_client'
    require 'json'

    api_url = 'https://www.page2api.com/api/v1/scrape'
    payload = {
      api_key: 'YOUR_PAGE2API_KEY',
      batch: {
        urls: [
          "https://finance.yahoo.com/quote/TSLA",
          "https://finance.yahoo.com/quote/AAPL",
          "https://finance.yahoo.com/quote/GOOG",
          "https://finance.yahoo.com/quote/AMZN"
        ],
        concurrency: 1,
        merge_results: true
      },
      parse: {
        stocks: [
          {
            _parent: "#quote-header-info",
            name: "h1 >> text",
            price: "[data-field=regularMarketPrice] >> text",
            change: "[data-field=regularMarketChange] >> text",
            change_percent: "[data-field=regularMarketChangePercent] >> text"
          }
        ]
      }
    }

    response = RestClient::Request.execute(
      method: :post,
      payload: payload.to_json,
      url: api_url,
      headers: { "Content-type" => "application/json" },
    ).body

    result = JSON.parse(response)

    puts(result)

      
    import requests
    import json

    api_url = 'https://www.page2api.com/api/v1/scrape'
    payload = {
      "api_key": "YOUR_PAGE2API_KEY",
      "batch": {
        "urls": [
          "https://finance.yahoo.com/quote/TSLA",
          "https://finance.yahoo.com/quote/AAPL",
          "https://finance.yahoo.com/quote/GOOG",
          "https://finance.yahoo.com/quote/AMZN"
        ],
        "concurrency": 1,
        "merge_results": True
      },
      "parse": {
        "stocks": [
          {
            "_parent": "#quote-header-info",
            "name": "h1 >> text",
            "price": "[data-field=regularMarketPrice] >> text",
            "change": "[data-field=regularMarketChange] >> text",
            "change_percent": "[data-field=regularMarketChangePercent] >> text"
          }
        ]
      }
    }

    headers = {'Content-type': 'application/json', 'Accept': 'text/plain'}
    response = requests.post(api_url, data=json.dumps(payload), headers=headers)
    result = json.loads(response.text)

    print(result)

      
    <?php

    $api_url = 'https://www.page2api.com/api/v1/scrape';
    $payload = [
      'api_key' => 'YOUR_PAGE2API_KEY',
      'batch' => [
        'urls' => [
          0 => 'https://finance.yahoo.com/quote/TSLA',
          1 => 'https://finance.yahoo.com/quote/AAPL',
          2 => 'https://finance.yahoo.com/quote/GOOG',
          3 => 'https://finance.yahoo.com/quote/AMZN'
        ],
        'concurrency' => 1,
        'merge_results' => true
      ],
      'parse' => [
        'stocks' => [
          0 => [
            '_parent' => '#quote-header-info',
            'name' => 'h1 >> text',
            'price' => '[data-field=regularMarketPrice] >> text',
            'change' => '[data-field=regularMarketChange] >> text',
            'change_percent' => '[data-field=regularMarketChangePercent] >> text'
          ]
        ]
      ]
    ];

    $postdata = json_encode($payload);
    $ch = curl_init($api_url);
    curl_setopt($ch,CURLOPT_POST, true);
    curl_setopt($ch,CURLOPT_POSTFIELDS, $postdata);
    curl_setopt($ch, CURLOPT_HTTPHEADER, array('Content-Type:application/json'));
    curl_setopt($ch,CURLOPT_RETURNTRANSFER, true);
    $result = curl_exec($ch);
    curl_close($ch);

    echo $result;

    ?>

      
    const axios = require('axios');
    const api_url = 'https://www.page2api.com/api/v1/scrape';
    const payload = {
      api_key: 'YOUR_PAGE2API_KEY',
      batch: {
        urls: [
          'https://finance.yahoo.com/quote/TSLA',
          'https://finance.yahoo.com/quote/AAPL',
          'https://finance.yahoo.com/quote/GOOG',
          'https://finance.yahoo.com/quote/AMZN'
        ],
        concurrency: 1,
        merge_results: true
      },
      parse: {
        stocks: [
          {
            _parent: '#quote-header-info',
            name: 'h1 >> text',
            price: '[data-field=regularMarketPrice] >> text',
            change: '[data-field=regularMarketChange] >> text',
            change_percent: '[data-field=regularMarketChangePercent] >> text'
          }
        ]
      }
    };

    axios.post(api_url, payload)
      .then((res) => {
        console.log(JSON.stringify(res.data, null, "  "));
      }).catch((err) => {
         console.error(err);
      });

      
    curl -XPOST -H "Content-type: application/json" -d '{
      "api_key": "YOUR_PAGE2API_KEY",
      "batch": {
        "urls": [
          "https://finance.yahoo.com/quote/TSLA",
          "https://finance.yahoo.com/quote/AAPL",
          "https://finance.yahoo.com/quote/GOOG",
          "https://finance.yahoo.com/quote/AMZN"
        ],
        "concurrency": 1,
        "merge_results": true
      },
      "parse": {
        "stocks": [
          {
            "_parent": "#quote-header-info",
            "name": "h1 >> text",
            "price": "[data-field=regularMarketPrice] >> text",
            "change": "[data-field=regularMarketChange] >> text",
            "change_percent": "[data-field=regularMarketChangePercent] >> text"
          }
        ]
      }
    }' 'https://www.page2api.com/api/v1/scrape' | python -mjson.tool

The result

  
    {
      "result": {
        "stocks": [
          {
            "name": "Tesla, Inc. (TSLA)",
            "price": "759.63",
            "change": "+51.90",
            "change-percent": "(+7.33%)"
          },
          {
            "name": "Apple Inc. (AAPL)",
            "price": "149.64",
            "change": "+5.86",
            "change-percent": "(+4.08%)"
          },
          {
            "name": "Alphabet Inc. (GOOG)",
            "price": "2,255.98",
            "change": "+90.06",
            "change-percent": "(+4.16%)"
          },
          {
            "name": "Amazon.com, Inc. (AMZN)",
            "price": "2,302.93",
            "change": "+81.38",
            "change-percent": "(+3.66%)"
          }
        ]
      }, ...
    }

How to export Yahoo Finance Stock Prices to Google Sheets

To export our Stock Prices to a Google Spreadsheet, we will need to slightly modify our request to receive the data in CSV format instead of JSON.

According to the documentation, we need to add the following parameters to our payload:

  
    "raw": {
      "key": "stocks", "format": "csv"
    }

Now our payload will look like this:

{ "api_key": "YOUR_PAGE2API_KEY", "raw": { "key": "stocks", "format": "csv" }, "batch": { "urls": [ "https://finance.yahoo.com/quote/TSLA", "https://finance.yahoo.com/quote/AAPL", "https://finance.yahoo.com/quote/GOOG", "https://finance.yahoo.com/quote/AMZN" ], "concurrency": 1, "merge_results": true }, "parse": { "stocks": [ { "_parent": "#quote-header-info", "name": "h1 >> text", "price": "[data-field=regularMarketPrice] >> text", "change": "[data-field=regularMarketChange] >> text", "change_percent": "[data-field=regularMarketChangePercent] >> text" } ] } }

Now, edit the payload above if needed, and press Encode →

Encode

The URL with encoded payload will be:

  Press 'Encode'

Note: If you are reading this article being logged in - you can copy the link above since it will already have your api_key in the encoded payload.

The final part is adding the IMPORTDATA function, and we are ready to import our Stock Prices into a Google Spreadsheet.

  Press 'Encode'

The result must look like the following one:

Yahoo Finance Stock Prices import to Google Sheets

Conclusion

All done!

Monitoring this kind of financial data can be quite valuable, simply because it will help you make better investment decisions.

With Page2API, the API that helps you scrape any data with ease, this process will become easy and fun.

How to Scrape Yahoo Finance Stock Pricing Data (+ No code)

Introduction

Prerequisites

How to scrape Yahoo Finance Stock Prices

How to export Yahoo Finance Stock Prices to Google Sheets

Conclusion

You might also like:

How to Scrape Reddit Data: Posts, Images, Comments, and more.

How to Scrape Glassdoor Reviews (Code & No code)

How to Scrape Indeed Data: Jobs, Salaries (Code & No code)

Ready to Scrape the Web like a PRO?