AI Overview

Web Scraping API AI Overview loading with google_search Target

The google_search target is built to obtain AI Overviews in search results. More information about the target can be found here.

AI Overview Rate Optimization

For the best chance of receiving a fully loaded and parsed AI-generated answer, please follow these guidelines:

  • Turn on JavaScript rendering by adding "headless": "html" parameter
  • Set device_type to one of the following: desktop_chrome, mobile_android, mobile_ios

Request example

curl --request 'POST' \
        --url 'https://scraper-api.decodo.com/v2/task' \
        --header 'Accept: application/json' \
        --header 'Authorization: Basic Auth.token' \ // update with your authorization token
        --header 'Content-Type: application/json' \
        --data '
	{
    "target": "google_search",
  	"query": "How to improve sleep quality?",
  	"user_agent_type": "dekstop_chrome",
  	"headless": "html",
  	"parse": true
	}
'

Output

Descriptions for fields in the parsed JSON results.ai_overview section are provided in the table below. Results may differ depending on search query provided in request.

AI Overview KeyDescription
answer_textBasic details related to the Google Search query.
bullet_listShows information about items presented in a bulleted list within the AI Overview section of search results.
productsA list of products along with their corresponding details.
source_panelA list of sources referenced to generate the AI Overview result.
additional_questionsAdditional questions along with their respective details.
recipesRecipes and their respective details presented in a list.
info_listList of details most often used to illustrate process steps connected to the search query.
pos_overallIndicates the position of the AI Overview SERP feature within all Google search results.

Example Output

...
{
  "ai_overviews": [
    {
      "answer_text": [
        {
          "pos": 1,
          "text": [
            "To improve sleep quality, focus on establishing healthy sleep habits, also known as sleep hygiene.",
            "This includes creating a relaxing bedtime routine, optimizing your sleep environment, and making lifestyle adjustments like limiting caffeine and alcohol before bed."
          ]
        },
        {
          "pos": 2,
          "text": [
            "Here's a more detailed breakdown:"
          ]
        }
      ],
      "bullet_list": [
        {
          "pos": 1,
          "points": [
            "Go to bed and wake up around the same time each day, even on weekends, to regulate your body's natural sleep-wake cycle.",
            "Aim for 7-9 hours of sleep per night."
          ],
          "list_title": "1. Establish a Regular Sleep Schedule:"
        }
      ],
      "pos_overall": 1,
      "source_panel": {
        "items": [
          {
            "pos": 1,
            "url": "https://www.healthline.com/nutrition/17-tips-to-sleep-better",
            "title": "15 Proven Tips to Sleep Better at Night",
            "source": "Healthline",
            "description": "May 29, 2024"
          },
          {
            "pos": 2,
            "url": "https://www.sleepfoundation.org/sleep-hygiene/healthy-sleep-tips",
            "title": "The 20 Ultimate Tips for How to Sleep Better | Sleep Foundation",
            "source": "Sleep Foundation",
            "description": "Dec 8, 2023"
          },
          {
            "pos": 3,
            "url": "https://www.health.harvard.edu/newsletter_article/8-secrets-to-a-good-nights-sleep",
            "title": "8 secrets to a good night's sleep - Harvard Health",
            "source": "Harvard Health",
            "description": "Nov 20, 2023"
          }
        ]
      }
    }
  ]
}

...

Support

Still can't find an answer? Want to say hi? We take pride in our 24/7 customer support. Alternatively, you can reach us via our support email at [email protected].

Feedback

Something's missing? Request an article!
Got feedback? Let us know how we're doing and what can be improved.