跳转到主要内容
通常,直接从浏览器在页面加载期间发出的一个或多个 Fetch 或 XHR 请求中提取必要的数据,比解析 HTML 内容更高效。因此,网页抓取 API 支持检索 XHR 请求列表。

如何获取 XHR 请求列表

要在响应中获取 XHR 请求列表,您需要添加值为 truexhr 参数,例如:
# update 'TOKEN VALUE' with your authorization token
curl --request 'POST' \
        --url 'https://scraper-api.decodo.com/v2/scrape' \
        --header 'Accept: application/json' \
        --header 'Authorization: Basic TOKEN VALUE' \
        --header 'Content-Type: application/json' \
        --data '
    {
      "url": "https://dummyjson.com/",
      "headless": "html",
      "xhr": true
    }
'
您将收到一个包含 JSON 对象列表的响应,其中每个对象对应一个单独的 XHR 请求。可以接收多类型响应;更多信息可以在这里找到。

输出

描述
urlXHR 请求的 URL
status_codeHTTP 响应返回的状态码
method请求的 HTTP 方法(例如 GET、POST)
request_headers请求头的键值对集合,包含 cookies
request_payload有效负载内容:此键仅出现在 POST、PUT 和 PATCH 请求中
response_headers响应头的键值对集合,包含 cookies
response_bodyHTTP 响应正文中返回的内容

响应示例

{
  "results": [
      {
          "content": [
              {
                  "url": "https://dummyjson.com/cdn-cgi/rum?",
                  "method": "POST",
                  "status_code": 204,
                  "response_body": "",
                  "request_headers": {
                      "accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7",
                      "origin": "https://dummyjson.com",
                      "referer": "https://www.yahoo.com/",
                      "sec-gpc": "1",
                      "sec-ch-ua": "\"Chromium\";v=\"119\", \"Not)A;Brand\";v=\"24\", \"Opera\";v=\"105\"",
                      "user-agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0.6045.193 Safari/537.36 OPR/105.0.4970.29",
                      "content-type": "application/json",
                      "sec-fetch-dest": "document",
                      "sec-fetch-mode": "navigate",
                      "sec-fetch-site": "same-origin",
                      "sec-fetch-user": "?1",
                      "accept-encoding": "gzip, deflate, br",
                      "accept-language": "en-US,en;q=0.8",
                      "sec-ch-ua-mobile": "?0",
                      "sec-ch-ua-platform": "\"Linux\"",
                      "upgrade-insecure-requests": "1"
                  },
                  "request_payload": "{\"memory\":{\"totalJSHeapSize\":3750592,\"usedJSHeapSize\":2468952,\"jsHeapSizeLimit\":4294705152},\"resources\":[],\"referrer\":\"\",\"eventType\":1,\"firstPaint\":0,\"firstContentfulPaint\":0,\"startTime\":1755774141001.2,\"versions\":{\"fl\":\"2024.11.0\",\"js\":\"2024.6.1\",\"timings\":2},\"pageloadId\":\"968fbcee-484b-4e53-b4ff-97c0058ba179\",\"location\":\"https://dummyjson.com/\",\"nt\":\"navigate\",\"timingsV2\":{\"unloadEventStart\":0,\"unloadEventEnd\":0,\"domInteractive\":1427.800000011921,\"domContentLoadedEventStart\":2259.9000000059605,\"domContentLoadedEventEnd\":2259.9000000059605,\"domComplete\":2269.5,\"loadEventStart\":2269.5,\"loadEventEnd\":2269.5,\"type\":\"navigate\",\"redirectCount\":0,\"criticalCHRestart\":0,\"activationStart\":0,\"initiatorType\":\"navigation\",\"nextHopProtocol\":\"h2\",\"deliveryType\":\"\",\"workerStart\":0,\"redirectStart\":0,\"redirectEnd\":0,\"fetchStart\":1,\"domainLookupStart\":1,\"domainLookupEnd\":1,\"connectStart\":56.20000001788139,\"connectEnd\":595.3000000119209,\"secureConnectionStart\":457.30000001192093,\"requestStart\":595.4000000059605,\"responseStart\":738,\"responseEnd\":738.9000000059605,\"transferSize\":5175,\"encodedBodySize\":4875,\"decodedBodySize\":24758,\"responseStatus\":200,\"firstInterimResponseStart\":0,\"renderBlockingStatus\":\"non-blocking\",\"finalResponseHeadersStart\":738,\"name\":\"https://dummyjson.com/\",\"entryType\":\"navigation\",\"startTime\":0,\"duration\":2269.5},\"dt\":\"\",\"siteToken\":\"a67792548ccc48faac5fa0d91120d5e7\",\"st\":2}",
                  "response_headers": {
                      "nel": "{\"report_to\":\"cf-nel\",\"success_fraction\":0.0,\"max_age\":604800}",
                      "date": "Thu, 21 Aug 2025 11:02:23 GMT",
                      "vary": "Origin, accept-encoding",
                      "cf-ray": "9729a34c9e38f032-DFW",
                      "server": "cloudflare",
                      "alt-svc": "h3=\":443\"; ma=86400",
                      "report-to": "{\"group\":\"cf-nel\",\"max_age\":604800,\"endpoints\":[{\"url\":\"https://a.nel.cloudflare.com/report/v4?s=1sDYaS2C%2F52rYP10Hp1fu0zokI2eEK0oBZnbM7fLRdM4rxEiqYBMM3vq6yK9wWJkNPj4lmML6rsK9f7eCD%2FA5BPIvQxnJJBjyWbdavc%3D\"}]}",
                      "content-type": "text/plain",
                      "server-timing": "cfEdge;dur=3,cfOrigin;dur=0",
                      "access-control-max-age": "86400",
                      "access-control-allow-origin": "https://dummyjson.com",
                      "access-control-allow-methods": "POST,OPTIONS",
                      "access-control-allow-credentials": "true"
                  }
              }
          ],
          "headers": {
              "age": "40350",
              "nel": "{\"report_to\":\"cf-nel\",\"success_fraction\":0.0,\"max_age\":604800}",
              "date": "Thu, 21 Aug 2025 11:02:21 GMT",
              "vary": "Accept-Encoding",
              "cf-ray": "9729a3416da3f032-DFW",
              "server": "cloudflare",
              "alt-svc": "h3=\":443\"; ma=86400",
              "report-to": "{\"group\":\"cf-nel\",\"max_age\":604800,\"endpoints\":[{\"url\":\"https://a.nel.cloudflare.com/report/v4?s=nyhZyWx2mEa9rX30X9iPrHhcsiowOcG89XIWtH7in5vmJKmf3H3LGlmjowKxk2qRcaaiDO2ODdqj6x2zRPJXHCJ4hUyhki1NAxXf7aA%3D\"}]}",
              "content-type": "text/html; charset=utf-8",
              "x-powered-by": "Cats on Keyboards",
              "cache-control": "no-store",
              "server-timing": "cfCacheStatus;desc=\"HIT\", cfEdge;dur=11,cfOrigin;dur=0",
              "x-railway-edge": "railway/us-east4-eqdc4a",
              "cf-cache-status": "HIT",
              "x-frame-options": "SAMEORIGIN",
              "content-encoding": "br",
              "x-xss-protection": "1; mode=block",
              "x-ratelimit-limit": "100",
              "x-ratelimit-reset": "1755612661",
              "x-download-options": "noopen",
              "x-railway-request-id": "HnoVBL2CSRWSyS9Vg4a9AQ",
              "x-ratelimit-remaining": "99",
              "x-content-type-options": "nosniff",
              "x-dns-prefetch-control": "off",
              "strict-transport-security": "max-age=15552000; includeSubDomains",
              "access-control-allow-origin": "*"
          },
          "cookies": [],
          "status_code": 200,
          "task_id": "7364250500075630593",
          "created_at": "2025-08-21 11:02:20",
          "updated_at": "2025-08-21 11:02:35"
      }
  ]
}
并非所有目标模板都支持 xhr 输出。请查看各个模板文档以了解兼容性。

支持

需要帮助或只是想打个招呼?我们的支持团队全天候为您服务。
您也可以随时通过电子邮件 support@decodo.com 联系我们。

反馈

找不到您要找的内容?请求一篇文章!
有反馈意见?分享您对我们如何改进的想法。