Inspecting active requests

Most Arvados services publish a snapshot of HTTP requests currently being serviced at /_inspect/requests. This can be useful for troubleshooting slow requests and understanding high server load conditions.

To access snapshots, services must be configured with a management token. When accessing this endpoint, prefix the management token with "Bearer " and supply it in the Authorization request header.

In an interactive setting, use the jq tool to format the JSON response.

curl -sfH "Authorization: Bearer your_management_token_goes_here" "https://0.0.0.0:25107/_inspect/requests" | jq .
Component Provides /_inspect/requests endpoint
arvados-api-server
arvados-controller
arvados-dispatch-cloud
arvados-dispatch-lsf
arvados-git-httpd
arvados-ws
composer
keepproxy
keepstore
keep-balance
keep-web
workbench1
workbench2

Report fields

Most fields are self explanatory.

The Host field reports the virtual host specified in the incoming HTTP request.

The RemoteAddr field reports the source of the incoming TCP connection, which is typically a local address associated with the Nginx proxy service.

The Elapsed field reports the number of seconds since the incoming HTTP request headers were received.

Example response

[
  {
    "RequestID": "req-1vzzj6nwrki0rd2hj08a",
    "Method": "GET",
    "Host": "tordo.arvadosapi.com",
    "URL": "/arvados/v1/groups?order=name+asc&filters=[[%22owner_uuid%22,%22%3D%22,%22zzzzz-tpzed-aaaaaaaaaaaaaaa%22],[%22group_class%22,%22in%22,[%22project%22,%22filter%22]]]",
    "RemoteAddr": "127.0.0.1:55822",
    "Elapsed": 0.006363228
  },
  {
    "RequestID": "req-1wrof2b2wlj5s1rao4u3",
    "Method": "GET",
    "Host": "tordo.arvadosapi.com",
    "URL": "/arvados/v1/users/current",
    "RemoteAddr": "127.0.0.1:55814",
    "Elapsed": 0.04796585
  }
]

Previous: Health checks Next: Diagnostics

The content of this documentation is licensed under the Creative Commons Attribution-Share Alike 3.0 United States licence.
Code samples in this documentation are licensed under the Apache License, Version 2.0.