Skip to main content

Home

BigQuery details page

From the BigQuery details page, you can get the processing details of all the queries running in your BigQuery projects. Moreover, you can also identify the utilization of resources based on each stage and the performance of a query.

Note

The statistics of the BigQuery details page are displayed when you run the query for the first time in the last 24 hours. However, the KPIs and metrics are not displayed for the second query run. This is because, for subsequent query execution, the query details are retrieved from the cache. To view the KPIs and metrics for each subsequent query run, go to the Applications page and click the BigQuery option in the Parent App column.

Menu bar

When you open a BigQuery details page, the following details are displayed on the upper section of the page:

menu-bar.png

Item No

Description

1

Name of the BigQuery. Click the download.png Download icon to download the BigQuery project as a JSON file. The JSON file includes all the details shown on the BigQuery details page UI in a raw format.

2

Name of the owner who has run the query.

3

Name of the Project where the query is run.

4

Type of the queue.

  • Interactive: For Interactive queues, the query jobs are run immediately after the query is executed. This is the default queue.

  • Batch: For Batch queues, the query jobs are run in batches during a scheduled time.

Note

Click the copy-icon.png Copy icon to copy the name, owner, project name, and queue name of the BigQuery for debugging.

KPIs
KPIs.png

Option

Description

Status

Displays the status (Success, Failed, or Running) of the query.

Duration

Total time of the query run.

Data I/O

Total data read and written by the query.

Start Time

Start time of the query run.

End Time

End time of the query run.

Query Output Row Count

Total number of rows that BigQuery has provided as an output.

Slot MS

Total time of the query run in the virtual CPU.

Billed Bytes

A number of bytes (data) on which BigQuery is charging the amount. BigQuery provides the initial 1GB of data free of cost.

Processed Bytes

The number of bytes the query has processed.

Cost in USD

The cost associated with the query. The cost is displayed in Cents. The cost is computed based on the BigQuery pricing for the billed bytes related to on-demand pricing.

Database

Name of the database where the query runs.

App Summary

The following tabs are displayed in the App Summary section:

AppSummary.png

Tab name

Description

Analysis

Query

Displays the query that was run.

Tables

Lists the names of the tables that were involved in the query run.

After you click the table name, the Data page is displayed (if the table information is recorded). If the table information is not recorded, a message is displayed.

Error View

Lists the errors for the failed queries.

From the Error View tab, you can do the following:

  • Search for a specific error.

  • Download error messages into a CSV file. You can send the file to the appropriate team for debugging.

Tags

Lists tags associated with BigQuery. For example, department, person name, location, and so on.

For more information, see Tagging.Tagging

For cached queries, the following labels are displayed in the App Summary section:

app-summary-cache.png
  • Cache: Indicates that the query result is retrieved from the BigQuery cache.

  • Original query: Click to go back to the original query. The original query is the first run of the selected cached query, and its result is cached in the last 24 hours.

  • Parent: Click to go back to the parent of the child query.

Stages

A query is executed in a series of stages. The details of each stage are shown on the BigQuery details page.

When a query is running, multiple stages are executed in parallel to increase time and efficiency. For example, INPUT, SORT, and JOIN. For example, a JOIN stage that generates far more output rows than input rows can indicate an opportunity to filter earlier in the query. These stages improve data distribution throughout query workers.

stages.png

To view the details of all the stages, click the expander-arrows.png expander arrows on the left panel of the BigQuery details page. In the Stages section, you can perform the following actions:

  • View timeline details along with the name and status of the stage. The timeline details include Start Time, Duration, and Slot MS.

  • Search for a specific stage.

  • Download stages into a CSV file.

After you click each stage, the selected stage summary is displayed in the right section.

  • Stage Summary: Lists KPIs of each stage such as Status, Duration, Start Time, Shuffle Output Bytes, Shuffle Output Bytes Spilled, Slot MS, Input Rows, and Output Rows. You can also view metric details of a specific stage.

  • Error View: Lists errors of each failed stage.

  • Metrics: Lists all the metrics involved in running the job, their values, and corresponding definitions.

For information about query stages and their metrics, see Google BigQuery documentation.