Cloud Monitoring provides visibility into the performance, uptime, and overall health of cloud-powered applications. Google Cloud Observability collects and ingests metrics, events, and metadata from Dataplex services to generate insights through dashboards and charts.
See Monitoring pricing to understand your costs.
See Monitoring quotas and limits for information on metric data retention.
Access service metrics in Monitoring
Dataplex service resource metrics are automatically enabled on Dataplex services. Use Monitoring to view these metrics.
You can access Monitoring from the Google Cloud console or by using the Monitoring API.
If you're unable to see the monitoring graphs or create alerts, you might need additional Monitoring permissions.
Console
In the Google Cloud console, go to the Metrics explorer page.
In the Select a metric menu, select a
Cloud Dataplexresource.Select a metric category, and then select a metric from the list.
To display information about a metric, hold the pointer over the metric name.
Click Apply.
Optional: Select filters, group by metric labels, perform aggregations, and select chart display options.
REST
You can use the Monitoring timeSeries.list
API to capture and list metrics defined by a filter expression.
Use the Try this API template on the API page to send
an API request and display the response.
Dataplex service metrics in Monitoring
Dataplex service metrics facilitates monitoring of service health.
| Scope | Metric Name | Monitored Resource | Metric Description |
|---|---|---|---|
| Lake | requires_action | dataplex.googleapis.com/Lake | Whether the lake has unresolved admin actions. 1 if the lake is actionable; 0 otherwise. |
| Zone | requires_action | dataplex.googleapis.com/Zone | Whether the data zone has unresolved admin actions. 1 if the data zone is actionable; 0 otherwise. |
| Asset | requires_action | dataplex.googleapis.com/Asset | Whether the asset has unresolved admin actions. 1 if the asset is actionable; 0 otherwise. |
| Asset | active | dataplex.googleapis.com/Asset | Whether the asset is active. 1 if an asset exists in non-error state; 0 otherwise. |
| Asset | data_items | dataplex.googleapis.com/Asset | Current number of data items discovered within an asset (objects in Cloud Storage bucket, and rows in BigQuery datasets). |
| Asset | data_size | dataplex.googleapis.com/Asset | Total size of data in an asset (reported in bytes). |
| Asset | filesets | dataplex.googleapis.com/asset | Current number of filesets discovered within an asset. |
| Asset | tables | dataplex.googleapis.com/Asset | Current number of tables discovered within an asset. |
Build a custom Monitoring dashboard
You can build a custom Monitoring dashboard that displays
charts of selected Dataplex service metrics. For more information
about how to create a dashboard, see
Create and manage custom dashboards. When you
select a metric for a widget on your dashboard, select a Cloud Dataplex
resource and then choose a Dataplex metric.
Use Monitoring alerts
You can create a Monitoring alert that notifies you when a Dataplex service or job metric crosses a specified threshold.
Create an alert
For more information about how to create an alert, see
Create metric-threshold alerting policies.
When you select a time series to be monitored, select a Cloud Dataplex
resource and then choose a Dataplex metric.
View alerts
When an alert is triggered by a metric threshold condition, Monitoring creates an incident and a corresponding event.
To view an incident, do the following:
In the Google Cloud console, go to the Alerting page.
If you defined a notification mechanism in the alert policy, such as an email or SMS notification, Monitoring also sends a notification of the incident.
For more information about alerts, see Incidents for metric-based alerts.
What's next
- See the Cloud Monitoring documentation.