Ingest cloud resources with Dynatrace
This guide aims to show you how to ingest cloud resources using Dynatrace to have a good grasp of the cloud resources/entities you have from your cloud provider.
Common use cases
- Map your monitored resources from cloud providers in Dynatrace
Prerequisites
This guide assumes the following:
- You have a Port account and that you have finished the onboarding process.
- You have installed and setup Port's Dynatrace integration
- You have entities from cloud providers configured on Dynatrace. See Dynatrace documentation for this.
Ingesting cloud resources into Port
We will be making use of the entity kind in Port's Dynatrace integration which provides information on entities being monitored in Dynatrace. Entities however are ingested based on their respective entity types. To ingest cloud resources, we have to ingest only entities of certain types such as the following:
Some cloud resources entity types
cloud:gcp:k8s_clustercloud:gcp:pubsub_subscriptioncloud:gcp:pubsub_topiccloud:gcp:gcs_bucketcloud:gcp:gae_appcloud:aws:acmprivatecacloud:aws:api_gatewaycloud:aws:app_runnercloud:aws:appstreamcloud:aws:appsynccloud:azure:apimanagement:servicecloud:azure:app:containerappscloud:azure:app:managedenvironmentscloud:azure:appconfiguration:configurationstorescloud:azure:appplatform:spring
Creating the mapping configuration
After installing the Dynatrace integration, create the following blueprint configuration:
Dynatrace dynatraceEntityCloudResource blueprint configuration
{
"identifier": "dynatraceEntityCloudResource",
"description": "This blueprint represents a Dynatrace Entity",
"title": "Dynatrace Cloud Resource",
"icon": "Dynatrace",
"schema": {
"properties": {
"firstSeen": {
"type": "string",
"title": "First Seen",
"description": "The timestamp at which the entity was first seen, in UTC milliseconds.",
"format": "date-time"
},
"lastSeen": {
"type": "string",
"title": "Last Seen",
"description": "The timestamp at which the entity was last seen, in UTC milliseconds.",
"format": "date-time"
},
"type": {
"type": "string",
"title": "Type",
"description": "The type of the entity."
},
"tags": {
"type": "array",
"title": "Tags",
"description": "A list of tags of the entity.",
"items": {
"type": "string"
}
}
},
"required": []
},
"mirrorProperties": {},
"calculationProperties": {},
"aggregationProperties": {},
"relations": {}
}
Next, locate the Dynatrace integration in the Data Sources page and add the following mapping for the cloud resources:
Dynatrace entity blueprint configuration
deleteDependentEntities: true
createMissingRelatedEntities: true
enableMergeEntity: true
resources:
- kind: entity
selector:
query: 'true'
entityTypes:
- `cloud:gcp:k8s_cluster`
- `cloud:gcp:pubsub_subscription`
- `cloud:gcp:pubsub_topic`
- `cloud:gcp:gcs_bucket`
- `cloud:gcp:gae_app`
- `cloud:aws:acmprivateca`
- `cloud:aws:api_gateway`
- `cloud:aws:app_runner`
- `cloud:aws:appstream`
- `cloud:aws:appsync`
- `cloud:azure:apimanagement:service`
- `cloud:azure:app:containerapps`
- `cloud:azure:app:managedenvironments`
- `cloud:azure:appconfiguration:configurationstores`
- `cloud:azure:appplatform:spring`
# see below section for more entity types
port:
entity:
mappings:
identifier: .displayName | gsub(" "; "-")
title: .displayName
blueprint: '"dynatraceEntityCloudResource"'
properties:
firstSeen: .firstSeenTms / 1000 | todate
lastSeen: .lastSeenTms / 1000 | todate
type: .type
tags: .tags[].stringRepresentation
Next, click on resync and watch your cloud resources from Dynatrace being ingested:
Cloud entity types
The entityTypes selector in the mapping above are entity types that corresponds to possible cloud resources in your Dynatrace environment. However, these are not the only types that are cloud resources. You can get the list of entity types, by making a GET request to https://<your dynatrace environment ID>.live.dynatrace.com/api/v2/entityTypes. Below is an exhaustive list of entity types you can use in the entityTypes selector:
Cloud resources entity types
cloud:aws:acmprivatecacloud:aws:api_gatewaycloud:aws:app_runnercloud:aws:appstreamcloud:aws:appsynccloud:aws:athenacloud:aws:auroracloud:aws:autoscalingcloud:aws:billingcloud:aws:cassandracloud:aws:chatbotcloud:aws:cloud_frontcloud:aws:cloudhsmcloud:aws:cloudsearchcloud:aws:codebuildcloud:aws:cognitocloud:aws:connectcloud:aws:datasynccloud:aws:daxcloud:aws:dmscloud:aws:documentdbcloud:aws:dxconcloud:aws:dynamodbcloud:aws:ebscloud:aws:ec2_spotcloud:aws:ec2apicloud:aws:ecscloud:aws:ecs:clustercloud:aws:efscloud:aws:eks:clustercloud:aws:elasticachecloud:aws:elasticbeanstalkcloud:aws:elasticinferencecloud:aws:elastictranscodercloud:aws:emrcloud:aws:escloud:aws:eventscloud:aws:fsxcloud:aws:gameliftcloud:aws:gluecloud:aws:inspectorcloud:aws:iotcloud:aws:iot_things_graphcloud:aws:iotanalyticscloud:aws:kafkacloud:aws:kinesis:data_analyticscloud:aws:kinesis:data_firehosecloud:aws:kinesis:data_streamcloud:aws:kinesis:video_streamcloud:aws:lambdacloud:aws:lexcloud:aws:logscloud:aws:media_tailorcloud:aws:mediaconnectcloud:aws:mediaconvertcloud:aws:mediapackagelivecloud:aws:mediapackagevodcloud:aws:mqcloud:aws:nat_gatewaycloud:aws:neptunecloud:aws:opsworkscloud:aws:pollycloud:aws:qldbcloud:aws:rdscloud:aws:redshiftcloud:aws:rekognitioncloud:aws:robomakercloud:aws:route53cloud:aws:route53resolvercloud:aws:s3cloud:aws:sage_maker:batch_transform_jobcloud:aws:sage_maker:endpointcloud:aws:sage_maker:endpoint_instancecloud:aws:sage_maker:ground_truthcloud:aws:sage_maker:processing_jobcloud:aws:sage_maker:training_jobcloud:aws:servicecatalogcloud:aws:sescloud:aws:snscloud:aws:sqscloud:aws:ssm-runcommandcloud:aws:statescloud:aws:storagegatewaycloud:aws:swfcloud:aws:textractcloud:aws:transfercloud:aws:transitgatewaycloud:aws:translatecloud:aws:trustedadvisorcloud:aws:usagecloud:aws:vpncloud:aws:wafcloud:aws:wafv2cloud:aws:workmailcloud:aws:workspacescloud:azure:apimanagement:servicecloud:azure:app:containerappscloud:azure:app:managedenvironmentscloud:azure:appconfiguration:configurationstorescloud:azure:appplatform:springcloud:azure:automation:automationaccountscloud:azure:batch:accountcloud:azure:blockchain:blockchainmemberscloud:azure:cache:rediscloud:azure:cdn:cdnwebapplicationfirewallpoliciescloud:azure:cdn:profilescloud:azure:classic_storage_accountcloud:azure:classic_storage_account:blobcloud:azure:classic_storage_account:filecloud:azure:classic_storage_account:queuecloud:azure:classic_storage_account:tablecloud:azure:classic_virtual_machinecloud:azure:cognitiveservices:allinonecloud:azure:cognitiveservices:anomalydetectorcloud:azure:cognitiveservices:bingautosuggestcloud:azure:cognitiveservices:bingcustomsearchcloud:azure:cognitiveservices:bingentitysearchcloud:azure:cognitiveservices:bingsearchcloud:azure:cognitiveservices:bingspellcheckcloud:azure:cognitiveservices:computervisioncloud:azure:cognitiveservices:contentmoderatorcloud:azure:cognitiveservices:customvisionpredictioncloud:azure:cognitiveservices:customvisiontrainingcloud:azure:cognitiveservices:facecloud:azure:cognitiveservices:immersivereadercloud:azure:cognitiveservices:inkrecognizercloud:azure:cognitiveservices:luiscloud:azure:cognitiveservices:luisauthoringcloud:azure:cognitiveservices:openaicloud:azure:cognitiveservices:personalizercloud:azure:cognitiveservices:qnamakercloud:azure:cognitiveservices:speechcloud:azure:cognitiveservices:textanalyticscloud:azure:cognitiveservices:translatorcloud:azure:containerinstance:containergroupcloud:azure:containerregistry:registriescloud:azure:containerservice:managedclustercloud:azure:datafactory:v1cloud:azure:datafactory:v2cloud:azure:datalakeanalytics:accountscloud:azure:datalakestore:accountscloud:azure:datashare:accountscloud:azure:devices:iothubscloud:azure:devices:provisioningservicescloud:azure:documentdb:databaseaccounts:globalcloud:azure:documentdb:databaseaccounts:mongocloud:azure:eventgrid:domainscloud:azure:eventgrid:systemtopicscloud:azure:eventgrid:topicscloud:azure:eventhub:clusterscloud:azure:frontdoorcloud:azure:hdinsight:clustercloud:azure:hybridcompute:machinescloud:azure:insights:componentscloud:azure:iotcentral:iotappscloud:azure:keyvault:vaultscloud:azure:kusto:clusterscloud:azure:logic:integrationserviceenvironmentscloud:azure:logic:workflowscloud:azure:machinelearningservices:workspacescloud:azure:maps:accountscloud:azure:mariadb:servercloud:azure:media:mediaservicescloud:azure:media:mediaservices:streamingendpointscloud:azure:mysql:flexibleserverscloud:azure:mysql:servercloud:azure:netapp:netappaccounts:capacitypoolscloud:azure:netapp:netappaccounts:capacitypools:volumescloud:azure:network:applicationgatewayscloud:azure:network:azurefirewallscloud:azure:network:dnszonescloud:azure:network:expressroutecircuitscloud:azure:network:loadbalancers:basiccloud:azure:network:loadbalancers:gatewaycloud:azure:network:loadbalancers:standardcloud:azure:network:networkinterfacescloud:azure:network:networkwatchers:connectionmonitorscloud:azure:network:networkwatchers:connectionmonitors:previewcloud:azure:network:privatednszonescloud:azure:network:publicipaddressescloud:azure:notificationhubs:namespaces:notificationhubscloud:azure:postgresql:flexibleserverscloud:azure:postgresql:servercloud:azure:postgresql:serverv2cloud:azure:powerbidedicated:capacitiescloud:azure:recoveryservices:vaultscloud:azure:relay:namespacescloud:azure:search:searchservicescloud:azure:servicefabricmesh:applicationscloud:azure:signalrservice:signalrcloud:azure:sql:managedcloud:azure:sql:serverscloud:azure:sql:servers:databases:datawarehousecloud:azure:sql:servers:databases:dtucloud:azure:sql:servers:databases:hyperscalecloud:azure:sql:servers:databases:vcorecloud:azure:sql:servers:elasticpools:dtucloud:azure:sql:servers:elasticpools:vcorecloud:azure:storage:storageaccountscloud:azure:storage:storageaccounts:blobcloud:azure:storage:storageaccounts:filecloud:azure:storage:storageaccounts:queuecloud:azure:storage:storageaccounts:tablecloud:azure:storagesync:storagesyncservicescloud:azure:streamanalytics:streamingjobscloud:azure:synapse:workspacescloud:azure:synapse:workspaces:bigdatapoolscloud:azure:synapse:workspaces:sqlpoolscloud:azure:timeseriesinsights:environmentscloud:azure:timeseriesinsights:eventsourcescloud:azure:traffic_manager_profilecloud:azure:virtual_network_gatewaycloud:azure:web:appslotscloud:azure:web:functionslotscloud:azure:web:hostingenvironments:v2cloud:azure:web:serverfarmscloud:gcp:autoscalercloud:gcp:bigquery_biengine_modelcloud:gcp:cloud_functioncloud:gcp:cloud_run_revisioncloud:gcp:cloudsql_databasecloud:gcp:filestore_instancecloud:gcp:gae_appcloud:gcp:gce_instancecloud:gcp:gcs_bucketcloud:gcp:https_lbcloud:gcp:instance_groupcloud:gcp:internal_http_lb_rulecloud:gcp:internal_network_lb_rulecloud:gcp:k8s_clustercloud:gcp:k8s_containercloud:gcp:k8s_nodecloud:gcp:k8s_podcloud:gcp:network_lb_rulecloud:gcp:projectcloud:gcp:pubsub_snapshotcloud:gcp:pubsub_subscriptioncloud:gcp:pubsub_topiccloud:gcp:pubsublite_subscription_partitioncloud:gcp:pubsublite_topic_partitioncloud:gcp:tcp_ssl_proxy_rulecloud:gcp:tpu_workerS3BUCKET