CI Monitoring In MCT

Background ¶

The CI team migrated their monitoring cases from Nagios to MCT in the previous phases.

Monitoring Types ¶

Monitoring is generally divided into two categories: General Checks and TAP Checks.

General Checks ¶

MCT Platform provides General plugins. CI team uses the following general plugins:

• Port Monitor
• Http Monitor
• Cert Monitor

TAP Checks ¶

Most TAP cases are written by the CI team as a MCT Java Plugin. These contain specific logic that checks the functionality of CI services.

Click on each monitoring type below to see its detailed logic.

Kibana Hit Monitoring ¶

Parameters:

1. ES information 1. ES url, e.g. es-api.wx-common-id.aiadlogprd-agg1.prod.infra.webex.com 2. topic, e.g. logstash-* 3. query DSL, e.g. { \"query\": { \"bool\": { \"must\": [ { \"query_string\": { \"query\": \"hostname: debezium-ta-001-appa.amer.prv.webex.com\" } } ], \"filter\": [ {\"range\": {\"@timestamp\": {\"gte\": \"now-5m\", \"lt\": \"now\"}}} ] } }}
2. alert rule 1. matched count 2. at least or at most

Broker Login-out Monitoring ¶

Parameters:

1. a user accounts, refer to Prod commercial account prodbuserlogin26@mcttest.com. 1. user account name 2. user account password 3. user account orgId

Broker Sign Encrypt Certs Monitoring ¶

Parameters:

1. a service account, refer to Prod commercial account cimcttestprod. 1. service account id 2. service account name 3. service account password
2. an oauth client with scope Identity:Config 1. client id 2. client secret

Broker Service Account Login Monitoring ¶

Parameters:

1. a service accounts, refer to Prod commercial account cimctsvclogintestprod. 1. service account name 2. service account password

Connector SCIM Oauth Monitoring ¶

Parameters:

1. an oauth client, refer to Prod commercial client C663505e9ef607b1a5d6f46d7461553d083f8364498156295fdcc8aed346dae21. 1. client id 2. client secret
2. 2 user accounts with same password, one with empty entitlement, one with following entitlements: "webex-squared", "squared-call-initiation", "spark-test-account","spark","screen-share","basic-message","basic-meeting", refer to Prod commercial account prodascimWithoutService@mcttest.cisco.com and prodascimWithService@mcttest.cisco.com. 1. user account name1 2. user account name2 3. user account password 4. user account orgId
3. a session cookie name, refer to Prod commercial cookie name cisPRODiPlanetDirectoryPro.

Connector SCIM HT Monitor ¶

Parameters:

1. a service account, refer to Prod commercial account cimcttestprod. 1. service account id 2. service account name 3. service account password
2. an oauth client with scope Identity:Config Identity:SCIM Identity:Organization Identity:OAuthToken 1. client id 2. client secret
3. an organization, refer to Prod commercial org 52517afe-2eef-4361-b18f-1d207e07b3ef. 1. org id 2. org display name

Extemal CertExpireDate Monitoring ¶

Parameters:

1. cert name
2. cert expire time
3. warning threshold (days)

Common Data Sync Monitoring ¶

Parameters:

1. a service account, refer to Prod commercial account cimcttestprod. 1. service account id 2. service account name 3. service account password
2. an oauth client with scope Identity:OAuthClient 1. client id 2. client secret

Connector Service Check Machine Account API Monitoring ¶

Parameters:

1. an oauth client, refer to Prod commercial client C663505e9ef607b1a5d6f46d7461553d083f8364498156295fdcc8aed346dae21. 1. client id 2. client secret
2. a user account, refer to Prod commercial account prodbFullADmachineAccountCheck28@mcttest.cisco.com. 1. user account name 2. user account password 3. user account orgId
3. a session cookie name, refer to Prod commercial cookie name cisPRODiPlanetDirectoryPro.

CI Services ¶

Zookeeper (yzksvr) ¶

Enabled checks:

• Port Check: 2281 (Host)
• Cert Check
• ES Count Monitor

DirSync (ydrsvr) ¶

Enabled checks:

• Port Check: 10443 (Host) / 443 (Vip)
• Cert Check
• ES Count Monitor
• Http Check: /SynchronizationService-v1_0/HealthCheck.jsp

FLS (flrsvr) ¶

Enabled checks:

• Port Check: 10443 (Host) / 443 (Vip)
• Cert Check
• ES Count Monitor
• Http Check: /federation/HealthCheck.jsp

Changelog (ychgsvr) ¶

Enabled checks:

• Port Check: 10443 (Host)
• Cert Check
• ES Count Monitor
• Http Check: /api/v1/healthcheck

Debezium (ydmsvr) ¶

Enabled checks:

• Port Check: 10443 (Host)
• Cert Check
• ES Count Monitor

Connector (ycnsvr) ¶

Enabled checks:

• Port Check: 10443 (Host) / 443 (Vip)
• Cert Check
• ES Count Monitor
• Http Check: /identity/HealthCheck.jsp
• SCIM HT Monitor: Both Host and Vip level
• Service Check Machine Account API Monitor: Both Host and Vip level
• SCIM Oauth Monitor: Only Vip level

Broker (yibsvr) ¶

Enabled checks:

• Port Check: 10443 (Host)
• Cert Check
• ES Count Monitor
• Http Check: /api/v1/healthcheck
• Login-out Monitor: Both Host and Vip level
• Service Account Login Monitor: Both Host and Vip level
• Sign Encrypt Certs Monitor: Only Vip level
• Data Sync Monitor: Only Global Vip level

Other ¶

Enabled checks:

• Extemal CertExpireDate Monitor: for Symantec Cert, kafkaWebexKeyStore and kafkaTeamKeyStore.

Monitoring Coverage ¶

1. CI BTS - EU - AMS - LHR - US - JFK - DFW
2. CI PROD - EU - AMS - FRA - CA - YUL - YYZ - A - JFK - DFW - SJC (retire) - B - JFK - DFW
3. CI FedRamp - F - IAD90 - DFW90

MCT Check Provision ¶

MCT uses the PAPV template to provision multiple checks. The request API is POST /mpi/automationPA/autoBuildServer

PAPV Template ¶

To find the template, go to svrtype setting and search for the target svrtype.

Request body example ¶

Zookeeper ¶

• Host Level:

  {
    "infraFile": "infra:\n  servers:\n    - hostname: zookeeper-ta-001-odie.amer.prv.webex.com\n      serverType: yzksvr\n      ip: 10.241.14.12\n    - hostname: zookeeper-ta-002-odie.amer.prv.webex.com\n      serverType: yzksvr\n      ip: 10.241.14.37\n    - hostname: zookeeper-ta-003-odie.amer.prv.webex.com\n      serverType: yzksvr\n      ip: 10.241.14.21\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: yzksvr\n      items:\n        tap.syncDownstream: 0\n        ESCountMonitor.Username: lma-grafana.gen@cisco.com\n        ESCountMonitor.Password: <[[TC1EeVrRcMsv7kageCc9cPDV7ifB2dsJWnNVkCcepuIF9MDI3BWQAuCbtCGLlquw]]>\n        ESCountMonitor.baseUrl: es-api.wx-common-id.int.aiadlogprd-agg1.prod.infra.webex.com\n        ESCountMonitor.topic: logstash-wx-common-id\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672911\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"DFW02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": true,\"pool_full_name\":\"ytx1(commonidentity)\",\"message\":null,\"pool_name\":\"ytx1\",\"requestId\":\"CI_1626232672911\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity Operations\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

Dirsync ¶

• Host Level:

  {
    "infraFile": "infra:\n  servers:\n    - hostname: iddirsync-ta-001-odie.amer.prv.webex.com\n      serverType: ydrsvr \n      ip: 10.241.14.13\n    - hostname: iddirsync-ta-002-odie.amer.prv.webex.com\n      serverType: ydrsvr \n      ip: 10.241.14.23\n    - hostname: iddirsync-ta-003-odie.amer.prv.webex.com\n      serverType: ydrsvr \n      ip: 10.241.14.22\n    - hostname: iddirsync-ta-004-odie.amer.prv.webex.com\n      serverType: ydrsvr \n      ip: 10.241.14.26\n    - hostname: iddirsync-ta-005-odie.amer.prv.webex.com\n      serverType: ydrsvr \n      ip: 10.241.14.189\n    - hostname: iddirsync-ta-006-odie.amer.prv.webex.com\n      serverType: ydrsvr \n      ip: 10.241.14.200\n    - hostname: iddirsync-ta-007-odie.amer.prv.webex.com\n      serverType: ydrsvr \n      ip: 10.241.14.203\n    - hostname: iddirsync-ta-008-odie.amer.prv.webex.com\n      serverType: ydrsvr \n      ip: 10.241.14.204\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: ydrsvr\n      items:\n        GenericPortMonitoringServer.Port: 10443\n        ESCountMonitor.Username: lma-grafana.gen@cisco.com\n        ESCountMonitor.Password: <[[TC1EeVrRcMsv7kageCc9cPDV7ifB2dsJWnNVkCcepuIF9MDI3BWQAuCbtCGLlquw]]>\n        ESCountMonitor.baseUrl: es-api.wx-common-id.int.aiadlogprd-agg1.prod.infra.webex.com\n        ESCountMonitor.topic: logstash-wx-common-id\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672911\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"DFW02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": true,\"pool_full_name\":\"ytx1(commonidentity)\",\"message\":null,\"pool_name\":\"ytx1\",\"requestId\":\"CI_1626232672911\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity Operations\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

• Vip Level:

  {
    "infraFile": "infra:\n  servers:\n      - hostname: cloudconnector.cisco.com\n        ip: cloudconnector.cisco.com\n        serverType: ydrsvrv\n      - hostname: cloudconnectorsj-s.cisco.com\n        ip: cloudconnectorsj-s.cisco.com\n        serverType: ydrsvrv\n      - hostname: cloudconnectortx-s.cisco.com\n        ip: cloudconnectortx-s.cisco.com\n        serverType: ydrsvrv\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: ydrsvrv\n      items:\n        GenericPortMonitoringServer.Port: 443\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672916\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"SJC02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": false,\"pool_full_name\":\"gysj1(commonidentity)\",\"message\":null,\"pool_name\":\"gysj1\",\"requestId\":\"CI_1626232672916\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

FLS ¶

• Host Level:

  {
    "infraFile": "infra:\n  servers:\n    - hostname: fls-ta-001-odie.amer.prv.webex.com\n      serverType: flrsvr \n      ip: 10.241.15.14\n    - hostname: fls-ta-002-odie.amer.prv.webex.com\n      serverType: flrsvr \n      ip: 10.241.15.15\n    - hostname: fls-ta-003-odie.amer.prv.webex.com\n      serverType: flrsvr \n      ip: 10.241.15.16\n    - hostname: fls-ta-004-odie.amer.prv.webex.com\n      serverType: flrsvr \n      ip: 10.241.15.17\n    - hostname: fls-ta-005-odie.amer.prv.webex.com\n      serverType: flrsvr \n      ip: 10.241.15.18\n    - hostname: fls-ta-006-odie.amer.prv.webex.com\n      serverType: flrsvr \n      ip: 10.241.15.19\n    - hostname: fls-ta-007-odie.amer.prv.webex.com\n      serverType: flrsvr \n      ip: 10.241.15.20\n    - hostname: fls-ta-008-odie.amer.prv.webex.com\n      serverType: flrsvr \n      ip: 10.241.15.21\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: flrsvr\n      items:\n        GenericPortMonitoringServer.Port: 10443\n        ESCountMonitor.Username: lma-grafana.gen@cisco.com\n        ESCountMonitor.Password: <[[TC1EeVrRcMsv7kageCc9cPDV7ifB2dsJWnNVkCcepuIF9MDI3BWQAuCbtCGLlquw]]>\n        ESCountMonitor.baseUrl: es-api.wx-common-id.int.aiadlogprd-agg1.prod.infra.webex.com\n        ESCountMonitor.topic: logstash-wx-common-id\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672911\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"DFW02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": true,\"pool_full_name\":\"ytx1(commonidentity)\",\"message\":null,\"pool_name\":\"ytx1\",\"requestId\":\"CI_1626232672911\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity Operations\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

• Vip Level:

  {
    "infraFile": "infra:\n  servers:\n      - hostname: cifls-sj-s.webex.com\n        ip: cifls-sj-s.webex.com\n        serverType: flrsvrv\n      - hostname: cifls-ta-s.webex.com\n        ip: cifls-ta-s.webex.com\n        serverType: flrsvrv\n      - hostname: cifls-us.webex.com\n        ip: cifls-us.webex.com\n        serverType: flrsvrv\n      - hostname: cifls.webex.com\n        ip: cifls.webex.com\n        serverType: flrsvrv\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: flrsvrv\n      items:\n        GenericPortMonitoringServer.Port: 443\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672916\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"SJC02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": false,\"pool_full_name\":\"gysj1(commonidentity)\",\"message\":null,\"pool_name\":\"gysj1\",\"requestId\":\"CI_1626232672916\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

Changelog ¶

• Host Level:

  {
    "infraFile": "infra:\n  servers:\n    - hostname: idchglog-ta-001-odie.amer.prv.webex.com\n      serverType: ychgsvr \n      ip: 10.241.14.31\n    - hostname: idchglog-ta-002-odie.amer.prv.webex.com\n      serverType: ychgsvr \n      ip: 10.241.14.38\n    - hostname: idchglog-ta-003-odie.amer.prv.webex.com\n      serverType: ychgsvr \n      ip: 10.241.14.210\n    - hostname: idchglog-ta-004-odie.amer.prv.webex.com\n      serverType: ychgsvr \n      ip: 10.241.14.187\n    - hostname: idchglog-ta-005-odie.amer.prv.webex.com\n      serverType: ychgsvr \n      ip: 10.241.14.205\n    - hostname: idchglog-ta-006-odie.amer.prv.webex.com\n      serverType: ychgsvr \n      ip: 10.241.14.207\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: ychgsvr\n      items:\n        GenericPortMonitoringServer.Port: 10443\n        ESCountMonitor.Username: lma-grafana.gen@cisco.com\n        ESCountMonitor.Password: <[[TC1EeVrRcMsv7kageCc9cPDV7ifB2dsJWnNVkCcepuIF9MDI3BWQAuCbtCGLlquw]]>\n        ESCountMonitor.baseUrl: es-api.wx-common-id.int.aiadlogprd-agg1.prod.infra.webex.com\n        ESCountMonitor.topic: logstash-wx-common-id\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672911\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"DFW02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": true,\"pool_full_name\":\"ytx1(commonidentity)\",\"message\":null,\"pool_name\":\"ytx1\",\"requestId\":\"CI_1626232672911\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity Operations\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

Debezium ¶

• Host Level:

  {
    "infraFile": "infra:\n  servers:\n    - hostname: debezium-ta-001-odie.amer.prv.webex.com\n      serverType: ydmsvr\n      ip: 10.241.14.211\n    - hostname: debezium-ta-002-odie.amer.prv.webex.com\n      serverType: ydmsvr\n      ip: 10.241.14.213\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: ydmsvr\n      items:\n        GenericPortMonitoringServer.Port: 10443\n        ESCountMonitor.Username: lma-grafana.gen@cisco.com\n        ESCountMonitor.Password: <[[TC1EeVrRcMsv7kageCc9cPDV7ifB2dsJWnNVkCcepuIF9MDI3BWQAuCbtCGLlquw]]>\n        ESCountMonitor.baseUrl: es-api.wx-common-id.int.aiadlogprd-agg1.prod.infra.webex.com\n        ESCountMonitor.topic: logstash-wx-common-id\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672911\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"DFW02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": true,\"pool_full_name\":\"ytx1(commonidentity)\",\"message\":null,\"pool_name\":\"ytx1\",\"requestId\":\"CI_1626232672911\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity Operations\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

Connector ¶

• Host Level:

  {
    "infraFile": "infra:\n  servers:\n    - hostname: y00tx1ycn001.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.5\n    - hostname: y00tx1ycn002.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.6\n    - hostname: y00tx1ycn003.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.7\n    - hostname: y00tx1ycn004.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.11\n    - hostname: y00tx1ycn005.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.15\n    - hostname: y00tx1ycn006.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.17\n    - hostname: y00tx1ycn007.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.19\n    - hostname: y00tx1ycn008.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.21\n    - hostname: y00tx1ycn009.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.22\n    - hostname: y00tx1ycn010.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.23\n    - hostname: y00tx1ycn011.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.47\n    - hostname: y00tx1ycn012.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.48\n    - hostname: y00tx1ycn013.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.45\n    - hostname: y00tx1ycn014.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.46\n    - hostname: y00tx1ycn015.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.57\n    - hostname: y00tx1ycn016.webex.com \n      serverType: ycnsvr \n      ip: 10.240.88.58\n    - hostname: y00tx1ycn017.webex.com \n      serverType: ycnsvr \n      ip: 10.240.40.154\n    - hostname: y00tx1ycn018.webex.com \n      serverType: ycnsvr \n      ip: 10.240.40.155\n    - hostname: y00tx1ycn019.webex.com \n      serverType: ycnsvr \n      ip: 10.240.40.156\n    - hostname: y00tx1ycn020.webex.com \n      serverType: ycnsvr \n      ip: 10.240.40.146\n    - hostname: y00tx1ycn021.webex.com \n      serverType: ycnsvr \n      ip: 10.240.40.147\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: ycnsvr\n      items:\n        GenericPortMonitoringServer.Port: 10443\n        ESCountMonitor.Username: lma-grafana.gen@cisco.com\n        ESCountMonitor.Password: <[[TC1EeVrRcMsv7kageCc9cPDV7ifB2dsJWnNVkCcepuIF9MDI3BWQAuCbtCGLlquw]]>\n        ESCountMonitor.baseUrl: es-api.wx-common-id.int.aiadlogprd-agg1.prod.infra.webex.com\n        ESCountMonitor.topic: logstash-wx-common-id\n        MachineAccountAPIsCheckByFullAdmin.ciUserName: prodaFullADmachineAccountCheck@mcttest.cisco.com\n        MachineAccountAPIsCheckByFullAdmin.ciUserPassword: P@ssword1234\n        MachineAccountAPIsCheckByFullAdmin.ciOrgId: abe20be8-f408-42e1-92dd-b2a9f41a4e68\n        MachineAccountAPIsCheckByFullAdmin.ciBrokerHost: idbroker.webex.com\n        MachineAccountAPIsCheckByFullAdmin.ciUserSessionCookieName: cisPRODiPlanetDirectoryPro\n        MachineAccountAPIsCheckByFullAdmin.ciClientId: C663505e9ef607b1a5d6f46d7461553d083f8364498156295fdcc8aed346dae21\n        MachineAccountAPIsCheckByFullAdmin.ciClientSecret: e886cb47d500e85f9952ea0c296ad223988a91c8952f413c202edf09d7c26418\n        ConnectorScimAPIsHTCheck.ciOrgId: 7acdddff-a2df-4d50-8e5d-9f8b6d615092\n        ConnectorScimAPIsHTCheck.ciDisplayName: Nantucket\n        ConnectorScimAPIsHTCheck.mctHost: mtsj1mpi001.webex.com:8021\n        ConnectorScimAPIsHTCheck.ciScope: Identity:Config Identity:SCIM Identity:Organization Identity:OAuthToken\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672911\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"DFW02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": true,\"pool_full_name\":\"ytx1(commonidentity)\",\"message\":null,\"pool_name\":\"ytx1\",\"requestId\":\"CI_1626232672911\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity Operations\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

• Vip Level:

  {
    "infraFile": "infra:\n  servers:\n      - hostname: identity-secondary.webex.com\n        ip: identity-secondary.webex.com\n        serverType: ycnsvrv\n      - hostname: identity.webex.com\n        ip: identity.webex.com\n        serverType: ycnsvrv\n      - hostname: identitysj-s.webex.com\n        ip: identitysj-s.webex.com\n        serverType: ycnsvrv\n      - hostname: identitytx-s.webex.com\n        ip: identitytx-s.webex.com\n        serverType: ycnsvrv\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: ycnsvrv\n      items:\n        GenericPortMonitoringServer.Port: 443\n        ESCountMonitor.Username: lma-grafana.gen@cisco.com\n        ESCountMonitor.Password: <[[TC1EeVrRcMsv7kageCc9cPDV7ifB2dsJWnNVkCcepuIF9MDI3BWQAuCbtCGLlquw]]>\n        ESCountMonitor.baseUrl: es-api.wx-common-id.int.aiadlogprd-agg1.prod.infra.webex.com\n        ESCountMonitor.topic: logstash-wx-common-id\n        MachineAccountAPIsCheckByFullAdmin.ciUserName: prodaFullADmachineAccountCheck@mcttest.cisco.com\n        MachineAccountAPIsCheckByFullAdmin.ciUserPassword: P@ssword1234\n        MachineAccountAPIsCheckByFullAdmin.ciOrgId: abe20be8-f408-42e1-92dd-b2a9f41a4e68\n        MachineAccountAPIsCheckByFullAdmin.ciBrokerHost: idbroker.webex.com\n        MachineAccountAPIsCheckByFullAdmin.ciUserSessionCookieName: cisPRODiPlanetDirectoryPro\n        MachineAccountAPIsCheckByFullAdmin.ciClientId: C663505e9ef607b1a5d6f46d7461553d083f8364498156295fdcc8aed346dae21\n        MachineAccountAPIsCheckByFullAdmin.ciClientSecret: e886cb47d500e85f9952ea0c296ad223988a91c8952f413c202edf09d7c26418\n        ConnectorScimAPIsCheckOauthPost.ciUserName: prodascimWithoutService@mcttest.cisco.com\n        ConnectorScimAPIsCheckOauthPost.ciUserName2: prodascimWithService@mcttest.cisco.com\n        ConnectorScimAPIsCheckOauthPost.ciUserPassword: P@ssword1234\n        ConnectorScimAPIsCheckOauthPost.ciOrgId: abe20be8-f408-42e1-92dd-b2a9f41a4e68\n        ConnectorScimAPIsCheckOauthPost.ciBrokerHost: idbroker.webex.com\n        ConnectorScimAPIsCheckOauthPost.ciUserSessionCookieName: cisPRODiPlanetDirectoryPro\n        ConnectorScimAPIsCheckOauthPost.ciClientId: C663505e9ef607b1a5d6f46d7461553d083f8364498156295fdcc8aed346dae21\n        ConnectorScimAPIsCheckOauthPost.ciClientSecret: e886cb47d500e85f9952ea0c296ad223988a91c8952f413c202edf09d7c26418\n        ConnectorScimAPIsHTCheck.ciOrgId: 7acdddff-a2df-4d50-8e5d-9f8b6d615092\n        ConnectorScimAPIsHTCheck.ciDisplayName: Nantucket\n        ConnectorScimAPIsHTCheck.mctHost: mctapi.webex.com\n        ConnectorScimAPIsHTCheck.ciScope: Identity:Config Identity:SCIM Identity:Organization Identity:OAuthToken\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672916\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"SJC02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": false,\"pool_full_name\":\"gysj1(commonidentity)\",\"message\":null,\"pool_name\":\"gysj1\",\"requestId\":\"CI_1626232672916\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

Broker ¶

• Host Level:

  {
    "infraFile": "infra:\n  servers:\n    - hostname: y00tx1yib001.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.8\n    - hostname: y00tx1yib002.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.10\n    - hostname: y00tx1yib003.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.12\n    - hostname: y00tx1yib004.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.14\n    - hostname: y00tx1yib005.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.16\n    - hostname: y00tx1yib006.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.18\n    - hostname: y00tx1yib007.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.30\n    - hostname: y00tx1yib008.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.31\n    - hostname: y00tx1yib009.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.9\n    - hostname: y00tx1yib010.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.44\n    - hostname: y00tx1yib011.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.51\n    - hostname: y00tx1yib012.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.52\n    - hostname: y00tx1yib013.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.53\n    - hostname: y00tx1yib014.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.54\n    - hostname: y00tx1yib015.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.55\n    - hostname: y00tx1yib016.webex.com\n      serverType: yibsvr\n      ip: 10.240.88.56\n    - hostname: y00tx1yib017.webex.com\n      serverType: yibsvr\n      ip: 10.240.40.157\n    - hostname: y00tx1yib018.webex.com\n      serverType: yibsvr\n      ip: 10.240.40.158\n    - hostname: y00tx1yib019.webex.com\n      serverType: yibsvr\n      ip: 10.240.40.159\n    - hostname: y00tx1yib020.webex.com\n      serverType: yibsvr\n      ip: 10.240.40.148\n    - hostname: y00tx1yib021.webex.com\n      serverType: yibsvr\n      ip: 10.240.40.37\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: yibsvr\n      items:\n        GenericPortMonitoringServer.Port: 10886\n        ESCountMonitor.Username: lma-grafana.gen@cisco.com\n        ESCountMonitor.Password: <[[TC1EeVrRcMsv7kageCc9cPDV7ifB2dsJWnNVkCcepuIF9MDI3BWQAuCbtCGLlquw]]>\n        ESCountMonitor.baseUrl: es-api.wx-common-id.int.aiadlogprd-agg1.prod.infra.webex.com\n        ESCountMonitor.topic: logstash-wx-common-id\n        CiServiceAccountLogin.ciServiceAccountName: cimctsvclogintestprod\n        CiServiceAccountLogin.ciServiceAccountPassword: QYP.qwin.68.ABXZ.eyjp.67.CDEY.quko.341\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672911\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"DFW02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": true,\"pool_full_name\":\"ytx1(commonidentity)\",\"message\":null,\"pool_name\":\"ytx1\",\"requestId\":\"CI_1626232672911\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity Operations\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }
  

• Vip Level:

  {
    "infraFile": "infra:\n  servers:\n      - hostname: idbroker-secondary.webex.com\n        ip: idbroker-secondary.webex.com\n        serverType: yibsvrv\n      - hostname: idbroker.webex.com\n        ip: idbroker.webex.com\n        serverType: yibsvrv\n      - hostname: idbrokersj-s.webex.com\n        ip: idbrokersj-s.webex.com\n        serverType: yibsvrv\n      - hostname: idbrokertx-s.webex.com\n        ip: idbrokertx-s.webex.com\n        serverType: yibsvrv\n",
    "monitorFile": "monitor:\n  - svrtype:\n      name: yibsvrv\n      items:\n        GenericPortMonitoringServer.Port: 443\n        CiServiceAccountLogin.ciServiceAccountName: cimctsvclogintestprod\n        CiServiceAccountLogin.ciServiceAccountPassword: QYP.qwin.68.ABXZ.eyjp.67.CDEY.quko.341\n",
    "messageJson": "{\"trackingCode\":\"MCT_BuildPool_BTS_RegisterServer_1626232672916\",\"body\":{\"ack_required\":[\"mct\"],\"cluster\":\"CI\",\"component\":\"commonidentity\",\"data_center\":\"SJC02_DATA\",\"environment\":\"Production\",\"is_gdm\": false,\"is_primary\": false,\"pool_full_name\":\"gysj1(commonidentity)\",\"message\":null,\"pool_name\":\"gysj1\",\"requestId\":\"CI_1626232672916\",\"requestType\":\"BuildPool\",\"service\":\"Identity\",\"status\":null,\"support_group\":\"Identity\",\"task\":\"RegisterServer\",\"tool\":null,\"version\":\"6.0.10\"}}"
  }