How do I send notifications to PagerDuty?

Set up the integration in PagerDuty

1. Log in to PagerDuty and go to Configuration > Services

2. Click Add Services, name the service, and select ‘Rigor’ as the integration type

   

3. Click Add Service.

4. Copy the Service API Key of the new PagerDuty Service to your clipboard.

   

Set up the Alert Webhook in Splunk Synthetic Monitoring

1. In Splunk Synthetic Monitoring, go to Admin > Alert Webhooks > + New and click Create a PagerDuty Alert Webhook
2. Under Name, provide a name for your webhook.
3. Under Triggers, select a trigger for your notification (either "when failed" or "when back online") from the dropdown.
4. Paste the PagerDuty Service API Key copied in step 4 into the ‘service_key’ field in the ‘Payload’ section for each trigger.
5. (optional) Click JSON to open the JSON request body for the API request that will be sent to HipChat upon each trigger event. Edit the JSON as needed to suit your workflow and then click Save.
6. Click Test test your webhook by sending a request to the PagerDuty API endpoint.
7. Click Create to save the webhook.

Add your webhook to a Splunk Synthetic Monitoring check 

You need to add your webhook to each check you want to send notifications from. To add your webhook to a check, do the following:

1. Navigate to a check in Splunk Synthetic Monitoring, click the gear icon, and select Edit from the dropdown.
2. Click the Notifications tab.
3. Under Notify, select your desired notification trigger. 
4. Under Recipients, select your new webhook from the dropdown. 
5. Adjust the additional settings to your preferences. 
6. Click Save.

With the webhook set up, Rigor alerts for each check it's added to trigger incidents in PagerDuty:

When the check comes back online, the associated PagerDuty incident gets resolved: