[SOLVED] I can't visualize the data from AWS IOT

swkuay · June 14, 2021, 4:48am

Hi I had an issues to visualize my data from AWS IoT Core. All the codes are working fine. It even created new device after I had publish the message. However, the message is empty and I can’t find the variable. I can’t find any problem there.
Uploading: 2.jpg…

ubidots · June 14, 2021, 3:32pm

@swkuay can you please share more about how you’re integrating Ubidots+AWS? Is is through our official plugin?

If so, please go to your plugin, then click on “Logs” and share them with us so we can inquire more about where the problem is:

swkuay · June 15, 2021, 2:12am

This is the message logs obtained

swkuay · June 15, 2021, 2:14am

I had also follow this articles exactly to build it.

ubidots · June 15, 2021, 6:40pm

Thanks @swkuay can you click on the Log Id and send us the actual output of the log?

swkuay · June 15, 2021, 11:27pm

 Messages:
{
  "success": true,
  "message": {
    "message": "Topic Rule Destination confirmed successfully ",
    "status": 200
  }

Logs:
2021-06-15T08:30:36.352530Z stdout: [Data Plugin AWS IoT Core] Params received: {'arn': 'arn:aws:iot:us-east-2:705960257188:ruledestination/http/f72b6888-e242-4964-9ef6-4c45b4198f44', 'confirmationToken': 'AYADeINfgMp3rVTf5-3xoynczhEAXwABABVhd3MtY3J5cHRvLXB1YmxpYy1rZXkAREFzR29pVlRkaG9ZU1h4ZGxRNmpVaXA1VzE2ejFFUzFLRUM1K2tiZDJ6L2lGZlFGQVRqdmFmRmNVVjRZSjJxSkpCQT09AAEAB2F3cy1rbXMAS2Fybjphd3M6a21zOnVzLWVhc3QtMjoxMTUxMzc4MDg0Njk6a2V5LzI5ZDk3N2RjLTE0YTMtNDEyMy04MmVhLWUwNmFkNTM3Yzg4MAC4AQIBAHj42jz0rmjO63WB3jUKIJ1w1fg8QxHwam9jYx8vZkGAAwFY1gWZSrGCb6bk0ezr8uKUAAAAfjB8BgkqhkiG9w0BBwagbzBtAgEAMGgGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMueNoF8Bz3IgbUyTpAgEQgDsZ1bf0J3Y7xLPNH62gqGNSdCLuI9vVePGhx3Rx5iIYjrM0UBjP0yRu92HO8Uc34xocD54qzH9TauBLywIAAAAADAAAEAAAAAAAAAAAAAAAAACTbRIpLCB_bnrWBhKHYTj9_____wAAAAEAAAAAAAAAAAAAAAEAAAB1VK-bLSSU-u9fcDKlPIwHpr-dKD-VLJcUJjDefXHOWUKllQfsHtO-SG241GKgOglp5tzVeMhi-RRiteVrjM7m_EAJv98FkA_8Y1yZuUFqhgkbrga2Y-Tkv-crmj3GuHCHrMPu4qoWGxOxCpAvWQe303giCW7EYD6ax4_lj7-2yFztBM5gZABnMGUCMQD-HHTjwM3WJYM8JdTzp-u109Lr97km3JEs3vPra4w8hkluugP0DI0el2dH1LAU9MgCMAqIT6pE8XLKMoktyewcH_PBWm5WDcCPE73IC-taupgV620DlXAokbMBTfglZ3Is1g', 'enableUrl': 'https://iot.us-east-2.amazonaws.com/confirmdestination/AYADeINfgMp3rVTf5-3xoynczhEAXwABABVhd3MtY3J5cHRvLXB1YmxpYy1rZXkAREFzR29pVlRkaG9ZU1h4ZGxRNmpVaXA1VzE2ejFFUzFLRUM1K2tiZDJ6L2lGZlFGQVRqdmFmRmNVVjRZSjJxSkpCQT09AAEAB2F3cy1rbXMAS2Fybjphd3M6a21zOnVzLWVhc3QtMjoxMTUxMzc4MDg0Njk6a2V5LzI5ZDk3N2RjLTE0YTMtNDEyMy04MmVhLWUwNmFkNTM3Yzg4MAC4AQIBAHj42jz0rmjO63WB3jUKIJ1w1fg8QxHwam9jYx8vZkGAAwFY1gWZSrGCb6bk0ezr8uKUAAAAfjB8BgkqhkiG9w0BBwagbzBtAgEAMGgGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMueNoF8Bz3IgbUyTpAgEQgDsZ1bf0J3Y7xLPNH62gqGNSdCLuI9vVePGhx3Rx5iIYjrM0UBjP0yRu92HO8Uc34xocD54qzH9TauBLywIAAAAADAAAEAAAAAAAAAAAAAAAAACTbRIpLCB_bnrWBhKHYTj9_____wAAAAEAAAAAAAAAAAAAAAEAAAB1VK-bLSSU-u9fcDKlPIwHpr-dKD-VLJcUJjDefXHOWUKllQfsHtO-SG241GKgOglp5tzVeMhi-RRiteVrjM7m_EAJv98FkA_8Y1yZuUFqhgkbrga2Y-Tkv-crmj3GuHCHrMPu4qoWGxOxCpAvWQe303giCW7EYD6ax4_lj7-2yFztBM5gZABnMGUCMQD-HHTjwM3WJYM8JdTzp-u109Lr97km3JEs3vPra4w8hkluugP0DI0el2dH1LAU9MgCMAqIT6pE8XLKMoktyewcH_PBWm5WDcCPE73IC-taupgV620DlXAokbMBTfglZ3Is1g', 'messageType': 'DestinationConfirmation', '_parameters': {'awsRegion': 'us-east-2', 'device_type_name': 'AWS IoT Devices', 'awsIotRuleQuery': 'SELECT topic(3) as device, state.reported as payload FROM "$aws/things/+/shadow/update"', 'token': 'BBFF-xxx', 'iam_account': '705960257188', 'role_trusted': 'Ubidots_813028286946', 'plugin_version_id': '60c864e14763e72baa70fc8b', 'is_new_webhook_url': True}}

2021-06-15T08:30:36.352607Z stdout: _parameters {'awsRegion': 'us-east-2', 'device_type_name': 'AWS IoT Devices', 'awsIotRuleQuery': 'SELECT topic(3) as device, state.reported as payload FROM "$aws/things/+/shadow/update"', 'token': 'BBFF-IJ7UYpoMslhLOE6yRqnCDDPOTwxozD', 'iam_account': '705960257188', 'role_trusted': 'Ubidots_813028286946', 'plugin_version_id': '60c864e14763e72baa70fc8b', 'is_new_webhook_url': True}

2021-06-15T08:30:36.352619Z stdout: AWS Payload {'arn': 'arn:aws:iot:us-east-2:705960257188:ruledestination/http/f72b6888-e242-4964-9ef6-4c45b4198f44', 'confirmationToken': 'AYADeINfgMp3rVTf5-3xoynczhEAXwABABVhd3MtY3J5cHRvLXB1YmxpYy1rZXkAREFzR29pVlRkaG9ZU1h4ZGxRNmpVaXA1VzE2ejFFUzFLRUM1K2tiZDJ6L2lGZlFGQVRqdmFmRmNVVjRZSjJxSkpCQT09AAEAB2F3cy1rbXMAS2Fybjphd3M6a21zOnVzLWVhc3QtMjoxMTUxMzc4MDg0Njk6a2V5LzI5ZDk3N2RjLTE0YTMtNDEyMy04MmVhLWUwNmFkNTM3Yzg4MAC4AQIBAHj42jz0rmjO63WB3jUKIJ1w1fg8QxHwam9jYx8vZkGAAwFY1gWZSrGCb6bk0ezr8uKUAAAAfjB8BgkqhkiG9w0BBwagbzBtAgEAMGgGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMueNoF8Bz3IgbUyTpAgEQgDsZ1bf0J3Y7xLPNH62gqGNSdCLuI9vVePGhx3Rx5iIYjrM0UBjP0yRu92HO8Uc34xocD54qzH9TauBLywIAAAAADAAAEAAAAAAAAAAAAAAAAACTbRIpLCB_bnrWBhKHYTj9_____wAAAAEAAAAAAAAAAAAAAAEAAAB1VK-bLSSU-u9fcDKlPIwHpr-dKD-VLJcUJjDefXHOWUKllQfsHtO-SG241GKgOglp5tzVeMhi-RRiteVrjM7m_EAJv98FkA_8Y1yZuUFqhgkbrga2Y-Tkv-crmj3GuHCHrMPu4qoWGxOxCpAvWQe303giCW7EYD6ax4_lj7-2yFztBM5gZABnMGUCMQD-HHTjwM3WJYM8JdTzp-u109Lr97km3JEs3vPra4w8hkluugP0DI0el2dH1LAU9MgCMAqIT6pE8XLKMoktyewcH_PBWm5WDcCPE73IC-taupgV620DlXAokbMBTfglZ3Is1g', 'enableUrl': 'https://iot.us-east-2.amazonaws.com/confirmdestination/AYADeINfgMp3rVTf5-3xoynczhEAXwABABVhd3MtY3J5cHRvLXB1YmxpYy1rZXkAREFzR29pVlRkaG9ZU1h4ZGxRNmpVaXA1VzE2ejFFUzFLRUM1K2tiZDJ6L2lGZlFGQVRqdmFmRmNVVjRZSjJxSkpCQT09AAEAB2F3cy1rbXMAS2Fybjphd3M6a21zOnVzLWVhc3QtMjoxMTUxMzc4MDg0Njk6a2V5LzI5ZDk3N2RjLTE0YTMtNDEyMy04MmVhLWUwNmFkNTM3Yzg4MAC4AQIBAHj42jz0rmjO63WB3jUKIJ1w1fg8QxHwam9jYx8vZkGAAwFY1gWZSrGCb6bk0ezr8uKUAAAAfjB8BgkqhkiG9w0BBwagbzBtAgEAMGgGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMueNoF8Bz3IgbUyTpAgEQgDsZ1bf0J3Y7xLPNH62gqGNSdCLuI9vVePGhx3Rx5iIYjrM0UBjP0yRu92HO8Uc34xocD54qzH9TauBLywIAAAAADAAAEAAAAAAAAAAAAAAAAACTbRIpLCB_bnrWBhKHYTj9_____wAAAAEAAAAAAAAAAAAAAAEAAAB1VK-bLSSU-u9fcDKlPIwHpr-dKD-VLJcUJjDefXHOWUKllQfsHtO-SG241GKgOglp5tzVeMhi-RRiteVrjM7m_EAJv98FkA_8Y1yZuUFqhgkbrga2Y-Tkv-crmj3GuHCHrMPu4qoWGxOxCpAvWQe303giCW7EYD6ax4_lj7-2yFztBM5gZABnMGUCMQD-HHTjwM3WJYM8JdTzp-u109Lr97km3JEs3vPra4w8hkluugP0DI0el2dH1LAU9MgCMAqIT6pE8XLKMoktyewcH_PBWm5WDcCPE73IC-taupgV620DlXAokbMBTfglZ3Is1g', 'messageType': 'DestinationConfirmation'}

2021-06-15T08:30:36.352635Z stdout: aws_region us-east-2

2021-06-15T08:30:36.352643Z stdout: iam_account 705960257188

2021-06-15T08:30:36.352650Z stdout: role_trusted Ubidots_813028286946

2021-06-15T08:30:36.352658Z stdout: ubidots_token BBFF-xxxxxxxx

2021-06-15T08:30:36.352665Z stdout: aws_iot_rule_query SELECT topic(3) as device, state.reported as payload FROM "$aws/things/+/shadow/update"

2021-06-15T08:30:36.352675Z stdout: device_type_name aws-iot-devices

2021-06-15T08:30:36.352681Z stdout: Response from AWS, confirming endpoint <Response [200]>

ubidots · June 16, 2021, 3:55am

Hey, It seems that the rule destination was created successfully, but no data is being received from AWS. Also, the fact that you only have 1 plugin log, shows that there’s only been 1 plugin activation.

To troubleshoot, we suggest making sure you’re sending data to AWS in the right topic, and that your payload is consistent with the AWS IoT rule specified:

SELECT topic(3) as device, state.reported as payload FROM "$aws/things/+/shadow/update"

As you can see in this statement, the AWS IoT Rule expects a payload with this structure:

{ 
  "state": { 
    "reported": { 
      "temperature": 23, 
      "humidity":55 
    } 
  } 
}

swkuay · June 16, 2021, 4:16am

How can I edit the rule to a correct statement in the plugin? As once i had changed, the plugin automatically stopped. My topic is just $aws/outTopic and the statement that had test is in correct JSON format too.

ubidots · June 22, 2021, 6:44pm

@swkuay you should edit the rule directly in AWS IoT.

As per your example, if you want the AWS rule to forward data to the plugin, then you want to tell it to grab all data from your topic “$aws/outTopic” and send it in the specified format:

SELECT <your-unique-device-id> as device, state.reported as payload FROM "$aws/outTopic"

Radps · June 24, 2021, 10:23am

i also facing this issue, My device also connected by i cant see any data, my topic is “$aws/things/+/shadow/update” i modified like this, and my aws payload format is

{
“temperature”: 23,
“humidity”:55
} and how can i change the decoding function, i tried many ways nothing workout, help me

and my json format is …
{
“format”: “json”,
“topic”: “$aws/things/84:0d:8e:8c:f8:3c/shadow/update”,
“timestamp”: 1624530392293,
“payload”: {
“Temprature”: 30,
“Humidity”: 11
}
},

dsr · June 24, 2021, 3:01pm

Hello @Radps,

Can you confirm that your device is:

Publishing to a topic following this structure "$aws/things/+/shadow/update", where the + sign is replaced by your device identifier? Note that this topic can’t be only in the payload, it must also be the topic you use to publish.
Publishing a payload with the structure seen at the end: note that the "state.reported" key holds the actual data that will be sent to the Ubidots Plugin because the AWS IoT rule specifies that way as seen in the below

Expected message structure:

{ 
  "state": { 
    "reported": { 
      "temperature": 23, 
      "humidity":55 
    } 
  } 
}

If you’re not following either of the above points, then it makes sense that the data isn’t correctly forwarded. Please make the necessary changes to adjust to the aforementioned indications.

I’ll be attentive should you need additional clarification.

-D

Radps · June 24, 2021, 3:04pm

@dsr thanks for your support,

i think i already have that correct Topic …

dsr · June 25, 2021, 12:47am

@Radps,

Yes, the topic is correct. Now we’re only left with the payload. Are you sending this from a physical device or using AWS IoT core’s publish simulation tool?
Either way, you should send a payload like this:

{ 
  "state": { 
    "reported": { 
      "temperature": 23, 
      "humidity":55 
    } 
  } 
}

Because that’s what the rule expects, otherwise, data won’t be forwarded to the Plugin

Does it make sense?

Radps · June 25, 2021, 3:39am

Thankyou soo much for the help…now i got the clear view…