I get the banner that data extraction limit exceeded 51,xxx … However, when I go to My Account and check usage for today (9/11) it shows Dots Out (API) as 19,942. I have no problem if I exceeded the daily limit. However, is the usage table current or does it lag actually use.
Some of this is addressed in thread:
But the question about account usage being low vs. message being displayed was not answered. It was stated that it was possibly a bug in the account usage page. Is this true or is the count wrong.
So the 51.xxx looks suspiciously like a total of 2 days of in+out
Hi @Jmchep,
Thank you for letting us know about this situation. The Dots Out is the sum of the dots extracted through two (2) outbound channels.
- API : Data requested by external applications or devices from our API
- Front-end: Data requested by the web interface (Dashboard and devices). This includes all the queries required to render dashboards, CSV reports, variables, etc.
The dots out consumption are only visible in the profile usage by the end of the day, the count reset at UTC 00:00. We already checked the count of both dots out and in and the counting is working as expected.
I hope I have clarified your doubts and concerns about this, if not pleas let me know.
All the best,
-Isabel
Yep understand the concept but the reality is that without immediate feedback from viewing a dashboard, changing to a different device and displaying a variable, etc… it is virtually impossible to get a feel for how many dots are being consumed. I realize I am only using as a hobby for an ispindel but I find this frustrating to not have a way to actually have a live dot counter.
I really am impressed with what I can create in the dashboard. Also, I think the STEM account for schools and hobbyist is cool both in terns of marketing and spreading the concept of IoT. I do work for an environmental firm that does field studies where we employ many data collection devices. I can definately see using this in addition to our own data collection services. My guess is that this is not an issue in paid accounts because Dots can be counted in developed apps. If not, I would find this a severe limitation.
Hi @Jmchep,
Please receive my apologies for the delay in replying to your note. Thank you for your valuable feedback. I will add a feature request to add a live counter in the Dashboards to show how many dots are being consumed by each one. In our paid plans, there is not a daily limitation as we include in all Ubidots paid plans dots in and out in order of millions that generally cover the consumption of most users, otherwise, it will be billed the additional dots consume.
All the best,
-Isabel
Absolute beginner Ubidots STEM user with same problem. I seem to have exceeded the daily quote of data extraction but looking at the usage it was last updated for sept 25th, which I suppose is not correct.
edit: I now understand it is not the calender day, still don’t understand how i got to + 40k data extraction. Is it normal that I cannot see my data anymore ?( Error loading your data
Something went wrong on our end and we were unable to load your data.)
Hi @ArdLab
Thank you for extending us your questions.
The count of dots out and in is made at 00:00:00 UTC. We are working on a way to show this consumption base on the timezone of the accounts, to be more clear. Now, regarding your question of the Error loading your data message, yes, it is normal, the message appears once you have reached out the dots out for the day.
Best,
-Isabel
Data extraction limits are tripping me up. Mostly because I don’t understand Ubidots’ system of using and tracking Dots.
A simple explanation of “dots in” and “dots out” and “data extraction” and how they relate to the web interface would help. It took me a lot of searching to figure out that a web page widget refresh caused data extraction. Am I right about that?
If that is correct, I will try to do fewer screen refreshes.
Please provide more complete documentation of Dot usage so that users can use methods to avoid using up all their Dots.
thanks, john
Hi @jcolema1,
Thank you again for your feedback, it is valuable as it is something that has happened to other users, and we certainly don’t want to be a bump in the road for their IoT initiatives. Let me explain and clarify how the dots out and in consumption works:
Dots in : All the dots received and saved from any channel, Dashboards and API.
Dots Out : The sum of the dots extracted through two (2) outbound channels.
- API : Data requested by external applications or devices from our API. Meaning each value extracted using any of our supported protocols (MQTT, HTTP, TCP/UDP).
- Front-end: Data requested by the web interface (Dashboard and devices). This includes all the queries required to render dashboards, CSV reports, variables, etc. Having that in mind, yes refreshing a Dashboard, or exporting data will consume dots out.
Both consumptions are visible in the profile usage by the end of the day. The count reset at UTC 00:00. The following are measures that you can take to avoid reaching out to the daily limit.
- Refresh the Dashboards only when necessary.
- Set a short time in the Default time range of the Dashboard, so the first time you open the Dashboard, this one only requests the last data.
- Reduce the frequency of data extraction trough API.
Finally, I went ahead and increased your dots out capacity to 40,000 per day, to avoid you hit any limits during your IoT application’s development.
I hope my note clarifies your concerns and let me know if you have additional comments.
All the best,
-Isabel
Isabel,
thanks for your response and the dots boost.
I don’t object to the limit Ubidots sets for STEM.
What caused me problems was the difficulty in figuring out why I was exceeding the limit. Clearer error messages and more complete documentation would have saved time.
thanks,
john
p.s. I hope you mean you boosted me to 400,000 dots per day, not 40,000 because I think the standard STEM limit is 50,000/day. I fear that you made a typo because I am again today getting the message “Error loading your data”
Hi @jcolema1,
Please receive my apologies for my mistake, you are correct is 400,000 dots per day, not 40,000. You should be able to see the data now.
Intending to explain this consumption much better, we have created the following article in our help center. Please let me know if you have any additional comments.
All the best,
-Isabel
Isabel,
I read the article and feel that adding the language that you posted in this forum (see below) to that help article would improve it. The key for me was understanding that a refresh of a browser page containing a dashboard widget can use lots of dots. thanks, john
1 Like
Hi @jcolema1,
Thank you for your feedback and suggestion. Be sure we will improve the article by adding more explanations and examples.
Have a nice day!
-Isabel
Hi,
I’m here with a similar problem with dots limits. I do understand all you wrote above, but i’m not sure how i can generate so big dot-traffic with 2 devices, 5 variables each, and 5 synthetic.Each device refreshes twice per hour.
How can i reduce this consumption?
Good day @x1d,
I hope you are doing fine.
In Ubidots there are two types of dots, dots in, which are the ones received and saved from your device, and the dots out that can be consumed when any of the actions below is executed:
- Load data in the variables view.
- Load data in any of your dashboards, including public dashboard links that you may have previously shared.
- Refresh Dashboards.
- Export data to CSV/Excel from your account.
- Extract data from your devices using 3rd APIs or scripts using any GET request.
- Extract data using MQTT subscriptions or any HTTP GET request.
The following are measures that you can take to avoid reaching out to the daily limit:
- Refresh the Dashboards only when necessary.
- Enable the Real-time option of the Dashboard only when needed.
- Set a short time in the Default time range of the Dashboard, so the first time you open the Dashboard, this one only requests the last data.
- Reduce the frequency of data extraction through API.
Finally, I went ahead and increased your dots out capacity per day, to avoid you hit any limits during your IoT application’s development.
I hope this information helps you understand the reason for your dots out consumption. If there is anything additional support we can bring you, please let us know.
All the best,
-Isabel
Hi Isabel,
Thank you.
To be sure I understand dots out counting: when I have a graph on my dashboard, 1 day long, with two variables refreshed each 30 mins it contains 2422 dots exported every time I refresh the dashboard?
All the best
K
Hi @x1d,
To make this calculation correct, we will need the frequency of the data sending. Let’s suppose you send data every 10 minutes to both variables, so the data you send on a day will be:
2 dots x 60/10 updates per hour x 24 hours = 288 dots per day
If you refresh the Dashboard every 30 minutes and the graphs display data for one day long, then, you will be consuming 13,834 dots out per day.
All the best,
-Isabel
Hi Isabel,
OK I understand. My problem is too “dotted” dashboard, sometimes there may be 2-3 weeks of data (2 graphs of 2 variables, 48 times a day) and I didn’t know that every page refresh generates dot traffic, so I will try to do this in once or twice a day as needed.
Thanks again for improving the limits and clarification
hugs
K.
Hi @x1d,
Sure, please let me know if you need additional clarification or assistance.
Have a nice day!
-Isabel