Website (Poll)

The Website (Poll) data source in ArcGIS Analytics for IoT will send an HTTP request to the specified website URL. This will collect any data that could be retrieved in a web browser via simply browsing to the same URL.

Example

A GIS analyst wants to load district polygons stored in a CSV file on a web server into Analytics for IoT.

Usage notes

  • The website must be externally accessible on the Internet.
  • The size of the web page or file being polled cannot exceed 8 MB. If the website or file being polled exceeds 8 MB, features will not be ingested.
  • After configuring source connection properties, see Configure input data to learn how to define the schema and the key properties.
  • Both the URL parameters and Custom headers parameters can make use of analytic global variables for recurring big data analytics. When analytics run, these global variables translate into epoch time (milliseconds since January 1, 1970 UTC). The following outlines the available analytic variables and what time they represent.
    • $analytic.AnalyticLastScheduledStartTime—Time the last run of the analytic was scheduled to start.
    • $analytic.AnalyticScheduledStartTime—Time the current run of the analytic was scheduled to start.
    • $analytic.AnalyticLastEndTime—Time the last run of the analytic ended.
    • $analytic.AnalyticStartTime—Time the current run of the analytic started (note the difference between this and $analytic.AnalyticScheduledStartTime is the startup delay.

Parameters

ParameterExplanationData Type

URL

The full URL to the externally accessible website.

String

HTTP method

The HTTP method to utilize for the website (either GET or POST).

If POST is selected, optionally specify a message body.

String

POST body

A message body to be included when sending a POST HTTP request.

This parameter only applies when HTTP Method is set to POST.

String

Authentication

The type of authentication to access the web server. Authentication options include None, Basic, and Certificate.

String

Username

The username for accessing the website.

This parameter only applies when Authentication is set to Basic.

String

Password

The password for accessing the website.

This property only applies when Authentication is set to Basic.

Password

Certificate URL

The URL location of the client certificate for accessing the website.

This parameter only applies when Authentication is set to Certificate.

String

Password

The client certificate password, if one is set.

This parameter only applies when Authentication is set to Certificate.

Password

Custom headers

Optional custom headers to be included in the HTTP request that is sent to the specified website.

For example, custom headers can be used to specify a third party API key or authorization header.

Supports analytic global variables.

Key-Value Pair

URL parameters

Optional URL parameters to be included in the URL of the HTTP request that is sent to the specified website.

While parameters can also be set in the URL parameter above, the URL parameters entered here as a separate property will override any matching parameter supplied in the URL parameter.

Parameters defined in this property will always be URL encoded.

Supports analytic global variables.

Key-Value Pair

Considerations and limitations

  • The website must be externally accessible on the Internet.