Define date and time properties

When configuring data ingestion from a feed or data source, ArcGIS Analytics for IoT allows you to specify the date and time properties of the data.

Specify date and time configuration

The date and time properties of a feed or data source can be specified on the Identify Key Fields step under the Date & Time section.

Date & Time

The features in a feed or data source may or may not have time fields available.

It is not required to set a Start Time, End Time, or Date Format to analyze and process data. However, some tools in real-time and big data analytics require a start time or a start time and end time to be defined in order to perform temporal analysis.

Additionally, if date information is represented as strings in your input data, a date format is required for Analytics for IoT to successfully parse this string into a date field.

Time types

There are three time configurations available:

  • Neither Start Time or End Time fields are specified. The data has no representation of time, for example, a country boundaries dataset without any date or time fields. Simply leave these parameters empty.
  • A Start Time field is specified. The data records represent their state as of that specific point in time, also known as instant time. For example, sensor observations which record the time of each reading.
  • Both Start Time and End Time fields are specified. The data records represent the state of that feature or observation for that duration of time, also known as interval time. For example, thunderstorm forecast warning polygons with a start and end time of each warning.

Date format - epoch time

If your data represents dates with epoch time values (also known as UNIX time), you do not need to specify a date format. Epoch time is a system for describing a point in time as the number of seconds since 00:00:00 Thursday, 1 January 1970 (UTC). This can be specified as seconds since or milliseconds since this point in time. Example values of epoch time that could be processed by Analytics for IoT without specifying a date format are 1563997859 or 1563997859000.

Date & Time specifying epoch value time

Date format - strings

Dates and datetimes stored in a string field can be represented in many different ways. For example, the following strings refer to the same point in time, but they are represented differently:

  • 2019-08-07T07:02:01.000Z
  • Aug 7, 2019 7:02:01
  • 20190807070201

If you have fields that express date values as strings, you will need to specify a date format so that Analytics for IoT knows how to parse this string into a date. This is done by providing a datetime formatting string in the Date Format parameter. Below are several examples of formatting datetimes:

  • 2019-04-05T12:05:18.095Z
    • yyyy-MM-dd'T'HH:mm:ss.SSS'Z'
  • 12/27/2015 16:39:20
    • MM/dd/yyyy HH:mm:ss
  • 2019-06-01T03:54:09+00:00
    • yyyy-MM-dd'T'HH:mm:ssZZ
  • 2020-06-18T19:13:50.212000Z
    • yyyy-MM-dd'T'HH:mm:ss.SSS'000Z'

Note:

Analytics for IoT supports time up to milliseconds. Any date strings with further precision will need to defined as in the example above.

The complete list of elements that can be used to specify the date format for strings can be found in the table below. Additional information regarding the configuration of a date time formatting string is available for the corresponding Joda time format DateTimeFormat class that is used to convert strings representing dates into date objects.

Date format string symbolMeaningExamples

G

era

AD

C

century of era (>=0)

20

Y

year of era (>= 0)

1996

x

weekyear

1996

w

week of weekyear

27

e

day of week

2

E

day of week

Tuesday; Tue

y

year

1996

D

day of year

189

M

month of year

July; Jul; 07

d

day of month

10

a

halfday of day

PM

K

hour of halfday (0~11)

0

h

clockhour of halfday (1~12)

12

H

hour of day (0~23)

0

k

clockhour of day (1~24)

24

m

minute of hour

30

s

second of minute

55

S

fraction of second

978

z

time zone

Pacific Standard Time; PST

Z

time zone offset/id

-0800; -08:00; America/Los_Angeles

Date & Time specifying string format time to be converted

Date format - Esri date fields

If your data has date or date and time information stored in a date field, you do not need to specify a date format. Feature layers, shapefiles, and Parquet files can hold date fields that store date or date and time values. Analytics for IoT can load date and time values from such fields without any additional properties or settings needed.

Date & Time specifying Esri date fields