6. Manage measurement data - Meas Hub#

Meas Hub v1.6.0

6.1. Display the list of measurements#

In a web browser, open the Meas Hub application ( <base_URL>/measurements/ ). If you already have an intdash application open, you can also go to Meas Hub by clicking the applications button at the top right of the screen.

The list of measurements stored in intdash is displayed. A measurement is a collection of a series of time series data points acquired at an edge.

../_images/measurements-list.en.png

Fig. 19 Measurement list (card type display)#

1 Switch display format

2 Search box (Search using the measurement name or description string. See Find measurement.)

3 Filter (Set conditions to narrow your search. See Find measurement.)

4 Delete (Move the selected measurement to the Trash. See Delete the measurement.)

5 Change status (Changes the status of the selected measurement)

6 Switch between ascending order and descending order according to the base time

7 Measurement details (see Check the measurement details for each item; see Display a list of markers included in the measurement for markers.)

8 Links to other applications (displayed only in some environments)

Hint

By bookmarking the URL of the list screen or detail screen with a web browser, you can quickly access the same information from the next time.

  • When you change the order, search, or specify a filter on the list screen, the URL of the current list is displayed in the address bar of the web browser. By bookmarking this URL, you can display the list with the same conditions next time.

  • The UUID of the measurement or marker is used for the URL of the individual measurement or marker page. For example, the details screen for the measurement UUID "ca3a...7964" looks like <base_URL>/measurements/ca3a ... 7964.

6.2. Find measurement#

On the search list screen, you can narrow down the measurement by using the search box and filter.

Search box ( search )

You can search for the following.

  • Measurement UUID, name, description

  • Measurement marker UUID, name, description, tag key, tag value

  • Edge UUID, name, nickname, description

You can search by AND condition by separating keywords with spaces. The search is not case sensitive.

Filter (filter)

You can narrow down the measurement by conditions such as the measurement start date and time, the measurement length, and the type of base time selected. You can search by AND condition by separating keywords with spaces. See Check the measurement details for the meaning of status, protection, etc. See Check/change the base time of measurement for base times and Display a list of markers included in the measurement for markers.

../_images/filters.en.png

1 Filter conditions

2 Number of measurements that match the current filter conditions

3 Remove filters

4 Close the filter setting screen

Note

  • Searching and filtering is done only for the data that has been loaded into the browser. If you want to display or search for all measurements on the server, set [Number of Measurements Loaded into the Browser] to [Unlimited] in [Preferences] of Meas Hub.

  • Measurements in the trash are not subject to search or filtering.

6.3. Check the measurement details#

Click [Details] of each measurement in the measurement list to display the measurement details.

../_images/measurement-details.en.png

Fig. 20 Measurement details#

Protected measurement (protected)

Indicates that this measurement is protected. Protected measurements cannot be moved to the Trash. Use the [Protected] switch on this screen to turn protection on/off.

Delete (delete)

Move this measurement to the Trash. See Delete the measurement.

Links to other applications (more-options) (Displayed only in some environments.)

View this measurement in other applications.

UUID

This is the unique ID given to this measurement.

Status

The following three statuses are available.

  • Measuring (sending data to the server in real time)

  • Resending (sending data that was not sent in real time to the server)

  • Finished (other than the above)

If a measurement is in progress or being resent, it can be terminated by clicking the status display on Meas Hub.

Processed Ratio

Measurements are sent to the server in units called "sections". The processed ratio is the percentage of sections that have been processed (for example, stored) on the server.

Show Sections

The section details are displayed. You can see which sections are unprocessed.

Duration

The length of the measurement.

Edge

The name of the edge that performed the measurement. Click to see the edge information in the Edge Finder. If you see "GHOST EDGE" as the name of an edge, it means that the information for that edge does not exist (for example, the edge was deleted).

Name

You can give the measurement a descriptive name.

Description

You can add a description to the measurement.

Base Time

You can select which time to use as the base time (measurement start time). See Check/change the base time of measurement for more information on base times.

Protected

You can protect your measurements. Protected measurements cannot be moved to the Trash.

Created At

The date and time the measurement was created on the server.

Updated At

The date and time when the measurement information was last updated.

Data ID

Displays a list of data IDs of time series data points included in this measurement. You can see what kind of data is included in the measurement. For more information on IDs, types, and channels, see iSCP 1.0 Essentials.

6.4. Check/change the base time of measurement#

The "base time" of measurement in intdash is the start time of measurement. intdash allows a measurement to have multiple base times, and you can change which one to use at any time.

The measurement details screen shows the base time currently in use. You can also select, add, edit, and delete a base time. If you change the base time to be used, the start, end, and markers for that measurement will all be displayed based on the new base time.

The types of base time are as follows.

Edge RTC

The time based on the edge real-time clock (RTC).

NTP

The time based on the edge side clock synchronized with the NTP server.

GPS

The time based on the edge side clock synchronized with GPS.

API First Received

The time when this measurement was first received on the server side.

Manual

The time set manually. If you click [Add] and manually set a new base time, the type of this new base time will be Manual. Only the base time of the Manual type can be edited.

For more information on measurements and base times, see iSCP 1.0 Essentials.

6.5. Display a list of markers included in the measurement#

Click [Markers] on the measurement details screen to display a list of markers set for that measurement.

You can add a marker to a specific time point or a specific time range in your measurements. A marker attached to a specific time point is called a "point marker", and a marker attached to a specific time range is called a "range marker". By attaching a marker to the measurement, it is possible to perform operation only on that specific point or range.

Note

Markers cannot be added on the Meas Hub. Markers are created on the edge side at the time of measurement, or added using other tools such as the intdash SDK.

Markers can be given a description or a tag with a key-value pair.

../_images/markers-timeline.en.png

Fig. 21 Marker list (example of timeline type display)#

1 Switch display format

2 Show/hide

3 Delete selected marker

4 Marker details (see Check the details of a marker for each item.)

6.6. Check the details of a marker#

Click [Details] of each marker on the marker list screen to display the marker details.

../_images/marker-details.en.png

Fig. 22 Marker details (example of a range marker)#

Delete (delete)

Delete this marker.

Links to other applications (more-options) (Displayed only in some environments.)

View this measurement in other applications.

Marker time(or marker start and marker end)

For point markers, the marker time is displayed. For range markers, the marker start and marker end are displayed.

UUID

The unique ID given to this marker.

Edge

The name of the edge that performed the measurement. Click to go to Edge Finder.

Name

You can give the marker a descriptive name.

Description

You can add a description to the marker.

Tag

Markers can be tagged with key-value pairs.

Created At

The date and time when the marker was created.

Created By

The name of the edge that created the marker. Click to go to Edge Finder.

Updated At

The date and time when the marker was last updated.

Updated By

The name of the edge that updated the marker. Click to go to Edge Finder.

Note

If you see "GHOST EDGE" as the name of an edge, it means that the information for that edge does not exist (for example, the edge was deleted).

6.7. Upload a CSV file to create a measurement#

You can upload a CSV file to create measurement data on intdash.

One CSV file is converted into one measurement. Measurement is a set of data from the start to the end of measurement.

6.7.1. CSV file format and how data is stored in intdash#

The CSV file uploaded to intdash must meet the following conditions.

  • Must be encoded in UTF-8. If you use an encoding other than UTF-8, multibyte characters such as Japanese may be garbled.

  • The first row (header row) stores the name of each column as a character string (these names are used as data IDs).

  • The first column (timestamp column) should store time stamps.

    • The name of the timestamp column in the header row must be time.

    • The time stamp must follow RFC 3339.

  • Data must be stored in the format of numerical values or character strings in the second and subsequent rows and the second and subsequent columns (data area).

../_images/csv-content.png

Fig. 23 Contents of CSV file (example)#

The data in each cell in the data area is stored in intdash as one data point. In the above example, since the data in 3 columns exists at 5 time stamps, they are stored as a total of 15 data points.

Each data point is given type information according to the notation in the CSV file.

  • Data expressed as integers are treated as Ints (integer type)

  • Data expressed as decimal values are treated as Floats (floating point type)

  • Data expressed as character strings are treated as Strings (character string type)

In the above example, the data ID "DATA_1" is treated as Int, the data ID "DATA_2" is treated as Float, and the data ID "DATA_3" is treated as String.

Also, the channel will automatically be 1.

6.7.2. Upload CSV file#

  1. Click [Measurement Uploads] on the Meas Hub side menu.

  2. Click [Create Measurement from CSV] and select which edge the data is from.

    ../_images/choose-edge.en.png

    Fig. 24 Select an edge#

  3. Click [Proceed to File Selection], select a CSV file and upload it.

    When the CSV file has been sent successfully, the new file will be displayed in the file list.

    Please wait for a while until the status of the uploaded file becomes "Succeeded".

    ../_images/uploaded-files.en.png

    Fig. 25 List of uploaded files#

    If you have failed to create a measurement, click [Details] and check the "Conversion Result".

    Note

    If you upload a file with the same name multiple times on the same day, a random string will be added to the file names (eg WXeiMUYkBU_sample.csv).

  4. The UUID of the measurement created by uploading is displayed in "Created Measurement". Click to go to the measurement details screen.

Attention

If you see a message "Upload to the server has failed. Please try again.", upload the file again. If you get the same message again, there may be no space on the server to store the CSV file (usually the CSV file storage area is 10GB).

If the intdash server you are using is operated by aptpod, please contact us to expand the storage. If the server is operated by you, please expand the storage by yourself.

Deleting uploads on the "Measurement Uploads" screen in Meas Hub will not increase free space.

Note

Selecting a measurement upload in the list and clicking [Delete] will delete information about that upload. The measurement itself created by the upload will not be deleted.

6.8. Delete the measurement#

To move a measurement to the Trash, select the measurement in the measurement list and click [Delete], or click [Delete] on the measurement details screen. Measurements moved to the Trash will be automatically deleted after 24 hours.

../_images/measurements-list-delete.en.png

Fig. 26 Delete measurement#

Click black-delete (Trash) from the menu on the left side of the screen to display a list of measurements in the trash.

../_images/trashed-measurements.en.png

Fig. 27 List of measurements in the trash#

Click on the measurement's restore (Restore) to restore the measurement.

You can click black-delete (Delete Permanently) to permanently delete the measurement without waiting for it to be automatically deleted.

You can restore or permanently delete measurements in bulk by selecting multiple measurements and then clicking [Restore] or [Delete Permanently] at the top of the window.

6.9. Change the display preferences of the Meas Hub application#

Meas Hub preference settings are made in [Preferences].

The following items can be configured.

These settings are saved in the web browser, so they will not be applied to the Meas Hub application opened in another web browser.

Number of Measurements Loaded into the Browser

Measurements up to the number specified here are loaded into the browser, starting with the measurement with the latest base time.

For example, if you set to load 1000 items, up to 1000 items will be loaded into the web browser in order of newest to oldest.

If the page takes a long time to load, you may save time by reducing this value.

Note

  • Sorting, searching, and filtering of the list is done only for measurements that have already been loaded into the web browser.

  • Measurements without a base time are treated as old data (base time 1970-01-01 00:00 UTC) and will have a lower priority for loading.

Results per Page

Set the number of measurements displayed on one page of the measurement list screen. If the page takes a long time to load, you may save time by reducing this value.

Display of Markers in Measurement List

When turned on, the list of markers is expanded in the measurement list screen.

Note

The display language and time zone can be set in [Preferences] (<base_URL>/edges/me/preferences) on My Page, not in Meas Hub. The settings are applied to Meas Hub.