Skip to content
Data Ocean

Data Ocean features

Trimble Data Ocean offers these features.

Filesets

Filesets, or archives, allow users to group a collection of files within an object, simplifying the management of files so users do not need to create unique File IDs or access links to get to the content.

Filesets are uploaded in a compressed format (zip, tar, or gzip) and uncompressed within Data Ocean. Users can then utilize the manifest and URL template to access content from within the archive.

Example use cases:

  • Displaying content within a map, you can manage a collection of files that are accessed using a URL template to simplify the display of map tiles within a browser.
  • Storing a collection of files that make up a website.

Support and master files

A master file is any file created in the system. Files uploaded to Data Ocean can have associated support files like thumbnails for full-sized images. Each support file is associated with a particular version of the master file by adding the master_id to the creation payload. When a new version of the master file is created, it will have no support files.

If a master file is deleted, all associated support files are deleted.

Malware scanning

Upon upload to Data Ocean, files are automatically scanned. The malware scanner decompresses archives before scanning up to 16 sub-archives deep.

Once a file has been scanned, you can check the response status and see if it was quarantined. If it was, you can temporarily access the file to update it or delete them. If files are flagged as infected, they will be stored for 30 days, and then permanently deleted.

Our malware scanning service currently leverages BitDefender.

Regional storage

Data Ocean regions allow you to host/store your data closest to your application stack, to address data residency concerns, optimize for performance, and to create redundancy of your files for disaster recovery (leveraging regional replication), failover, and resilience.

Data Ocean currently supports the following regions. Additional regions can be supported upon request and with business justification. See also List of AWS and Azure server regions.

Please reach out to support if you are interested in support for additional regions.

Backups

While Data Ocean relies on the different cloud providers for data resiliency provided, the service puts the user in control of regional replication for additional backup functionality. The user can decide how many and which regions to use as backups depending on the cost, criticality of data, and applicable data residency and compliance regulations.

File sharing with access control list settings

Data Ocean users gain the ability to share files/objects and directories between applications, enabling Trimble applications to have shared file stores by configuring sharing between the applications managed through Trimble API Cloud.

Users can modify the Access Control List (ACL) parameter for their Data Ocean file or directory to identify applications that may have shared access to a particular Data Ocean file.

Files may not be accessible if the restricted_access parameter has been set to true.

Public/private object access

Users can configure files to be either restricted (signed) URLs or public URLs. By modifying the restricted_access parameter, the URL can be configured to share publicly across the internet while restricted files would be signed each time the file is accessed and only available based on the URL Expiration (restricted_access).

You can only add the public/private status during the creation of a file. To change the status, upload a new version using the restricted_access parameter.

Customizable URL duration

By default, the file upload URL duration is set to 60 minutes (60m). By configuring the url_duration parameter upon upload, you can modify the length of time the file upload URL will be accessible, after which a subsequent GET call is required on the file to refresh the file upload URL.

Object duration and expiration

Trimble developers can leverage this feature to manage and control costs by offering temporary storage solutions or defining expiration on temporary files that aren’t needed by your application in the long term (for example, support files).

Users can set an expiration date on objects only during the initial creation of a file. There is no default for the expires_at value; if a value is not set, the file will not expire. Once a file expires, it will be deleted.

Content delivery network

Data Ocean leverages AWS’s Cloudfront content delivery network to provide a globally-distributed network of proxy servers as a caching layer to accessing Data Ocean content. If users access files/objects from an edge location, that content will be cached locally and improve the availability and performance of accessing those files – which becomes especially important for large files.

You may modify the response-cache-control to customize the availability of a file in the cache.

Multipart object upload and download

Multipart uploads/downloads ensure resilience by chunking the object into parts. This allows you to upload large files, create parallel uploads, and retry parts to eliminate data loss as chunks are uploaded.

Object versioning

You can create different versions of a file object. When you associate files as new versions, they are treated as a set. If you delete a file object, all versions associated with that object are also deleted. Previous versions cannot be modified.

Cost optimization

Data Ocean is focused on making it easier for Trimble to save on storage while scaling to support our applications:

  • Intelligent Storage. By default, Data Ocean takes into account the access frequency of stored data and will transfer data between intelligent tiers for automatic cost reduction.
  • Support Files. Flag objects as a support file (such as .SHP files) to link supporting files to a master file. If the master file is deleted, copied, or moved, the supporting files will remain linked.
  • File Versions. When deleting a file object, all versions are deleted in the set.

Security and compliance

  • ISO 27001K compliant
  • Data encryption at rest and in transit
  • Trimble Identity v3 OAuth 2 integration (2- and 3-legged OAuth) via Trimble API Cloud

Interoperability

  • Processing Framework. Data Ocean operations can be performed within Processing Framework to provide users with connectors for uploading/downloading files for managing input data and processed data.
  • Search. Users can leverage Data Ocean and DataHub by ingesting data from Data Ocean into the DataHub service for searching data within Data Ocean based on a defined schema.

Data Ocean limits

Path and filename character limits

  • Each part of a path (or filename) must not exceed 255 characters. The full path must not exceed 1024 characters.
  • Fileset manifest entries must not exceed 255 characters for the full manifest entry path.

Data Ocean events

Data Ocean uses Trimble Event Service to notify users of processed CRUD operations. Data Ocean event notification currently supports update and delete operations on files, delete operation on directories and renaming operation on directories.

To read more and subscribe to Data Ocean events, see the documentation for the Events Service.