Skip to content

January 2023

Webhook real-time notifications

We have implemented a new section on the Platform where users can configure multiple webhooks to receive real-time notifications from the platform. Webhooks are currently supported by Dataflow Studio. The user can select a previously created webhook or set up a new one during the DFS job configuration process.

alt_text

Product Enhancements

  • Expanded data through HLL table and Longitudinal APIs

    We have added Spectus proprietary data into the HLL table from Jan 1st, 2019, with more than 1.5M+ DAU for the entire period. We have also added probabilistic HLL data in the HLL table and Longitudinal APIs response, starting from Jan 1st, 2023.

    Finally, we updated our Longitudinal APIs layer by allowing users to select data providers through a dedicated filter. This enables users to choose between the aforementioned new sources and pre-existing sources. Learn more about it in our API documentation.

  • Trino fault-tolerant execution

    We have turned on Trino’s fault-tolerant mechanism that enables a cluster to mitigate query failures by retrying queries in the event of failure. This mechanism is fully transparent for the end user as everything happens under the hood.

  • Visit Engine providers support

    A new enhanced Visit Engine template is now available in Data Flow Studio. This new version works with the last version of Spectus core data assets (paas_cda_v3) and allows users to select certain data providers to be utilized for the visits computation. Furthermore, new data providers are now available for the visit computation!

  • Connected cars enhanced trajectories

    The trajectory asset within the schema vehicle_v1 has been improved with the following changes. New filters now enable users to remove noisy trajectories (unrealistically fast trajectories or those with insignificant distance or time). Moreover, we have added new fields to enable further use cases and to increase functionality of our connected vehicles trajectories. This includes:

  • start and end block_group_id: another geographical dimension of where a car began and ended its trip

  • max_time_gap_seconds: a measure of the trajectory accuracy
  • trajectory_wkt: a string to easily plot and handle all the vehicle_location points composing the trajectory
  • bounding_box_diagonal_meters: another measure of the spatial extension of the trajectory.

Bug fixing

  • Mapbox expiration token on Superset: we have refreshed the Mapbox token used by Superset to show the map charts and avoid 403 unauthorized errors.
  • Improved DFS run creation process: we increased the robustness of the run creation process in DFS that has led, in rare cases, to a failure.