Release notes for 2.38.10

Overview:

The primary focus of this major release is to update various data infrastructure to RAPIDS 2021.10, infrastructure for Organizations (next release), and significantly upgraded web APIs, such as for use with the new "Graphistry for PowerBI" integration. Except for potential changes in JS, it is backwards compatible, and includes the standard set of smaller fixes and upgrades.

Highlights

• Features
  • New JS+React API
  • Preview: Graphistry for PowerBI
  • Color blind safe palettes
  • Cross-origin (CORS) embedded API calls
• Infrastructure
  
  • RAPIDS 2021.10 
  • Drop license dependencies on Anaconda, Inc.
  • Nvidia Docker baseline
  • Experimental helm charts
• Admin
  
  • Experimental: Live local Postgres backup loader
• Fixes & tweaks
  • Categorical columns now supported
  • streamgl-gpu autohealing
• Docs
  • Databricks notebooks and dashboarding
  • Trovares notebooks
  • JavaScript+React Storybooks
  • Main dashboard
• Migration

Graphistry Versions

Server	2.38.NEXT
JS React+Vanilla	4.0.0 (was 3.7.6)
Python PyGraphistry client	0.20.5 (was 0.20.1)

Third-Party Versions

Caddy	2.3.0
CUDA (In-Docker)	11.0
Dask	2021.9.1
Django	3.1
Docker (CE)	19.03.2
Docker Compose	1.24.1
Elasticsearch node driver	14.2.2
fsspec	2021.10.0
Gremlinpython	3.4.8
Jupyter	1.0.0
Neo4j-python-driver	4.1.0
NodeJS	14.6.1
Pandas	1.3.3 (was 1.2)
Postgres	12.5
Python	3.7.10
Neo4j node driver	4.1.1
networkX	2.6.3 (was 2.5)
Notebook	6.4.4 (was 6.2.0)
RAPIDS	21.10.01 (was 0.19)
Arrow	5.0.0 (was 1.0.1)
Splunk node SDK	1.9.0
Tornado	6.1

Features

• New JS+React APIs: Primarily backwards compatible via built-in shims; adds React 17 support, switches to more recent RxJS conventions, new Storybooks for JS + React usage, added multiple bundle format support 
• Preview: Graphistry for PowerBI: Contact our team for early access
• Color blind safe palettes: When using the encodings color picker, you can now filter for color safe palettes
• Cross-origin (CORS) embedded API calls: The JWT API routes now support cross-origin calls from browsers, meaning you can now build client-only embedded Graphistry apps

Infrastructure

• RAPIDS 2021.10: Ecosystem update - see above version upgrades for Arrow, Pandas, RAPIDS, Protobuf, and more
• Drop license dependencies on Anaconda, Inc.: Due to Anaconda, Inc. universally revoking  open source licensing of conda default channel use, we have removed its use to avoid license complications for teams. (We previously already replaced use of conda with mamba.)
• Nvidia Docker baseline: Previous base containers used a custom install of mamba+RAPIDS; the new containers base on the official RAPIDS container
• Cron restarts: Environment variable CRON_RESTART now triggers scheduled restarts for some containers based on the cron format, with per-container overrides of FORGE_ETL_CRON_RESTART, STREAMGL_VIZ_CRON_RESTART, STREAMGL_GPU_WORKER_CRON_RESTART . Defaults to restarting services 2x a day.
• Experimental helm charts: Contact our team for early access

Admin

• Experimental: Live local Postgres backup loader Updater will now only stop & restart the Postgres service, leaving the others up

Fixes & tweaks

• Categorical columns now supported: Arrow uploads of categorical columns are now supported, which may aid in smaller upload sizes such as for string columns. However, due to RAPIDS limitations, we internally expand them to the base dtype.
• streamgl-gpu autohealing: Was not actually triggering on worker node failures

Docs

• Databricks notebooks and dashboarding
• Trovares notebooks
• JavaScript+React Storybooks: Various features and calling conventions now live documented using Storybooks
• Main dashboard: Login area now links individual connectors

Migration

See previous notes.