Platform

New Features

1. Data Sandbox.
Data Sandbox is an isolated environment using which data can be exposed for purpose of conducting data science experiments. Data can be uploaded to sandbox via manual upload or via data pipeline.
1. Admin Setting- S3 as Storage / Network Storage based on the configuration.
2. Supported file types: CSV/Excel/Text/Video/Image/Audio
2. Data Catalogue.
1. Pipeline integration.
2. Data classification
3. Data Center: MongoQL connector is supported to create Data Store.
4. POST call for Data As API.
5. Security Remediations:
1. Log4j upgrade to 2.17.1
2. UI library updates
3. CORS Multiple origin support

Enhancements

1. Enhancements in the ‘Publish to group’ function of Dashboard.
When a new user gets added to a group, all the dashboards published to the group will be accessible to the user. When the user gets removed from that group, the user losses access to the dashboard as well.
2. Data As API Enhancement
1. Option of Custom Message for No Data
2. Response code, status code Enhancement

Fixes

1. Some more Security Remediations:
1. Unauthorized Access to Document (getWikiByDocld, getdocumentinfobyid)
2. Unauthorized File Upload (Bulk user creation)
3. Unauthorised Access to Notifications
4. User Data Disclosure- Prevent access of other user details
5. Persistent Cross-Site Scripting
6. Username Enumeration (Generis message for forgotten password functionality)
2. Changes and fixes for SSO support in Multitenant
3. Admin Module – UI Additions for Pipeline multiple namespace support
4. Data set query change: using the ‘db’ variable instead of database name in a query
5. Session Token in URL Security Fix
6. Input Validation Weaknesses Security Fix
7. Untrusted Inclusion of Code from Remote Hosts Security Fix
8. HTTP Security Headers Not Implemented Security Fix
9. Information Disclosure Security Fix

Self Service

New Features

1. MongoDB as a data store is available.
2. NLP Support provided for MongoDB Data Store.

Dashboard Designer

Charting

Enhancements

1. Filter Component: Title enhancement
2. Chart auto-axis enhancements
3. UI Enhancements- Multi-select Combo box design updates
4. Grid - Tooltip styling updated
5. Map Chart- Tooltip enhancements for font color and padding

Designer

Enhancements

1. Custom Export to Excel- Control for filter while exporting to excel & update filter conditions from rows to columns.

Data Pipeline

New Features:

1. Introduction to Grace period in basic info of component: user can now give a grace period for components to go down gracefully after that time
2. Support for Kubernetes 1.21 and Mongo 5.0
3. Component Monitor, a monitoring system component has been provided to kill the orphan pods.
4. New Writer: Python Writer component is introduced.
5. Event Mapping feature: Now the user can map events or ingest data from topics that belong to the same Kafka server as pipeline.
6. Log Manager Component: A System component for managing Pipeline Logs.

Enhancements

1. Enhancements in system components for more stability.
2. Advanced Logs – UI enhancements implemented in Pod age and create time.
3. Pipeline Migration Enhancements:
1. Pipelines with the Mapped topics will also be migrated now.
2. The events will be created with the same topic partition and retention time as the source pipeline.
4. Pipeline Monitoring framework enhancements:
1. Earlier the values shown in percentage are fetched now from the Kubernetes API.
2. Multiple instances of the docker components are shown with aggregated total records.
5. Event time retention enhancements.
6. Event time UI enhancements.

Fixes

1. Multiple instance fix for batch components.
2. Orphan Pod fixes

Data Science Workbench

New Features

1. New Data Preparation components: Auto Preparation, Group By, Text Vectorization
2. New Algorithms: SVM, Light GBM
3. Mongo QL connector integration with limit enhancement

Enhancements

1. Limit fix in MongoQL connector: Added Optional and Mandatory fields in MQL connector
2. Changes to accommodate security fixes in DSW: Fix for filter XML changes added to R and Python services.
3. Python Workspace: Functionality improvement enhancements are done for the following algorithms:
1. Elastic net
2. LDA Prediction
3. Catboost Regression
4. Perceptron
5. Catboost classification
6. K nearest neighbours
7. Bagging
8. ADABoost
9. Extremely Randomized Trees
10. Gradient Boosting Model
11. XGBoost
12. Decision Trees
13. Interquartile Range
14. Isolation forest
15. K means++
16. Hclustering
17. Kmeans
18. Optimal k-value
19. Factor Analysis
20. LDA Feature selection
21. Principal component analysis
4. Mongo QL data connector with limit enhancement

Data Preparation

New Features

1. Updated jQuery version.
2. Removed third-party libraries.

Data Science Lab

New Features

1. Data Science Lab is introduced into the Platform with the following features
2. Project Creation with specific configurations for Environments, Resource allocation, etc.
3. Projects will be capable of mentioning external libraries to be installed and providing server specifications.
4. Introduced functionality to fetch data from Database and Data Sandbox.
5. Notebook - Create, Save, and Download functions are available.

Please Note:

1. The Data Science Lab is a Beta Release.
2. Upgraded the UI library version to the latest for Platform (core), Business story, Designer, Data Pipeline, Data Preparation modules.