Platform

New Features

1. Admin Module:
1. Migration- The Report Migration feature enables the migration of self-service reports.
2. BI Workflow:
1. Implemented Data Preparation within the Report module to introduce the BI Workflow.
3. Data Center:
1. Introduced the Athena Data Connector (without Data Store).
2. Added Azure Cosmo DB support for Mongo and Postgres databases.

Enhancements

1. Admin Module:
1. Implemented tenant-specific Configuration and Validation details.
2. Report Burst:
1. Included tenant and server details in email notifications for Report Burst.
3. Data Center:
1. Enhanced UI for List pages of Data Connectors, Data Sets, Data Stores, Data Sandbox, Data Sheet, Data Preparation, and Data Catalog.
2. Updated descriptions for Data Store, Meta Data Store, and Data Sheet on the Data Center Homepage.
3. Data Sandbox:
1. Data Sheet creation is possible now by using CSV & Excel files.
2. Supports various file formats such as JSON, Avro, Parquet, and PDF.

Please Note:The BDB Platform is compliant with OWASP security standards.

Data Preparation

New Features

1. Data prepared with Auto Prep is compatible with the Report module.
2. Providing a name to the Preparation is mandatory for the users to save the Data Preparation.
3. Suggestions:
1. It displays the entire Data Set along with the columns.
2. Enhanced design and display for column-based suggestions.
4. N Rows – This feature allows pulling up to 5,000 rows for data transformation.
5. Python version upgraded to 3.10.
6. New Transformations:
1. Anonymization
1. Hashing Anonymization (using Salt and Pepper technique)
2. Columns
1. Concatenate Arrays
3. Data Cleansing
1. Remove Special Character from Meta Data
4. Functions
1. Create Geopoint from Latitude and Longitude transformation
2. Count Occurrences
3. Discretize Value
4. Distance between Geopoints
5. Extract Data with GROK
6. Extract Latitude and Longitude from Geopoint transformation
7. Extract Ngrams
8. Extract Regular Expression
9. Extract User agent information
10. Generate Numerical Combination Transformation
11. Impute with computed Values
12. Merge Long Tail Values
13. Normalization
14. Simplify Text
15. Vectorization

Data Pipeline

New Features

1. Combined cluster events and data channels into a single page for streamlined monitoring.
2. System Pod Details:
1. Added Download option for pod logs.
2. Introduced an indicator for pod logs with more than 1 restart.
3. Synthetic Data Generator:
1. Enhanced schema generation with enum, format (date), minimum, maximum for strings, and numbers during file upload.
2. Added support for condition statements, unique property, UUID, and time.
4. Added Redshift driver in the DB Reader and Writer for seamless database connectivity.
5. Introduced an Alert Component to notify users on Microsoft Teams and Slack when configured.

Enhancements

1. UI enhancements in the Data Pipeline module:
1. Enhanced Component configuration page
2. Improved Trash List page interface
3. Refined Settings page layout
4. Streamlined Job Editor page design
5. Optimized Pipeline Editor page for better user experience
6. Spark component- An information icon indicates intelligent scaling when max instances exceed 1.
7. Job Create form now indicates an information icon in the scheduler field for development mode clarification.

Generative AI (LLMs)

One of the key additions in 8.5 is the introduction of Generative AI (LLMs) as BDB Assist.

1. BDB Assist is to help developers use the integrated LLMs inside BDB Notebook, to help write the code in Python, Java, SQL, etc. when they are developing either Code, Algorithm, or Workflow.
2. It can also help the Professional Services team to build chatting features with the Retrieval system on internal data.
3. Currently, this is a Beta version therefore it will be available only on BDB Cloud.
4. For customers, if they want to work on LLM use cases, we can do separate deployments.
5. This feature keeps one's data completely secured. The accuracy of this is 15-20% lower than that of Open AI (a very high-level estimate of BDB AI experts).

Please Note: Integration with ChatGPT/Open AI has already been achieved by BDB therefore clients who want Open AI integration can ask specifically for the same. This method will compromise your security.

Data Science Lab

New Features

1. Python upgraded to 3.10.0 for the Data Science Lab module.
2. Implemented a user interface with multiple tabs for DS Notebooks, allowing users to work with multiple notebooks simultaneously.
3. Enabled Project & Notebook access without project activation.
4. AutoML now supports Automated Time Series analysis.
5. Python and PySpark scripts can be registered as Jobs.
6. An Auto-Save option can be enabled or disabled for Notebooks.
7. Python Writers are integrated into the Data Science Lab.
8. The users can generate an Explainer Dashboard for Automated Time Series models.
9. Explainer Dashboards can be downloaded in the HTML format.
10. Provided Pull and push functionalities for Python files from Git.

Enhancements

1. Improved user interface in DS Lab lists and Notebook tiles for enhanced user experience.
2. Upgraded user interface for the Interrupt Kernel option.
3. Copy to Clipboard option added for Copy Path feature.
4. Utility
1. Added the Utility tab inside the DS Notebook.
2. Validation for utility scripts during upload and edit.
5. Introduced Code and Markdown cell highlighting functionality.
6. Users can upload the .text files at the Project level using the External Libraries option
7. Dataset rows can be limited using the DS Lab reader function.
8. Complete DS Lab Projects access granted to Admin users.

Please Note: The Assist functionality is a Beta Release.

Designer

Features

1. Publish Dashboard:
1. Dashboards can now be published to both My Documents and Public Documents for wider accessibility.

Enhancements

1. Shankey chart:
1. Added Node Tooltip functionality.
2. Introduced Node alert indicator feature.
2. Decomposition chart:
1. Enhanced precision for Data and tooltip information.
2. Added a button label to display other nodes effectively.
3. Knowledge chart:
1. Included level indicators for custom shapes and colors.
2. Improved Tooltip functionality.
3. Implemented SVG Image support for nodes.
4. Added Path Highlighter feature for better visualization.

Report

New Features

1. New Themes:
1. Introduced more themes to enhance the visual experience.
2. Implemented tab functionality for improved navigation and organization of the Report.
3. Machine Learning Integration:
1. Implemented machine learning capabilities to enhance the user experience, enabling intuitive report creation.
4. Searchable UI has been introduced for designing a View:
1. The user can search dimensions and measures from the selected Data Store to design their Views.
2. It supports functionalities like Slicer (slicedBy), Hidden (hiddenBy), Order(orderBy), limit, etc.
5. Integrated data preparation functionality at the report creation level for a streamlined workflow.
6. Changed fonts for consistency across the platform, ensuring a unified look and feel.
7. Added new charting components for diverse data representation:
1. Shankey chart
2. Word Cloud chart

Please Note:

1. The Story module is renamed as Report from the BDB R-8.5 and onwards.
2. The Machine Learning feature within the Report module is a Beta Release.