Release-2019.07

July 31, 2019

Bristlecone
Bristlecone

Bristlecone NEO® Platform
Release-2019.07

  1. Bristlecone NEO® Cockpit
  2. Bristlecone NEO® IDM
  3. Bristlecone NEO® Data Platform
  4. Bristlecone NEO® Modules
  5. Bristlecone NEO® Lambdas
  6. @bcone/neo-app-sdk npm
  1. – 0.3.0.5
  2. – 0.3.0.3
  3. – 0.3.0.3
  4. – 0.3.0.1
  5. – 0.3.0.3
  6. – 1.0.4

Bristlecone

Features

  1. Data Dictionary Validation
  2. File Validation
  3. File Conversion
    1. EXCEL TO CSV
    2. CSV TO JSON
    3. CSV TO ORC
    4. CSV TO PARQUET
    5. CSV TO AVRO
    6. AVRO TO CSV
    7. ORC TO CSV
    8. PARQUET TO CSV
    9. PDFimage TO PDFText
    10. PDFText TO CSV
  4. Batch Processing
  5. File Preview Support for ORC, PARQUET and AVRO
  6. Serverless Custom Job
  7. Ability to Show/Hide Files that are Archived
  8. Ability for a Pipeline to gracefully fail the pipeline when it encounters a file that is archived
  9. Ability to block download and preview in data catalog for a file that is archived
  10. App SDK as an npm package
  11. Upgrade ready

Bristlecone

Known Issues

  1. DE588 : Dictionary : Data Format column is missing during preview as well as in the downloaded dictionary
  2. DE596 : Batch Pipeline:Performance Issue taking 45minutes to Process 110 file in batch pipeline data export
  3. DE642 : Lifecycle policy is not getting appended to output files of pipeline in staged and processed bucket
  4. DE647 : Verify that if a particular version of a file is archived then preview, download option should be disabled
  5. DE663 : Dictionary Validation : Data type validation accepts only the values 0 and 1 in the Boolean data type column
  6. DE667 : Dictionary Validation for Integer column accepts float value
  7. DE676 : Data Dictionary : The data formats that is getting displayed in the UI for the Data Type 'Timestamp' is incorrect. If the user prepares a raw file based on it, then it will fail in the Dictionary validation
  8. DE677 : Dictionary Validation : None of the date formats are supported for the Date data type column. Data Type check fails on Date column irrespective of correct data
  9. DE687 : File conversion-Unable to preview converted avro file(in staged bucket)

Bristlecone

Limitations

  1. Supports only Chrome (version > 74.0)
  2. Special characters, decimal, negative, space are not accepted in the column header for file conversion execution step in the pipeline
  3. For Export, tables (Dynamo and Postgres) CRUD operations can be performed by API's only
  4. For re-deployment of the deleted application with the same name, the user must await 20 minutes, as deletion takes time in the backend
  5. App Logs, as part of cockpit-menu, is not linked end to end
  6. Admin is not getting notified to give app/role access, post user registration
  7. On demand and scheduled pipeline support for batch processing not supported
  8. XLSX to CSV file conversion working up to 100MB file size
  9. On demand and scheduled pipeline support for batch processing not supported and only one batch pipeline can run at a time