Reports

How to debug EBCDIC data?

To debug EBCDIC data loading issues, you can use the ebcdicCsvDumpFolder property in your configuration. Add this to your EBCDIC loading step:   
ebcdicCsvDumpFolder=data/Debug

This setting does two key things:

  1. It creates a CSV file in the specified folder that represents the data stream passing through the database's COPY or INSERT statement. This allows you to inspect the transformed data before it reaches the database.
  2. It generates a log file detailing how the EBCDIC file was parsed to fill each column. This helps identify any mismatches between the file structure and the expected database schema.

By examining these debug files, you can:

  • Verify the correct interpretation of EBCDIC encoding
  • Check for data formatting issues
  • Identify structural misalignments between your flat-file and the target table
  • Spot any character encoding problems

This debug feature is an invaluable tool for ensuring accurate EBCDIC data conversion and database loading.

Example:

  • Flat file
flat-file.png
  • <debug>.csv file
debug-file.png
  • cut off log file
cut-of-log-file.png