🕓Package Options

We're given quite a few options on how to handle the data being sent through transforms. Let's take a look.

Process Options

• "Fail on Conversion Issues" - This will stop processing the current transform and NOT send the data to the target if any conversion level issues arise. This may or may not be important for you depending on the conversion process defined.

• "Remove rows where column A is blank?" - This feature serves as a filter to delete rows. It checks the first column (Column A) for any cells that are empty or contain no data and removes the entire row if any are found.

• "Remove rows where amount (sum) is zero" - Useful for financial type files where the sum of all budget, amount, and total columns is zero.

• Header Row - Auto-Detect is the default setting and tries to identify header information automatically before processing the data. If you know the precise location of your data or if the auto-detection is incorrect, you can specify the exact row here before uploading your file.

• Significant Digits - If processing data with high precision decimals, increase this value to match. Typically this value should be left at 5.

• Custom File Process - These custom processes are developed independently and consist of specific, targeted operations designed to convert poorly formatted data or various formats into a format that is compatible with the Perigee Transforms application.

  • If you would like your processes written, please contact us at [e-mail].

  • You can also write your own plugins, check out the Authoring Plugins section for more info

File Generation

Both the Transformation report and the Data Quality report can be generated and sent to any or all of the options listed.

• Locally to a file path.

• Remote - if the destination is a folder type like an SFTP folder, a file path, an S3 bucket, etc.

• Emailed

Emailing

You have the option of enabling emails for every successfully converted or failed file. Configuration is quite straight forward as you configure both the Failure and Success options independently.

There are a couple of tokenized replacement that you can add to the subject or body of the HTML.

• {file} - The filename

• {time} - The time it took to process this file

• {rows} - Number of data rows

• {clean} - It either has the text "clean" or "conversion issues" depending on the result

FileIO Processes