DELMIA Ortems 2023 Golden: Speed up your interface thanks to our new APPEND_BATCHES mode

Introduction

The Golden level of DELMIA Ortems 2023 offers a new mode “APPEND_BATCHES” to insert records into tables.

 

This new parameter is exclusive to database-type target.

Interface Synchronization Modes

The interface synchronization mode determines how to integrate new data into the target.

Including "Append_batches", 9 modes are now available:

  • Append (Default mode. This is the mode for text and XML targets)
  • Append_Batches (New mode)
  • Edit
  • Field
  • Update
  • Replace
  • Delete
  • Compare
  • Comp_header

Append, Edit and Field modes provide the shortest processing times while Compare and Comp_header modes give the longest times.

Append_batches mode is now the fastest insertion mode.


“Append_batches” mode description

“Append_batches” mode is very similar to “Append” mode except that it manages records in batches rather than individually.

This is the simplest and fastest interface synchronization mode that you can choose for database-type targets in the configuration database in VIC Editor.

It transfers the records in batches to the target database. The database engine then adds all the new records. It does not replace any existing record.

The default size of the batches is 1 000 records, but you can change that value in the Environment Management application for each environment (database) concerned, in the right panel, in “Advanced” tab. The ResourceOptions.ArrayDMLSize field displays the current batch size. You can modify that number.

The database engine relies on primary keys to identify the new records it must add, versus the existing records it must skip.
This synchronization mode generates "violation of primary key" messages each time there is an attempt to write to an existing record.

Performances

With the default batch size (=1 000), insertion durations were divided by 3 compared with standard “Append” mode. Our tests were performed on dataset sized from 25 000 to 100 000 records.

​​​​​​​