DTFSQLite cartridge overview
DTFSQLite cartridge allows to read DTF and AddressBase Premium gazetteers, including full uploads and change only updates.
...
- It is expected that SQLite Database file does not exist but its directory is already created.
- If the file already exists, it will be deleted.
Format type (DTF or ABP) is automatically determined based on version encoded in the first line of csv files.
Source file upload order
The source files (.csv) are processed in the following order:
- All full upload files are identified
- All COU files older then full uploads are ignored
- Only the newest upload per custodian code is taken for further processing with exception of 9999 custodian code which marks extracts from National Hub. All uploads from National Hub are processed.
- All records from selected files (Full uploads + COUs) are then segregated into appropriate tables.
- All but the newest records are removed from the aforementioned tables.
DTF specific comments
SQLite Database directory will be also used to store missingUprns.txt and missingUsrns.txt which contain lists of UPRNs and USRNs existing in LPI table but missing from Street Descriptors or BLPUs tables.
...