Warehouse Processing

Warehouse Processing

1. Event Store

   • Bureau Pop-Map
   • Define
   • ER Gonaways
   • SHARE credit activity
   • SHARE business postcodes
   • Warehouse
     • Data Processing
       • Continuous Data Pull
         • Processed in Batches of configured size
         • Parallel event processing
         • Specific Event handler for each Event Type
           • Event Handler Factory
             • Find Event Handler based on Event Type
               • If Event Handler not Available
                 • Store event in Unhandled Events Table
               • Event Handler
                 • Holds specific logic how to handle and store data
                 • Acts in non-blocking manner
                 • Multiple instances can run at any time
         • If Unhandled events found, send summary email about events types and counts
         • Log and Store Statistics and Timings
         • Send Warning and Error Emails
         • Should we specify what event types we're subscribing to?
       • Process Unhandled Events
         • Use Event Handler Factory and parallel processing to handle unhandled events