While much attention and technology are dedicated to getting data out of database management systems, ABSI believes that there should also be great interest paid to the processes of putting the data into corporate systems.  This includes monitoring and reporting on all aspects of data transfer, ingest, and error reporting.   ABSI’s expertise and real-time data ingest tools support all aspects of data quality, completeness, and timeliness assessment. 
 

ABSI can help your organization use it’s data in real time for decision making or alerting.  We feel that if your organization receives and uses specific data hourly, daily, or on a schedule, then processes at data ingest need to address data completeness and support your the ability to view, or be alerted to, selected data quality, inventory and completeness measures. 
 

Many organizations have difficulty with data quality, timeliness and completeness determination as some degree of processing and load times occur for data prior to its availability in the corporate or enterprise databases or data marts.  This processing and/or ETL may occur weekly, monthly, or on other schedules.  If operations data quality and completeness determination occurs after scheduled processing and database loading, this results in significant delay in the identification of missing or late data, thereby delaying recovery and ultimate availability of complete data.  It is this processing delay before availability in the end user data mart or database, that provides justification for robust “upon ingest” quality monitoring and alerting tools. 
 

In other words, best practice indicates that for data that is ingested and used daily, that there are processes to identify and correct data receipt problems on a daily basis.  In addition, for data that has a cyclical processing cycle (e.g. weekly, monthly) operations best practice will identify data that is not present, PRIOR to processing, takes action to recover or repair the data gap, and to caveat the processed data if data gaps are identified.