Nigel Ainscoe

You need a data warehouse.

Says who? Says me! There is a received wisdom in the world of business intelligence that says you need a data warehouse in your business, but is this true? Why do you need a data warehouse? The most important reason is to get a single version of the truth, or…

Read More

BimlScript and Automated ETL Part 2

Implementing the Pattern Now that we have the requisite metadata it’s time to use it to create our Biml files. In order to handle the requirements of different feeds, i.e.  different target dimension and fact tables, some files will require data to be unpivoted and some will contain multiple demographic…

Read More

Random thoughts on data

For as long as I can remember I have been intimately involved with data. Moving it, cleaning it, providing it to the business; either pre-aggregated for immediate consumption or the raw stuff for further analysis. Always I have been concerned with automating the pipeline so that the latest data is…

Read More

BimlScript and Automated ETL Part 1

Or a prescriptive pattern for automating the building of sophisticated data warehouses based upon a simple metadata store There are lots of Biml articles that discuss strategies for generating SSIS packages to load data warehouses that are essentially copies of the production DB. These strategies usually leverage the built in…

Read More