February 9, 2019
SQL Saturday #807 - Redmond
SQL Saturday is a free 1-day training event for data professionals that focus on local speakers, providing a variety of high-quality technical sessions, and making it all happen through the efforts of volunteers and support from sponsors.
RDX SQL BI Developer, Russel Loski, will be representing RDX and presenting the following session:
Managing ETL Change using BIMLScript from 1:30 PM - 3:00 PM in room Utopia 2310.
You develop an SSIS package to load a flat file. You meticulously identify each of the columns and map the columns to the target table. Your package runs fine for months. Then the file format changes. It is back to the drawing board, selecting each column, setting the data types (type, length, etc.). In many cases, you actually have the file structure in an electronic form. Wouldn't it be nice to simply regenerate your SSIS package using that metadata?
In this session I will demonstrate how to automate the generation of SSIS packages using the open source BIML and BIMLScript.
I will then demonstrate how to use this technique to handle changes in file structure. I will generate an SSIS package from a simple Excel workbook I will represent the structure of a flat file and its relationship to a staging table.
Finally, I will use BIMLScript to handle changes from one version of SSIS to the next and from SSIS to Azure data factory.
The complete schedule can be found here.
SQL Saturday #807 will be held at Microsoft Building 92:
15010 NE 36th Street
Redmond, WA 98052
Register for SQL Saturday #807 here.