SQL Server BI Developer, Russel Loski, will be representing RDX at SQL Saturday #901 in Kansas City, MO, on September 14, 2019. While there, he'll be presenting the following speaking session:
Managing ETL Change Using BIMLScript - 2:15 - 3:30 PM, Room ARP 212
Change is constant, especially with source files. Health care claims data files change at least yearly. You develop an SSIS package to load the source file. You meticulously identify each of the columns and map them to the targets. Your package runs fine for months. Then the file format changes. Again, you tediously select each column, etc. Wouldn't it be nice to simply document the structure of the file, the file's metadata, and generate the SSIS from that metadata? Your users demand the documentation anyway. If the file changes, you simply change the metadata.
During his session, Russel will import US census data to exemplify this methodology. He'll then create the SSIS package using BIMLScript and metadata. Additionally, he'll demonstrate how to generate an Azure Data Factory pipeline from the same metadata.
SQL Saturday #901 will be held at Rockhurst University:
1100 Rockhurst Road, Kansas City, MO, 64110
Register for SQL Saturday #901 here.
Held in a hundreds of cities globally throughout the year, SQL Saturday is a free training event for data professionals that brings together dozens of SQL Server professionals for a day of networking and technical sessions designed to expand their skill sets.