What is the Data Profiling task?

 Data profiling is the process of analyzing the source data to better understand what condition the data is in, in terms of cleanliness, patterns, numbers or nulls, and so on. data profiling tasks usually be used at the beginning of the development cycle to support the design of the destination database schema. Note that this task is not used when you develop the normal recurring ETL packages.

Comments

Post a Comment

Popular posts from this blog

What is Connection Mangers

  Connection as its name suggests is a component to connect to any source or destination from SSIS — like a sql server or flat file or lot of other options that SSIS provides. Connection manager is a logical representation of a connection. Connection Managers are used for gathering data from various sources and sending it to a destination. It facilitates system connection by including information regarding server, data source, authentication details, database, etc.
Read more

What is Transformation? Explain Different Types of Transformations

Image
Data transformation is the process of extracting required data from a data source and is the most critical SSIS step. Post extraction, the process aids in managing and transferring the data to a specific file destination. There are several rules implemented by this process for loading the extracted data to the destination target file. Based on this, the transformations are classified as: Blocked Non Blocked Semi Blocked Non-Blocking  –  No blocking Partial Blocking  –  The downstream transformations wait for certain periods, it follows start then stop and start over technique Full Blocking :  The downstream has to be waiting till the data has been released from the upstream transformation. Non- blocking transformations Audit Cache Transform Character Map Conditional Split Copy Column Data Conversion Derived Column Export Column Import Column Lookup Multicast OLE DB Command Percentage Sampling Script Component Slowly Changing Dimension Partial blocking transforma...
Read more