sql-serverssissql-server-2016ssis-2016

How can I delete the columns in DataFlow Task in SSIS?


I use SQL Server 2016 and I have a very busy DataFlow task. In my DataFlow task, I use Multicast component for some reason. After creating a new Flow in my DataFlow, I need to delete some of the columns in the new flow because they are useless.

enter image description here

Just for more information, I need to do that because I have more than 200 columns in my flow and I need less than 10 of those columns.

How can I delete the columns in DataFlow Task in SSIS?


Solution

  • You can add an extra component of some sort. However, this will never reduce complexity or improve performance. Just thinking about it, logically, you are adding an additional interface that needs to be maintained. Performance-wise, anything that will eliminate columns means copying one set of rows from one buffer to a whole other buffer. This is called an asynchronous transformation, and it is better described here and here. You can imagine that copying rows is less efficient than updating them in place.

    Here are some recommendations for reducing complexity, which will, in turn, improve performance:

    These guidelines will get you headed in the general direction, but do post more questions for tuning specific performance problems.