I have cube where measure groups are partitioned into 2 partition for different time frame as below:
latest 2 years data ( PRT_DATA_2YEARS )
older data than 2 years ( PRT_DATA_REST )
By processing 1st partition ( with any of processing option ), How can I make sure to process/refresh only last 2 years of data? Meaning only latest 2 years of data will be updated and rest of the data will be intact.
Example: lets say actual data on database got updates for all years. and till now cube has not reflected those changes because it hasn't processed yet. Now we run cube processing job, that will update or fetch updated data only for latest 2 years in the cube. And rest of the data will be intact. There will not be any change in the cube data which is older than 2 years.
Request you to please help to resolve this.
Any suggestions/hints/trick are welcomed.
Regards
I would recommend you change from sliding windows partitions. For example, yesterday when you processed the “latest 2 years” partition it contained January 18, 2018-January 17, 2020. (Or I’m not sure if it’s full year boundaries, but the point is the same.) If you reprocess that partition then you will lose January 18, 2018 data and will this have to reprocess the older partition too.
Instead switch to 5 partitions: 2016, 2017, 2018, 2019, and 2020. Then you should be able to reprocess the 2020 partition only and not have to reprocess the prior partitions. Basically you can achieve incremental processing. When you are ready to stop reporting on 2016 data then drop that partition and create the 2021 partition.