You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I was experiencing some strange rebuilding behavior.
When 1_fetch/out/dv_data.rds.ind is rebuilt, text is printed to the console to share progress. When I ran scipiper::scmake(remake_file = '2_process.yml') and 1_fetch/out/dv_data.rds.ind was rebuilt, the same text about progress for fetching dv data would be repeated during the 2_process/out/dv_stats.rds.ind step. I was able to pinpoint that the re-downloading of dv data was happening at the line of code that read in the dv data with dv_data <- readRDS(scipiper::sc_retrieve(dv_data_ind, remake_file = '1_fetch.yml')) in 2_process/src/process_dv_stats.R.
This does not happen when 2_process/out/dv_stats.rds.ind is built and remake did not need to rebuild 1_fetch/out/dv_data.rds.ind. @aappling-usgs pointed to the potential for a known scipiper issue (??) to be the cause, but more investigation is needed.
For now, this is not a priority. It is annoying because the same data download is happening twice but we need to move on for now and might return when that step would cause more of an issue as we expand the time period for the animation (see #36).
The text was updated successfully, but these errors were encountered:
I was experiencing some strange rebuilding behavior.
When
1_fetch/out/dv_data.rds.ind
is rebuilt, text is printed to the console to share progress. When I ranscipiper::scmake(remake_file = '2_process.yml')
and1_fetch/out/dv_data.rds.ind
was rebuilt, the same text about progress for fetching dv data would be repeated during the2_process/out/dv_stats.rds.ind
step. I was able to pinpoint that the re-downloading of dv data was happening at the line of code that read in the dv data withdv_data <- readRDS(scipiper::sc_retrieve(dv_data_ind, remake_file = '1_fetch.yml'))
in2_process/src/process_dv_stats.R
.This does not happen when
2_process/out/dv_stats.rds.ind
is built and remake did not need to rebuild1_fetch/out/dv_data.rds.ind
. @aappling-usgs pointed to the potential for a known scipiper issue (??) to be the cause, but more investigation is needed.For now, this is not a priority. It is annoying because the same data download is happening twice but we need to move on for now and might return when that step would cause more of an issue as we expand the time period for the animation (see #36).
The text was updated successfully, but these errors were encountered: