[general] Is there any way to make a targets inside a targets?

[filipemsc]

Help

• I understand and agree to https://books.ropensci.org/targets/help.html.

Description

I'm working on a general data-cleaning project involving datasets from all Brazilian states. Each state requires substantial work and has its own specific characteristics. For this reason, I would like to create a separate targets pipeline for each state, tailored to its particularities. My goal is to then orchestrate all these individual pipelines within a larger targets workflow, where each state-level pipeline is represented as a target in the master pipeline. Does this approach make sense conceptually? And is it currently feasible with targets?

[wlandau]

I haven't explored this pattern. At minimum, you'd have to give each pipeline have its own data store and _targets.R file. Since targets isn't designed for nested pipelines, a different approach to the problem (such as one large pipeline or completely separate state-specific pipelines) may turn out better in the end.