Skip to content

Conversation

@DataCentricDave
Copy link

Summary

This change updates the Load FUAM Data Fabric pipeline to require upstream activities to succeed, not just complete, before dependent activities run.

Problem

Previously, all activity dependencies were configured with the Completed condition only. This meant:

  • Downstream activities continued even when an upstream activity failed
  • The overall pipeline could appear successful despite partial or complete data load failures
  • Failures were harder to detect and troubleshoot, especially in automated or scheduled runs

Solution

This update adds the Succeeded dependency condition alongside Completed for all relevant activities in the pipeline. With this change:

  • Downstream activities will only run if the upstream activity completes successfully
  • The pipeline will correctly surface a Failed status when any activity fails
  • Failures are now explicit and easier to monitor and alert on

Scope of Change

  • Updated dependency conditions across all dependent activities in Load_FUAM_Data_E2E.DataPipeline
  • No changes to activity logic, data sources, or transformations
  • Behavioral change is limited to pipeline execution and status reporting

Impact

  • Improves reliability and observability of the pipeline
  • Prevents silent failures and partial data loads
  • Aligns pipeline behavior with expected success/failure semantics

@DataCentricDave
Copy link
Author

@DataCentricDave please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.

@microsoft-github-policy-service agree [company="{your company}"]

Options:

  • (default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
@microsoft-github-policy-service agree
  • (when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.
@microsoft-github-policy-service agree company="Microsoft"

Contributor License Agreement

@microsoft-github-policy-service agree

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant