Skip to content

Conversation

@kokbent
Copy link
Contributor

@kokbent kokbent commented Nov 28, 2025

Due to some path issues with generating the parquet file, the previous submitted file (version 2) was essentially no different from the original version. As a result, all the modifications we made in September were not reflected.

This PR fix the issue and made sure our Sep 26 run was correctly reflected in it.

@github-actions
Copy link

Model Output

--- CFA-Scenarios/2025-08-10-CFA-Scenarios.gz.parquet ---

✅: [file_exists]: File exists at path 'model-output/CFA-Scenarios/2025-08-10-CFA-Scenarios.gz.parquet'.

✅: [file_name]: File name "2025-08-10-CFA-Scenarios.gz.parquet" is valid.

✅: [file_location]: File directory name matches model_id
metadata in file name.

✅: [round_id_valid]: round_id is valid.

✅: [file_format]: File is accepted hub format.

✅: [file_n]: Number of accepted model output files per round met.

✅: [metadata_exists]: Metadata file exists at path 'model-metadata/CFA-Scenarios.yaml'.


Run validation on files: 2025-08-10-CFA-Scenarios.gz.parquet

ℹ: [pairing_info]: Run grouping pairing: scenario_id, target, horizon, age_group; No stochasticity. Number of Samples: 500
✅: [valid_round_id_col]: round_id_col name is valid.

✅: [unique_round_id]: round_id column "origin_date" contains a single, unique round ID value.

✅: [match_round_id]: All round_id_col "origin_date" values match submission round_id from file name.

✅: [colnames]: Column names are consistent with expected round task IDs and std column names.

✅: [col_types]: Column data types match hub schema.

✅: [valid_vals]: tbl contains valid values/value combinations.

✅: [rows_unique]: All combinations of task ID column/output_type/output_type_id values are unique.

✅: [req_vals]: Task ID/output type/output_type_id combinations all present.

✅: [value_col_valid]: Values in column value all valid with respect to modeling task config.

ℹ: [value_col_non_desc]: No quantile or cdf output types to check for non-descending values.
Check skipped.
✅: [spl_compound_taskid_set]: All samples in a model task conform to single, unique compound task ID set that matches or is
coarser than the configured compound_taksid_set.
Pairing information: scenario_id, target, horizon, age_group
✅: [spl_compound_tid]: Each sample compound task ID contains single, unique value.

ℹ: [spl_non_compound_tid]: Task ID combinations of non compound task id values not tested
✅: [spl_n]: Required unique number of samples per compound idx task present.
Only one number of samples from: 300 to 600 are accepted. Submission contains: 500
✅: [n_decimal]: value associated with sample is in a valid format.
A maximum of 5 decimal place is expected.
✅: [na_value]: value does not contain NA value.

✅: [flat_projection]: All projections don't have a unique value for the whole projection period.

✅: [cumul_proj]: The cumulative values are not decreasing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant