Skip to content

Commit 2bf082f

Browse files
YingChen1996Ying Chen
andauthored
[BUG] Support submits spark pipeline with reference component (Azure#27619)
* update * update msg Co-authored-by: Ying Chen <[email protected]>
1 parent ff66658 commit 2bf082f

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

sdk/ml/azure-ai-ml/azure/ai/ml/entities/_job/spark_job_entry_mixin.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,8 +39,13 @@ def entry(self, value: Union[Dict[str, str], SparkJobEntry, None]):
3939
self._entry = value
4040

4141
def _validate_entry(self):
42+
if self.entry is None:
43+
# Entry is a required field for local component and when we load a remote job, component now is an arm_id,
44+
# entry is from node level returned from service. Entry is only None when we reference an existing
45+
# component with a function and the referenced component is in remote with name and version.
46+
return
4247
if not isinstance(self.entry, SparkJobEntry):
43-
msg = "Entry is a required field."
48+
msg = f'Unsupported type {type(self.entry)} detected when validate entry, entry should be SparkJobEntry.'
4449
raise ValidationException(
4550
message=msg,
4651
no_personal_data_message=msg,

0 commit comments

Comments
 (0)