Query Result not rendering in Sagemaker Distribution Image 2.8 or 3.3 in Unified Studio

[sakshigaud]

When running queries on Spark compute in JupyterLab with SageMaker Distribution Image 2.8 or 3.3, result sets fail to render and show an ‘error loading data’ message.

The same code works as expected on Image 2.6, where results are displayed in tabular format.

Output from the space with Sagemaker Distribution Image 2.8

Output from the space with Sagemaker Distribution Image 2.6

Also, I don't see any Sagemaker Distribution Images in the drop down in Jupterlab Space Configuration apart from 2.8 and 3.3. Is this expected?

[sakshigaud]

Could someone please help with this issue. Please let me know if I am missing something.

I tried checking the logs at /var/log/apps/app_container.log. It has the error that Notebook JSON is invalid: is not valid under any of the given schemas.
The JSON mentioned contained the output result along with other metadata information.

[TRNWWZ]

This issue should be reported to AWS SageMaker Unified Studio service, instead of SMD image.