feat: Recover from reading incompatible schema metadata if validation is allowed

[Copilot]

Motivation

When serialization formats change (e.g., primary_keys vs primary_key), previously serialized schemas/collections become unreadable. Schema deserialization already handles this via a strict parameter, but collections did not. Additionally, when reading serialized data, using non-strict schema deserialization in all cases that would allow validation to be run allows to recover from unreadable metadata where it is not needed.

Fixes #230

Changes

• Added strict parameter to deserialize_collection: Mirrors existing deserialize_schema behavior—when strict=False, returns None on deserialization errors instead of raising exceptions
• Propagated strict through deserialization chain: Updated _deserialize_types to accept and forward the parameter
• Connected to scan_parquet/read_parquet validation modes: Both Collection._read and Schema._validate_if_needed now pass strict=False when validation is "allow", "skip" or "warn", allowing automatic fallback to validation when old formats are detected
• Added DeserializationError exception: Created a new exception class that is raised when deserialization fails with strict=True, providing a clear and consistent error type for both schema and collection deserialization failures
• Parametrized tests over storage backends: Updated test_read_write_old_metadata_contents for collections to use TESTERS parametrization instead of being Parquet-specific
• Added set_metadata to CollectionStorageTester: Implemented abstract method with Parquet and Delta backend implementations to support testing metadata manipulation across storage backends
• Updated tests to use set_metadata pattern: Updated test_read_write_parquet_schema_json_fallback_corrupt to use write_untyped + set_metadata instead of passing metadata kwarg which was being ignored

---

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 100.00%. Comparing base (3b82fdc) to head (f21c4b8).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff            @@
##              main      #231   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files           53        53           
  Lines         3019      3053   +34     
=========================================
+ Hits          3019      3053   +34     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[AndreasAlbertQC]

Thanks @MoritzPotthoffQC ! Small questions