Skip to content

FormatCBFFull does not work with compressed files #858

@dagewa

Description

@dagewa

The file LCLS_jungfrau-jungfrau_multipanel.cbf in the image_examples directory on dials-data is a large file, the 4th largest in that directory with a size of 17 MB.

It is uncompressed, but if I try to compress it, then it fails to read, with an error raised in FormatCBFFull

$ dxtbx.print_header LCLS_jungfrau-jungfrau_multipanel.cbf.bz2 
=== LCLS_jungfrau-jungfrau_multipanel.cbf.bz2 ===
CBFlib: warning input line 1 (11) -- invalid character
CBFlib: warning input line 1 (13) -- invalid character
CBFlib: warning input line 1 (14) -- invalid character
CBFlib: warning input line 1 (15) -- invalid character
CBFlib: warning input line 1 (16) -- invalid character
CBFlib: warning input line 1 (18) -- invalid character
CBFlib: warning input line 1 (19) -- invalid character
CBFlib: warning input line 1 (20) -- invalid character
CBFlib: warning input line 1 (21) -- invalid character
CBFlib: warning input line 1 (22) -- invalid character
CBFlib: warning input line 1 (23) -- invalid character
CBFlib: warning input line 1 (24) -- invalid character
CBFlib: warning input line 1 (25) -- invalid character
CBFlib: warning input line 1 (26) -- invalid character
CBFlib: warning input line 1 (27) -- invalid character
CBFlib: warning input line 1 (28) -- invalid character
CBFlib: warning input line 1 (29) -- invalid character
CBFlib: warning input line 1 (30) -- invalid character
CBFlib: warning input line 1 (31) -- invalid character
CBFlib: warning input line 1 (32) -- invalid character
CBFlib: warning input line 1 (33) -- invalid character
CBFlib: warning input line 1 (34) -- invalid character
CBFlib: warning input line 1 (35) -- invalid character
CBFlib: warning input line 1 (36) -- invalid character
CBFlib: warning input line 1 (37) -- invalid character
CBFlib: warning input line 1 (38) -- invalid character
CBFlib: warning input line 1 (39) -- invalid character
CBFlib: warning input line 1 (40) -- invalid character
CBFlib: warning input line 1 (41) -- invalid character
CBFlib: warning input line 1 (42) -- invalid character
CBFlib: warning input line 1 (43) -- invalid character
CBFlib: warning input line 1 (44) -- invalid character
CBFlib: warning input line 1 (45) -- invalid character
CBFlib: warning input line 1 (46) -- invalid character
CBFlib: warning input line 1 (47) -- invalid character
CBFlib: warning input line 1 (48) -- invalid character
CBFlib: warning input line 1 (49) -- invalid character
CBFlib: warning input line 1 (50) -- invalid character
CBFlib: warning input line 1 (51) -- invalid character
CBFlib: warning input line 1 (52) -- invalid character
CBFlib: warning input line 1 (53) -- invalid character
CBFlib: warning input line 1 (54) -- invalid character
CBFlib: warning input line 1 (56) -- invalid character
CBFlib: warning input line 1 (58) -- invalid character
CBFlib: warning input line 1 (60) -- invalid character
CBFlib: warning input line 1 (61) -- invalid character
CBFlib: warning input line 1 (63) -- invalid character
CBFlib: warning input line 1 (68) -- invalid character
CBFlib: warning input line 1 (69) -- invalid character
CBFlib: warning input line 1 (1) -- no data block
CBFlib: error input line 1 (1) -- syntax error
CBFlib: warning input line 1 (1) -- data block (null) ends with no content
Using header reader: FormatCBFFullStill
CBFlib: warning input line 1 (11) -- invalid character
CBFlib: warning input line 1 (13) -- invalid character
CBFlib: warning input line 1 (14) -- invalid character
CBFlib: warning input line 1 (15) -- invalid character
CBFlib: warning input line 1 (16) -- invalid character
CBFlib: warning input line 1 (18) -- invalid character
CBFlib: warning input line 1 (19) -- invalid character
CBFlib: warning input line 1 (20) -- invalid character
CBFlib: warning input line 1 (21) -- invalid character
CBFlib: warning input line 1 (22) -- invalid character
CBFlib: warning input line 1 (23) -- invalid character
CBFlib: warning input line 1 (24) -- invalid character
CBFlib: warning input line 1 (25) -- invalid character
CBFlib: warning input line 1 (26) -- invalid character
CBFlib: warning input line 1 (27) -- invalid character
CBFlib: warning input line 1 (28) -- invalid character
CBFlib: warning input line 1 (29) -- invalid character
CBFlib: warning input line 1 (30) -- invalid character
CBFlib: warning input line 1 (31) -- invalid character
CBFlib: warning input line 1 (32) -- invalid character
CBFlib: warning input line 1 (33) -- invalid character
CBFlib: warning input line 1 (34) -- invalid character
CBFlib: warning input line 1 (35) -- invalid character
CBFlib: warning input line 1 (36) -- invalid character
CBFlib: warning input line 1 (37) -- invalid character
CBFlib: warning input line 1 (38) -- invalid character
CBFlib: warning input line 1 (39) -- invalid character
CBFlib: warning input line 1 (40) -- invalid character
CBFlib: warning input line 1 (41) -- invalid character
CBFlib: warning input line 1 (42) -- invalid character
CBFlib: warning input line 1 (43) -- invalid character
CBFlib: warning input line 1 (44) -- invalid character
CBFlib: warning input line 1 (45) -- invalid character
CBFlib: warning input line 1 (46) -- invalid character
CBFlib: warning input line 1 (47) -- invalid character
CBFlib: warning input line 1 (48) -- invalid character
CBFlib: warning input line 1 (49) -- invalid character
CBFlib: warning input line 1 (50) -- invalid character
CBFlib: warning input line 1 (51) -- invalid character
CBFlib: warning input line 1 (52) -- invalid character
CBFlib: warning input line 1 (53) -- invalid character
CBFlib: warning input line 1 (54) -- invalid character
CBFlib: warning input line 1 (56) -- invalid character
CBFlib: warning input line 1 (58) -- invalid character
CBFlib: warning input line 1 (60) -- invalid character
CBFlib: warning input line 1 (61) -- invalid character
CBFlib: warning input line 1 (63) -- invalid character
CBFlib: warning input line 1 (68) -- invalid character
CBFlib: warning input line 1 (69) -- invalid character
CBFlib: warning input line 1 (1) -- no data block
CBFlib: error input line 1 (1) -- syntax error
CBFlib: warning input line 1 (1) -- data block (null) ends with no content
CBFlib: warning input line 153 (81) -- over line size limit
CBFlib: warning input line 154 (81) -- over line size limit
CBFlib: warning input line 155 (81) -- over line size limit
CBFlib: warning input line 156 (81) -- over line size limit
CBFlib: warning input line 157 (81) -- over line size limit
CBFlib: warning input line 158 (81) -- over line size limit
CBFlib: warning input line 159 (81) -- over line size limit
CBFlib: warning input line 160 (81) -- over line size limit
CBFlib: warning input line 161 (81) -- over line size limit
CBFlib: warning input line 162 (81) -- over line size limit
CBFlib: warning input line 163 (81) -- over line size limit
CBFlib: warning input line 164 (81) -- over line size limit
CBFlib: warning input line 165 (81) -- over line size limit
CBFlib: warning input line 166 (81) -- over line size limit
CBFlib: warning input line 167 (81) -- over line size limit
CBFlib: warning input line 168 (81) -- over line size limit
CBFlib: warning input line 169 (81) -- over line size limit
CBFlib: warning input line 170 (81) -- over line size limit
CBFlib: warning input line 171 (81) -- over line size limit
CBFlib: warning input line 172 (81) -- over line size limit
CBFlib: warning input line 173 (81) -- over line size limit
CBFlib: warning input line 174 (81) -- over line size limit
CBFlib: warning input line 175 (81) -- over line size limit
CBFlib: warning input line 176 (81) -- over line size limit
CBFlib: warning input line 177 (81) -- over line size limit
CBFlib: warning input line 178 (81) -- over line size limit
CBFlib: warning input line 179 (81) -- over line size limit
CBFlib: warning input line 180 (81) -- over line size limit
CBFlib: warning input line 181 (81) -- over line size limit
CBFlib: warning input line 182 (81) -- over line size limit
CBFlib: warning input line 183 (81) -- over line size limit
CBFlib: warning input line 184 (81) -- over line size limit
CBFlib: warning input line 185 (81) -- over line size limit
CBFlib: warning input line 186 (81) -- over line size limit
CBFlib: warning input line 187 (81) -- over line size limit
CBFlib: warning input line 188 (81) -- over line size limit
CBFlib: warning input line 189 (81) -- over line size limit
CBFlib: warning input line 190 (81) -- over line size limit
CBFlib: warning input line 191 (81) -- over line size limit
CBFlib: warning input line 192 (81) -- over line size limit
CBFlib: warning input line 193 (81) -- over line size limit
CBFlib: warning input line 194 (81) -- over line size limit
CBFlib: warning input line 195 (81) -- over line size limit
CBFlib: warning input line 196 (81) -- over line size limit
CBFlib: warning input line 197 (81) -- over line size limit
CBFlib: warning input line 198 (81) -- over line size limit
CBFlib: warning input line 199 (81) -- over line size limit
CBFlib: warning input line 200 (81) -- over line size limit
CBFlib: warning input line 201 (81) -- over line size limit
CBFlib: warning input line 202 (81) -- over line size limit
CBFlib: warning input line 203 (81) -- over line size limit
Beam:
    probe: x-ray
    wavelength: 1.31273
    sample to source direction : {0,0,1}
    divergence: 0
    sigma divergence: 0
    polarization normal: {0,1,0}
    polarization fraction: 0.999
    flux: 0
    transmission: 1
    sample to source distance: 0

Detector:
Panel:
  name: Panel
  type: SENSOR_UNKNOWN
  identifier: 
  pixel_size:{0.075,0.075}
  image_size: {256,256}
  trusted_range: {0,2e+06}
  thickness: 0
  material: 
  mu: 0
  gain: 1
  pedestal: 0
  fast_axis: {0,1,0}
  slow_axis: {-1,0,0}
  origin: {-1.3875,-38.5875,-100}
  distance: -100
  pixel to millimeter strategy: SimplePxMmStrategy


No goniometer model found
No scan model found
Traceback (most recent call last):
  File "/home/fcx32934/sw/cctbx/conda_base/bin/dxtbx.print_header", line 7, in <module>
    sys.exit(run())
             ~~~^^
  File "/home/fcx32934/sw/cctbx/modules/dxtbx/src/dxtbx/command_line/print_header.py", line 60, in run
    print_header(options.image_files)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
  File "/home/fcx32934/sw/cctbx/modules/dxtbx/src/dxtbx/command_line/print_header.py", line 46, in print_header
    raw_data = i.get_raw_data()
  File "/home/fcx32934/sw/cctbx/modules/dxtbx/src/dxtbx/format/FormatCBFFull.py", line 178, in get_raw_data
    len(types) == cbf.count_rows() == 1
AssertionError

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions