Skip to content

Fix data types used in kernel_shift_1d/2d

Javier Duarte requested to merge github/fork/vloncar/line_buffer_fix into master

Created by: vloncar

The kernel_shift_1d/2d functions of recently added line buffer CNN implementations incorrectly take the data type of the kernel_window as res_T instead of data_T. In fact, the data type cannot change to res_T at this stage anyway so this commit removes it altogether. Using res_T causes crashes in models with mixed quantization, such as the one from @thaarres attached below. pruned_cnn.tar.gz

Merge request reports