Convert ZydisDecoder field decoder_mode to a bitmap.

[jpidancet]

Make decoder_mode a bitmap instead of an array of booleans for space efficiency.

[flobernd]

I like this change, but it seems like some stuff needs to be fixed before merging 🙂

The regression tests are failing and the fuzzer complains as well.

[jpidancet]

Hi,

Thank you for having a look. It looks like the || vs | mix-up was causing all the build and fuzzing errors. It is fixed now.

[flobernd]

@jpidancet Thanks for fixing! I will merge if @athre0z agrees as well.

@athre0z @th0rex fyi, this is a breaking change for the JS, Rust, etc. bindings 🙂

For v5 I would like to change the public API for this entirely (ZydisDecoderEnableMode(mode) -> ZydisDecoderSetModes(bitmask) and converting the ZYDIS_DECODER_MODE_X constants to bits), but for now it's probably better to keep the current API.

[athre0z]

For v5 I would like to change the public API for this entirely (ZydisDecoderEnableMode(mode) -> ZydisDecoderSetModes(bitmask) and converting the ZYDIS_DECODER_MODE_X constants to bits), but for now it's probably better to keep the current API.

We can do this in a non-breaking manner by just adding such a function without removing the old one. I think this would be preferable here since maintaining the old function is very little effort. We can mark the old function as deprecated and remove it in a few years, or just keep it around forever. Changing the constants is not API breaking, only ABI breaking, so can be done in a minor version.

[athre0z]

LGTM, good change!