Replace the FFI tokenizer state transmute with an explicit conversion from the incoming numeric value. The old code range-checked against the last state before transmuting, which matched today's contiguous enum but left the conversion dependent on that layout detail. Returning early for unknown values keeps the FFI boundary tolerant while removing a source of possible invalid enum discriminants. |
||
|---|---|---|
| .. | ||
| src | ||
| build.rs | ||
| Cargo.toml | ||
| cbindgen.toml | ||