BOM inside tokens

[Igor Bukanov]

The currently proposed rule for byte-order-mark (BOM) characters in
ES4 sources is to replace them by whitespace outside of tokens. But
what is exactly the tokens in a case like -<bom>-?

AFAICS it would be treated as - - turning cases like:
  -<bom>-a;
into
  - -a;
versus
  --a;
that would be with current ES3 implementations.

Regards, Igor