BOM inside tokens

[Igor Bukanov]

2008/7/15 Ash Berlin <ash_es4 at firemirror.com>:
>
> I'd say that a BOM should be treated just like any ordinary whitespace
> char - namely that it should invalid in spaces, and beyond that why is
> any conversion needed, since its a valid unicode character...

The problem comes from the current ES3 implementations that strip BOM
from the sources and web pages placing BOM in arbitrary places in JS
sources. So the question is should ES4 at least partially be
compatible with the current code?

igor