Fatal error: Call to undefined function token_get_all() – drupal 8

Hi. I’m attempting to install drupal8 on FreeBSD but when I try to load the front page in the browser, I get an empty page with just the error,

Fatal error: Call to undefined function DoctrineCommonAnnotationstoken_get_all() in /data/htdocs/test1/vendor/doctrine/annotations/lib/Doctrine/Common/Annotations/TokenParser.php on line 56

All the other extensions listed in extensions.ini seem to load and Drupal7 is working fine.

The tokenizer extension is installed but phpinfo() does not show it enabled under the Configuration section. Although it does mention it in the PHP credits section.

Here is the contents of /usr/local/etc/php/extensions.ini

    extension=dom.so
    extension=filter.so
    extension=ftp.so
    extension=gd.so
    extension=hash.so
    extension=json.so
    extension=mysqli.so
    extension=pdo.so
    extension=session.so
    extension=simplexml.so
    extension=xml.so
    extension=curl.so
    extension=tokenizer.so

I even upgraded from php 5.6.25 to php 7.0.10 but get the same result.
Also I tried with both drupal-8.1.7 and drupal-8.1.9. Same result.

If I run “php -m” on the command line, tokenizer is in the list and if it comment it out in /usr/local/etc/php/extensions.ini, it is no longer in the list.

Also, the command “php -i” shows

Tokenizer Support => enabled

Any help would be appreciated.

OS: FreeBSD-10.2
Web Server: nginx-1.10.1
PHP version: 7.0.10
Drupal version: 8.1.9

Drupal version: 


Source: https://www.drupal.org/taxonomy/term/1/feed