mirror_php/PHP-Parser
1
0
Fork 0
mirror of https://github.com/nikic/PHP-Parser.git synced 2025-01-17 23:28:15 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,658 Commits 7 Branches 105 Tags
Commit Graph

85 Commits

Author SHA1 Message Date
Nikita Popov
06c7ab51b7 Drop Lexer::getTokens() method 
This doesn't make a lot of sense now that Lexer::tokenize() returns
the tokens.

The tokens for the last parse should be fetched via
Parser::getTokens() instead.
 2023-09-16 09:50:50 +02:00
Nikita Popov
502b090900 Add property types 
Types omitted in two places where we violate them currently:
Namespace_::$stmts can be null during parsing, and Enum_::$scalarType
can be a complex type for invalid programs.
 2023-08-16 21:37:02 +02:00
Nikita Popov
ba851243f4 Replace startLexing() with tokenize() 
For now Lexer::getTokens() still exists, but should probably be
removed.
 2023-08-13 16:06:10 +02:00
Nikita Popov
4b497045e0 Move attribute handling into parser 
The Lexer now only provides the tokens to the parser, while the
parser is responsible for determining which attributes are placed
on notes. This only needs to be done when the attributes are
actually needed, rather than for all tokens.

This removes the usedAttributes lexer option (and lexer options
entirely). The attributes are now enabled unconditionally. They
have less overhead now, and the need to explicitly enable them for
some use cases (e.g. formatting-preserving printing) doesn't seem
like a good tradeoff anymore.

There are some additional changes to the Lexer interface that
should be done after this, and the docs / upgrading guide haven't
been adjusted yet.
 2023-08-13 10:40:21 +02:00
Nikita Popov
748aab3365 Don't set start attributes for whitespace 
These will get overwritten later anyway.
 2023-07-09 15:47:37 +02:00
Markus Staab
8ad4129442
Declare list types (#907) 
Closes #905
 2022-12-14 22:59:53 +01:00
Nikita Popov
f98341f688 Specify more types 2022-09-17 18:48:56 +02:00
Nikita Popov
fc6b4890ef Specify more types 2022-09-17 16:45:25 +02:00
Nikita Popov
48f470eac7 Add missing return types 2022-09-11 18:17:05 +02:00
Nikita Popov
f63081a57c Partial documentation update 2022-09-04 16:16:25 +02:00
Nikita Popov
dd63ddbc24 Add php-cs-fixer config and reformat 
The formatting in this project has become something of a mess,
because it changed over time. Add a CS fixer config and reformat
to the desired style, which is PSR-12, but with sane brace placement.
 2022-08-28 22:57:06 +02:00
MathiasReker
653757bec6 Nullable type declaration for default null value 
Adds ? before type declarations for parameters with a default null value
 2022-07-04 20:34:31 +02:00
Nikita Popov
c878d7195d Move token mapping from lexer to parser 
This allows a different token mapping per parser.
 2022-06-19 18:05:52 +02:00
Nikita Popov
6e0eec807e Move definition of compatibility tokens into separate file 2022-06-19 17:29:24 +02:00
Nikita Popov
aff98bbf16 Use PHP 8.0 token representation 
Migrate everything to use PhpToken-compatible token representation,
rather than the legacy array/string representation.
 2022-06-05 17:44:42 +02:00
Máté Kocsis
55c4269232
Add support for new PHP 8.1 modifiers (#796) 
Implement support for readonly properties (https://wiki.php.net/rfc/readonly_properties_v2) and
final class contstants (https://wiki.php.net/rfc/final_class_const).
 2021-07-21 12:43:29 +02:00
Nikita Popov
c758510a37 Add support for PHP 8.1 
With the introduction of intersection types, PHP now lexes the
token '&' either as T_AMPERSAND_(NOT_)FOLLOWED_BY_VAR_OR_VARARG.
This completely breaks parsing of any code containing '&'.

Fix this by canonicalizing to the new token format (unconditionally,
independent of emulation) and adjusting the parser to use the two
new tokens.

This doesn't add actual support for intersection types yet.
 2021-07-09 16:52:58 +02:00
Nikita Popov
4848a0d734 Check for \r as newline in closing tag 
Fixes #761.
 2021-04-25 22:42:18 +02:00
Nikita Popov
a8223f228a Add emulation for enum keyword 2021-03-20 17:49:44 +01:00
Stefano Arlandini
bc7a9bf9c2 Remove useless code left from old implementation 2020-12-02 12:54:15 +01:00
Nikita Popov
b9b65a2996 Fix check for token emulation conflicts 2020-09-26 12:29:16 +02:00
Nikita Popov
f66a32e2df Emulate PHP 8 attribute syntax 
Perform emulation by replacing #[ with %[, then patching % back
to # and coalescing #[ into T_ATTRIBUTE if it is a freestanding
token.
 2020-09-06 17:42:38 +02:00
Nikita Popov
e3872b8906 Improve compatibility with other libs defining compat tokens 2020-09-06 15:00:28 +02:00
Nikita Popov
35306de32f Support visibility modifiers in namespaced names 
Fixes #704.
 2020-08-29 16:35:31 +02:00
Nikita Popov
3aadc15e2e Support keywords in namespaced names 2020-08-09 21:11:49 +02:00
Nikita Popov
23d9c17770 Add support for nullsafe operator 2020-08-09 12:08:05 +02:00
Nikita Popov
1a1300aa2a Add reverse emulation support 2020-08-01 22:34:36 +02:00
Nikita Popov
acaf3fecad Implement emulation of PHP 8 T_NAME_* tokens 
Like comment emulation, this is unconditional, as it is required
for core functionality.
 2020-07-23 12:28:13 +02:00
Nikita Popov
739b4b4c60 Fix handling of unterminated comment with trailing newline 
Fixes #688.
 2020-07-22 18:35:55 +02:00
Nikita Popov
4abc531213 Canonicalize to PHP 8 comment token format 
The trailing newline is no longer part of the comment token.
 2020-06-27 18:53:09 +02:00
Nikita Popov
602af9060d Add end line / file position / token position to comments 2020-02-09 16:53:46 +01:00
Nikita Popov
0a80b2d8ee Fix PHP 8 compatibility 
This is a fix to preserve current behavior, but this should be
changed towards doing the same as PHP 8 does.
 2019-10-19 10:49:37 +02:00
Nikita Popov
4fd36b9946 Fix compatibility with T_BAD_CHARACTER in PHP 7.4 2019-08-12 22:10:02 +02:00
Nikita Popov
b9b45dd2bc Insert T_BAD_CHARACTER tokens for missing characters 
The token stream should cover all characters in the original code,
insert a dummy token for missing illegal characters. We should
really be doing this in token_get_all() as well.
 2019-06-30 11:43:48 +02:00
Nikita Popov
a167aa2061 Optimize attribue checks in the lexer 2019-05-12 15:26:26 +02:00
Gabriel Caruso
e0a2043089 [CS] Space before casting 2018-01-13 16:03:57 +01:00
Nikita Popov
5285df8f22 [CS] Use elseif instead of else if 
Conflicts:
	lib/PhpParser/TokenStream.php
 2018-01-13 16:03:36 +01:00
Nikita Popov
fa174b093f Merge branch '3.x' 2017-11-13 01:15:38 +01:00
Nikita Popov
94ca9a7ab9 Use Tokens::class in lexer 
Ref #441.
 2017-11-13 01:14:55 +01:00
Nikita Popov
68e9b91e9c Use fully-qualified names for global constant references 2017-11-10 23:33:12 +01:00
Nikita Popov
47c973b3aa Store start token position in comments 2017-11-04 17:45:14 +01:00
Nikita Popov
a02990a39a Remove PHP 5 substr() workaround 
In PHP 7 it no longer returns false instead of '' in this case.
 2017-09-29 17:51:44 +02:00
TomasVotruba
e2e99f269b Add strict_types to lib code 2017-08-18 23:00:13 +02:00
TomasVotruba
ec535ea14e [cs] use PHP 5.4 short array, since PHP 7.0 is min version 2017-08-13 21:14:28 +02:00
Nikita Popov
7646b31907 Merge branch '3.x' 2017-06-03 15:18:44 +02:00
Romain Neutron
c28b8556f5 Fix Lexer errorHandling when there is no tokens 
I encounter an issue when no tokens exist. An error `Undefined offset -1` is triggered.
 2017-06-03 15:17:45 +02:00
Nikita Popov
b2c6497d63 Remove undefined variable hack 
No longer necessary, as we don't support PHP 5 anymore.
 2017-05-07 19:57:24 +02:00
Nikita Popov
a32e3797d4 Generate PHP 7 type annotations 2017-04-28 21:40:59 +02:00
Matthew Brown
9857a545e2 Remove unused variables (#357) 2017-02-11 11:05:36 +01:00
Matthew Brown
329e90c239 Improve doc comments 2017-02-09 20:49:52 +01:00