관리-도구
편집 파일: _tokenizer.cpython-38.pyc
U -?�f� � @ s� U d dl Z d dlZd dlmZ d dlmZmZmZmZm Z m Z ddl m Z eG dd� d��Z G dd � d e�Zd d d d dde�dej�dddde�dej�e�e je j ejejB �ddddddd d �Zd ed < G d d!� d!�ZdS )"� N)� dataclass)�Dict�Iterator�NoReturn�Optional�Tuple�Union� )� Specifierc @ s& e Zd ZU eed< eed< eed< dS )�Token�name�text�positionN)�__name__� __module__� __qualname__�str�__annotations__�int� r r �Q/opt/hc_python/lib/python3.8/site-packages/wheel/vendored/packaging/_tokenizer.pyr s r c sB e Zd ZdZeeeeef dd�� fdd� Zed�dd�Z� Z S ) �ParserSyntaxErrorz7The provided source text could not be parsed correctly.N)�message�source�span�returnc s || _ || _|| _t� �� d S )N)r r r �super�__init__)�selfr r r �� __class__r r r s zParserSyntaxError.__init__�r c C s> d| j d d| j d | j d d }d�| j| j|g�S )N� r �~r �^z )r �joinr r )r �markerr r r �__str__ s *zParserSyntaxError.__str__) r r r �__doc__r r r r r' � __classcell__r r r r r s � r z\(z\)z\[z\]�;�,zk ( ('[^']*') | ("[^"]*") ) z(===|==|~=|!=|<=|>=|<|>)z \b(or|and)\bz\bin\bz\bnot\ba� \b( python_version |python_full_version |os[._]name |sys[._]platform |platform_(release|system) |platform[._](version|machine|python_implementation) |python_implementation |implementation_(name|version) |extra )\b z\@z[^ \t]+z \b[a-zA-Z0-9][a-zA-Z0-9._-]*\bz\.\*z \+[a-z0-9]+(?:[-_\.][a-z0-9]+)*z[ \t]+�$)�LEFT_PARENTHESIS�RIGHT_PARENTHESIS� LEFT_BRACKET� RIGHT_BRACKET� SEMICOLON�COMMA� QUOTED_STRING�OP�BOOLOP�IN�NOT�VARIABLE� SPECIFIER�AT�URL� IDENTIFIER�VERSION_PREFIX_TRAIL�VERSION_LOCAL_LABEL_TRAIL�WS�END�&Dict[str, Union[str, re.Pattern[str]]]� DEFAULT_RULESc @ s� e Zd ZdZeddd�dd�Zedd�dd �Zd d �eeed �d d�Zeee d�dd�Z e d�dd�Z ddd�ee e e e ed�dd�Zejeeeed d�dd��ZdS ) � Tokenizerz�Context-sensitive token parsing. Provides methods to examine the input stream to check whether the next token matches. rA N)r �rulesr c C s* || _ dd� |�� D �| _d | _d| _d S )Nc S s i | ]\}}|t �|��qS r )�re�compile)�.0r �patternr r r � <dictcomp>f s z&Tokenizer.__init__.<locals>.<dictcomp>r )r �itemsrD � next_tokenr )r r rD r r r r _ s �zTokenizer.__init__)r r c C s | � |�r| �� dS )z8Move beyond provided token name, if at current position.N)�check�read)r r r r r �consumel s zTokenizer.consumeF)�peek)r rO r c C sz | j dks td|�d| j ����|| jks8td|����| j| }|�| j| j�}|dkr^dS |svt||d | j�| _ dS )z�Check whether the next token has the provided name. By default, if the check succeeds, the token *must* be read before another check. If `peek` is set to `True`, the token is not loaded and would need to be checked again. NzCannot check for z, already have zUnknown token name: Fr T)rK �AssertionErrorrD �matchr r r )r r rO � expressionrQ r r r rL q s �� zTokenizer.check)r �expectedr c C s" | � |�s| �d|� ���| �� S )zsExpect a certain token name next, failing with a syntax error otherwise. The token is *not* read. z Expected )rL �raise_syntax_errorrM )r r rS r r r �expect� s zTokenizer.expectr! c C s0 | j }|dk st�| jt|j�7 _d| _ |S )z%Consume the next token and return it.N)rK rP r �lenr )r �tokenr r r rM � s zTokenizer.read)� span_start�span_end)r rX rY r c C s8 |dkr| j n||dkr | j n|f}t|| j|d��dS )z.Raise ParserSyntaxError at the given position.N)r r )r r r )r r rX rY r r r r rT � s ��z Tokenizer.raise_syntax_error)� open_token� close_token�aroundr c c sf | � |�r| j}| �� nd }d V |d kr0d S | � |�sZ| jd|� d|� d|� �|d� | �� d S )NzExpected matching z for z, after )rX )rL r rM rT )r rZ r[ r\ � open_positionr r r �enclosing_tokens� s �zTokenizer.enclosing_tokens)r r r r( r r rN �boolrL r rU rM r r r rT � contextlib�contextmanagerr r^ r r r r rC X s. � �� �rC )r` rE � dataclassesr �typingr r r r r r � specifiersr r � Exceptionr rF �VERBOSE�_operator_regex_str�_version_regex_str� IGNORECASErB r rC r r r r �<module> sN � � ��3