관리-도구
편집 파일: tokenize.cpython-311.opt-2.pyc
� c��fR � �N � d Z dZddlZddlZddlmZmZ ddlT ddlm Z d� e e � � D � � g d �z Z[ e n # e $ r eZY nw xY wd � Zd� Zd� Zd � ZdZdZe edez � � z ee� � z ZdZdZdZdZ edd� � Z eeeee� � ZdZ edd� � ee� � z Zdez Z eee� � Z ededz � � Z ee ee� � Z!dZ"dZ#dZ$d Z%d!Z& ee&d"z e&d#z � � Z' ee&d$z e&d%z � � Z( ed&d'd(d)d*d+d,d-d.� � Z)d/Z* ed0d1d2� � Z+ ee)e*e+� � Z, ee!e,e(e� � Z-ee-z Z. ee&d3z ed4d� � z e&d5z ed6d� � z � � Z/ edee'� � Z0e ee0e!e,e/e� � z Z1 e2ej3 e.e1e$e%f� � \ Z4Z5Z6Z7 ed7d8d9d:� � ed7d8d;d<� � z h d=�z Z8 ej3 e"� � ej3 e#� � e6e7d>�d?� e8D � � �d@� e8D � � �dA� e8D � � �Z9d"d#hdB� e8D � � z dC� e8D � � z Z:d4d6hdD� e8D � � z dE� e8D � � z Z;dFZ< G dG� dHe=� � Z> G dI� dJe=� � Z?dK� Z@e@fdL�ZAdM� ZB G dN� dO� � ZC ej3 dPejD � � ZE ej3 dQejD � � ZFdR� ZGdS� ZHdT� ZIdU� ZJeKdVk rUddlLZL eMeLjN � � dk r& eA eOeLjN d � � jP � � dS eAeLjQ jP � � dS dS )WzKa-Ping Yee <ping@lfw.org>z@GvR, ESR, Tim Peters, Thomas Wouters, Fred Drake, Skip Montanaro� N)�BOM_UTF8�lookup)�*� )�tokenc �* � g | ]}|d dk �|��S )r �_� )�.0�xs �=/opt/alt/python311/lib64/python3.11/lib2to3/pgen2/tokenize.py� <listcomp>r % s! � � 0� 0� 0��A�a�D�C�K�K�1�K�K�K� )�tokenize�generate_tokens� untokenizec �8 � dd� | � � z dz S )N�(�|�))�join��choicess r �groupr 0 s � �C�#�(�(�7�"3�"3�3�c�9�9r c � � t | � dz S )Nr �r r s r �anyr 1 s � �%��/�C�/�/r c � � t | � dz S )N�?r r s r �mayber 2 s � �E�7�O�c�1�1r c �: � � t � fd�� D � � � � S )Nc 3 � �K � | ];}�d z D ]3}|� � � |� � � k �,||z V � �4�<dS ))� N)�casefold)r r �y�ls �r � <genexpr>z _combinations.<locals>.<genexpr>4 s` �� � � � � ��!�e�)�� ��q�z�z�|�|�q�z�z�|�|�/K�/K��A��/K�/K�/K�/K�/K�� r )�set)r&