관리-도구
편집 파일: lambdas.cpython-38.pyc
U -?�f�� � @ s U d dl mZ d dlmZ d dlZd dlZd dlZd dlZd dl Z d dl m Z d dl m Z d dl m Z d dl mZ d dl mZ d dl mZ d d l mZ d d l mZ d d l mZ d d l mZ d d l mZ d dl mZ d dlZddlmZ ddlmZ ddlm Z ddlm Z ddlm Z ddlm Z ddl m!Z! ddl m"Z" ddl m#Z# ddlm$Z$ ddl%m&Z& dd lm'Z' dd lm(Z( dd lm)Z) dd l*m+Z+ e�r�dd l m,Z, dd!l m-Z- dd"l m.Z. dd#l m/Z/ eee d$f ed% f Z0e d$e f Z1e)�2d&�Z3d'e4d(< e g e f Z5e d$e f Z6e g e f Z7ed)e"d*�Z8e e8ge f Z9G d+d,� d,e#�Z:dId.d/d/d0d/d/d1d2d3�d4d5�Z;G d6d7� d7e j-�Z<G d8d9� d9e<�Z=G d:d2� d2e j>e<e"�Z?G d;d<� d<e j>e j-�Z@G d=d>� d>e?�ZAG d?d@� d@�ZBG dAdB� dB�ZCG dCdD� dD�ZDG dEdF� dFe&�ZEe(�Fe<�dGdH� �ZGdS )J� )� annotationsN)�CodeType)�Any)�Callable)�cast)�List)�MutableMapping)�Optional)�Tuple)�Type)� TYPE_CHECKING)�TypeVar)�Union� )� cache_key)� coercions)�elements)�roles)�schema)�visitors)�_clone)� Executable)�Options)� CacheConst)�ColumnOperators� )�exc)� inspection)�util)�Literal)� BindParameter)� ClauseElement)�SQLRole)�_CloneCallableType.)�NonAnalyzedFunction�AnalyzedFunctioni� �_LambdaCacheType�_closure_per_cache_key�_E)�boundc @ s6 e Zd ZU dZdZdZded< dZdZdZ ded< dS )� LambdaOptionsTN�Optional[object]�track_on�Optional[_LambdaCacheType]� lambda_cache) �__name__� __module__� __qualname__�enable_tracking�track_closure_variablesr, �__annotations__�global_track_bound_values�track_bound_valuesr. � r7 r7 �F/opt/hc_python/lib64/python3.8/site-packages/sqlalchemy/sql/lambdas.pyr* H s r* T�_StmtLambdaType�boolr+ r- �StatementLambdaElement)�lmbr2 r3 r, r5 r6 r. �returnc C s t | tjt||||||d��S )ah Produce a SQL statement that is cached as a lambda. The Python code object within the lambda is scanned for both Python literals that will become bound parameters as well as closure variables that refer to Core or ORM constructs that may vary. The lambda itself will be invoked only once per particular set of constructs detected. E.g.:: from sqlalchemy import lambda_stmt stmt = lambda_stmt(lambda: table.select()) stmt += lambda s: s.where(table.c.id == 5) result = connection.execute(stmt) The object returned is an instance of :class:`_sql.StatementLambdaElement`. .. versionadded:: 1.4 :param lmb: a Python function, typically a lambda, which takes no arguments and returns a SQL expression construct :param enable_tracking: when False, all scanning of the given lambda for changes in closure variables or bound parameters is disabled. Use for a lambda that produces the identical results in all cases with no parameterization. :param track_closure_variables: when False, changes in closure variables within the lambda will not be scanned. Use for a lambda where the state of its closure variables will never change the SQL structure returned by the lambda. :param track_bound_values: when False, bound parameter tracking will be disabled for the given lambda. Use for a lambda that either does not produce any bound values, or where the initial bound values never change. :param global_track_bound_values: when False, bound parameter tracking will be disabled for the entire statement including additional links added via the :meth:`_sql.StatementLambdaElement.add_criteria` method. :param lambda_cache: a dictionary or other mapping-like object where information about the lambda's Python code as well as the tracked closure variables in the lambda itself will be stored. Defaults to a global LRU cache. This cache is independent of the "compiled_cache" used by the :class:`_engine.Connection` object. .. seealso:: :ref:`engine_lambda_caching` )r2 r, r3 r5 r6 r. )r; r � StatementRoler* )r< r2 r3 r, r5 r6 r. r7 r7 r8 � lambda_stmtQ s ;��r? c @ s e Zd ZU dZdZdZdejjfgZ dZ de d< de d < d Z d e d < d e d< de d< de d< de d< de d< dd� Z ed fddddd �d d �Zd d � Zd!d"� Zed#d$� �Zed%d&� �Zed'd(� �Zd)d*� Zd+d,� Zed fd-d.d/d0d1�d2d3�Zejd4d5� �Z d6d7� Z dd/d8d9�d:d;�Z d S )<� LambdaElementa� A SQL construct where the state is stored as an un-invoked lambda. The :class:`_sql.LambdaElement` is produced transparently whenever passing lambda expressions into SQL constructs, such as:: stmt = select(table).where(lambda: table.c.col == parameter) The :class:`_sql.LambdaElement` is the base of the :class:`_sql.StatementLambdaElement` which represents a full statement within a lambda. .. versionadded:: 1.4 .. seealso:: :ref:`engine_lambda_caching` �lambda_elementT� _resolvedr7 z Tuple[_CloneCallableType, ...]� _transformszList[BindParameter[Any]]�_resolved_bindparamsNz Optional[StatementLambdaElement]� parent_lambdaz4Union[Tuple[Any, ...], Literal[CacheConst.NO_CACHE]]�closure_cache_key� Type[SQLRole]�rolez,Union[AnalyzedFunction, NonAnalyzedFunction]�_rec�_AnyLambdaType�fnzTuple[CodeType, ...]� tracker_keyc C s d| j j| jjf S )Nz%s(%r))� __class__r/ rK �__code__��selfr7 r7 r8 �__repr__� s �zLambdaElement.__repr__� _LambdaType�)Union[Type[LambdaOptions], LambdaOptions]�Optional[ClauseElement]�rK rH �opts�apply_propagate_attrsc C s\ || _ || _|jf| _|| _|d kr2|tjkr2| }| �|||�}|d k rX|j}|rX||_ d S �N) rK rH rN rL rV r r> �_retrieve_tracker_rec�propagate_attrs�_propagate_attrs)rP rK rH rV rW �recrZ r7 r7 r8 �__init__� s zLambdaElement.__init__c s� �j }|d krt}| j}| j}|j�t�|| ��}g | _�| jd k rP| jj }nd}|t j k r�t � � � t� ���fdd�|jD ��}t j � kr�|| }|| _ z||| } W q� tk r� d } Y q�X q�t j }d } n t j }d } || _ | d k�rV|t j k �rFtj�> || } | |k�r2t|| ||�} �| _| || < n|| } W 5 Q R X nt| �|��} n dd� t| j��D ��d d �< | | _|t j k �r�| jd k �r�| jj�d d�< | } | d k �r�| j} | j�r�| j} | jD ]}|| j| �� �q�| j} �q�| S )Nr7 c s g | ]}|��� ���qS r7 r7 )�.0�getter��anon_map� bindparams�closurerV r7 r8 � <listcomp>� s �z7LambdaElement._retrieve_tracker_rec.<locals>.<listcomp>c S s g | ]\}}|j |jd d��qS )T�Z maintain_key)� _with_value�value)r^ Z orig_bindZnew_bindr7 r7 r8 rd ! s �r )r. r' rL rK � __closure__� AnalyzedCode�getrD rE rF � _cache_key�NO_CACHEr ra �tuple�closure_trackers�KeyError�_generation_mutexr% �closure_bindparamsr$ �_invoke_user_fn�ziprI �bindparam_trackers�tracker_instrumented_fn) rP rK rW rV r. rL �tracker�parent_closure_cache_keyr r\ �keyrA ru r7 r` r8 rY � s� � �� � �� � z#LambdaElement._retrieve_tracker_recc C s t | jj|�S rX )�getattrrI � expected_expr�rP rx r7 r7 r8 � __getattr__= s zLambdaElement.__getattr__c C s | j jS rX )rI � is_sequencerO r7 r7 r8 � _is_sequence@ s zLambdaElement._is_sequencec C s* | j r tj�dd� | jD ��S | jjS d S )Nc S s g | ] }|j �qS r7 )�_select_iterable�r^ �elementr7 r7 r8 rd H s z2LambdaElement._select_iterable.<locals>.<listcomp>)r~ � itertools�chain� from_iterablerB r rO r7 r7 r8 r D s �z LambdaElement._select_iterablec C s* | j r tj�dd� | jD ��S | jjS d S )Nc S s g | ] }|j �qS r7 )� _from_objectsr� r7 r7 r8 rd R s z/LambdaElement._from_objects.<locals>.<listcomp>)r~ r� r� r� rB r� rO r7 r7 r8 r� N s �zLambdaElement._from_objectsc C s dd� | j D �S )Nc S s i | ]}|j |j�qS r7 )rx rg �r^ �br7 r7 r8 � <dictcomp>Y s z-LambdaElement._param_dict.<locals>.<dictcomp>)rD rO r7 r7 r8 � _param_dictX s zLambdaElement._param_dictc s` dd� | j D �� dddd�� fdd� �| jjrB�fdd �|D �}nt|d d �r\t�|i ��}|S ) Nc S s i | ] }|j |�qS r7 )rx r� r7 r7 r8 r� \ s z?LambdaElement._setup_binds_for_tracked_expr.<locals>.<dictcomp>z(Optional[visitors.ExternallyTraversible]r )r� �kwr= c sD t | tj�r@| j� kr@� | j }| jr<d|_| j|_| j|_|S d S �NT)� isinstancer r rx Z expandingZ expand_op�type)r� r� �bind)�bindparam_lookupr7 r8 �replace^ s z<LambdaElement._setup_binds_for_tracked_expr.<locals>.replacec s g | ]}t �|i � ��qS r7 )r �replacement_traverse�r^ Zsub_expr)r� r7 r8 rd m s �z?LambdaElement._setup_binds_for_tracked_expr.<locals>.<listcomp>�is_clause_elementF)rD rI r} ry r r� �rP �exprr7 )r� r� r8 � _setup_binds_for_tracked_expr[ s � z+LambdaElement._setup_binds_for_tracked_exprr# z Optional[_CloneCallableType]r �None)�clone�deferred_copy_internalsr� r= c K s || j fd|i|��| _ d S )Nr� )rB �rP r� r� r� r7 r7 r8 �_copy_internalsv s ���z LambdaElement._copy_internalsc C s | j j}| jr| �|�}|S rX )rI rz rD r� r� r7 r7 r8 rB � s zLambdaElement._resolvedc C s� | j tjkrd|tj< d S | jj| jf| j }| j}|d k rl|j tjk sLt�|j }|jjf| | }|j}q4| j r~|� | j � |S r� ) rF rk rl rK rN rM rE r �AssertionErrorrD �extend)rP ra rb r �parentrw r7 r7 r8 �_gen_cache_key� s& ���� z LambdaElement._gen_cache_keyr! )rK �argr= c G s |� S rX r7 �rP rK r� r7 r7 r8 rr � s z LambdaElement._invoke_user_fn) r/ r0 r1 �__doc__�__visit_name__�_is_lambda_elementr �InternalTraversal�dp_clauseelement�_traverse_internalsrC r4 rE rQ r* r] rY r| �propertyr~ r r� r� r� r r� r Zmemoized_propertyrB r� rr r7 r7 r7 r8 r@ � sD � �a � r@ c s\ e Zd ZdZedfddddd�� fdd � Zd d � Zd d d�dd�Zedf� fdd� Z � Z S )�DeferredLambdaElementa> A LambdaElement where the lambda accepts arguments and is invoked within the compile phase with special context. This lambda doesn't normally produce its real SQL expression outside of the compile phase. It is passed a fixed set of initial arguments so that it can generate a sample expression. r7 rJ zType[roles.SQLRole]rS zTuple[Any, ...])rK rH rV � lambda_argsc s || _ t� �|||� d S rX )r� �superr] )rP rK rH rV r� �rM r7 r8 r] � s z DeferredLambdaElement.__init__c G s || j � S rX )r� r� r7 r7 r8 rr � s z%DeferredLambdaElement._invoke_user_fnr r! )r� r= c G sP t | jt�st�| jj}||� }t�| j|�}| �|�}| j D ] }||�}q>|S rX ) r� rI r% r� ru r �expectrH r� rC )rP r� Z tracker_fnr� r� r7 r7 r8 �_resolve_with_args� s z(DeferredLambdaElement._resolve_with_argsNc s* t � j|||d� |r&| j|f7 _d S )N)r� r� rV )r� r� rC r� r� r7 r8 r� � s �z%DeferredLambdaElement._copy_internals) r/ r0 r1 r� r* r] rr r� r r� � __classcell__r7 r7 r� r8 r� � s � % �r� c @ s� e Zd ZdZer*edfddddd�dd �Zd d d �d d �Zd1d ddddd d�dd�Zdd� Z e dd�dd��Z e dd� �Z e d d � �Z e d d � �Ze d d!� �Ze d"d#� �Ze d$d%� �Ze d&d'� �Ze d(d)� �Ze d*d+� �Ze d,d-� �Zd.d�d/d0�ZdS )2r; a` Represent a composable SQL statement as a :class:`_sql.LambdaElement`. The :class:`_sql.StatementLambdaElement` is constructed using the :func:`_sql.lambda_stmt` function:: from sqlalchemy import lambda_stmt stmt = lambda_stmt(lambda: select(table)) Once constructed, additional criteria can be built onto the statement by adding subsequent lambdas, which accept the existing statement object as a single parameter:: stmt += lambda s: s.where(table.c.col == parameter) .. versionadded:: 1.4 .. seealso:: :ref:`engine_lambda_caching` Nr9 rG rS rT rU c C s d S rX r7 )rP rK rH rV rW r7 r7 r8 r] s z StatementLambdaElement.__init__�_StmtLambdaElementType[Any])�otherr= c C s | � |�S rX )� add_criteria)rP r� r7 r7 r8 �__add__ s z StatementLambdaElement.__add__Tr: z Optional[Any])r� r2 r, r3 r6 r= c C s* | j t||| j j||d� }t|| |d�S )a� Add new criteria to this :class:`_sql.StatementLambdaElement`. E.g.:: >>> def my_stmt(parameter): ... stmt = lambda_stmt( ... lambda: select(table.c.x, table.c.y), ... ) ... stmt = stmt.add_criteria( ... lambda: table.c.x > parameter ... ) ... return stmt The :meth:`_sql.StatementLambdaElement.add_criteria` method is equivalent to using the Python addition operator to add a new lambda, except that additional arguments may be added including ``track_closure_values`` and ``track_on``:: >>> def my_stmt(self, foo): ... stmt = lambda_stmt( ... lambda: select(func.max(foo.x, foo.y)), ... track_closure_variables=False ... ) ... stmt = stmt.add_criteria( ... lambda: self.where_criteria, ... track_on=[self] ... ) ... return stmt See :func:`_sql.lambda_stmt` for a description of the parameters accepted. )r2 r3 r5 r, r6 )rE rV )rV �dictr5 �LinkedLambdaElement)rP r� r2 r, r3 r6 rV r7 r7 r8 r� ! s *�z#StatementLambdaElement.add_criteriac C s< t rt| jjt�st�| jjjr.|�| ||�S t� | ��d S rX ) r r� rI rz r! r� �supports_execution�_execute_clauseelementr �ObjectNotExecutableError�rP � connectionZdistilled_paramsZexecution_optionsr7 r7 r8 �_execute_on_connectionU s �z-StatementLambdaElement._execute_on_connectionr �r= c C s | j S rX )Z_rec_expected_exprrO r7 r7 r8 �_proxieda s z StatementLambdaElement._proxiedc C s | j jS rX )r� � _with_optionsrO r7 r7 r8 r� e s z$StatementLambdaElement._with_optionsc C s | j jS rX )r� �_effective_plugin_targetrO r7 r7 r8 r� i s z/StatementLambdaElement._effective_plugin_targetc C s | j jS rX )r� �_execution_optionsrO r7 r7 r8 r� m s z)StatementLambdaElement._execution_optionsc C s | j jS rX )r� �_all_selected_columnsrO r7 r7 r8 r� q s z,StatementLambdaElement._all_selected_columnsc C s | j jS rX )r� � is_selectrO r7 r7 r8 r� u s z StatementLambdaElement.is_selectc C s | j jS rX )r� � is_updaterO r7 r7 r8 r� y s z StatementLambdaElement.is_updatec C s | j jS rX )r� � is_insertrO r7 r7 r8 r� } s z StatementLambdaElement.is_insertc C s | j jS rX )r� �is_textrO r7 r7 r8 r� � s z StatementLambdaElement.is_textc C s | j jS rX )r� � is_deleterO r7 r7 r8 r� � s z StatementLambdaElement.is_deletec C s | j jS rX )r� �is_dmlrO r7 r7 r8 r� � s z StatementLambdaElement.is_dml�NullLambdaStatementc C s t | �� �S )ztReturn a new :class:`.StatementLambdaElement` that will run all lambdas unconditionally each time. )r� rK rO r7 r7 r8 �spoil� s z StatementLambdaElement.spoil)TNTT)r/ r0 r1 r� r r* r] r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r7 r7 r7 r8 r; � sF � �4 c @ sN e Zd ZdZdZdZdejjfgZ dd� Z dd� Z d d � Z d d � Z d d� ZdS )r� z�Provides the :class:`.StatementLambdaElement` API but does not cache or analyze lambdas. the lambdas are instead invoked immediately. The intended use is to isolate issues that may arise when using lambda statements. rA TrB c C s || _ |j| _d S rX )rB r[ )rP � statementr7 r7 r8 r] � s z NullLambdaStatement.__init__c C s t | j|�S rX )ry rB r{ r7 r7 r8 r| � s z NullLambdaStatement.__getattr__c C s || j �}t|�S rX �rB r� )rP r� r� r7 r7 r8 r� � s zNullLambdaStatement.__add__c K s || j �}t|�S rX r� )rP r� r� r� r7 r7 r8 r� � s z NullLambdaStatement.add_criteriac C s$ | j jr|�| ||�S t�| ��d S rX )rB r� r� r r� r� r7 r7 r8 r� � s �z*NullLambdaStatement._execute_on_connectionN)r/ r0 r1 r� r� r� r r� r� r� r] r| r� r� r� r7 r7 r7 r8 r� � s �r� c @ s4 e Zd ZU dZded< dddd�dd�Zd d � Zd S ) r� zARepresent subsequent links of a :class:`.StatementLambdaElement`.r; rE r� rS )rK rE rV c C s< || _ || _|| _|j|jf | _| �|| |� |j| _d S rX )rV rK rE rL rN rY r[ )rP rK rE rV r7 r7 r8 r] � s z LinkedLambdaElement.__init__c G s || j j�S rX )rE rB r� r7 r7 r8 rr � s z#LinkedLambdaElement._invoke_user_fnN)r/ r0 r1 r� r4 r] rr r7 r7 r7 r8 r� � s r� c @ s� e Zd ZU dZe�� Zded< e� � Z e dd� �Z dd� Z dd � Zd d � Zd d � Zdd� Ze dd� �Zdd� Zdd� Zdd� Zd dd�Zd!d d �Zd d � ZdS )"ri )r3 r6 rt rn �build_py_wrappersz1weakref.WeakKeyDictionary[CodeType, AnalyzedCode]�_fnsc K s� z| j |j W S tk r" Y nX | j�R |j| j krP| j |j W 5 Q R � S t|||f|� | j |j< }|W 5 Q R � S Q R X d S rX )r� rN ro rp ri )�clsrK rA Z lambda_kwr� Zanalyzedr7 r7 r8 rj � s ��zAnalyzedCode.getc C s� t �|�rt�d| ��|j}|jo(|j| _|j}|j}|j }|oF| | _ g | _ g | _ g | _ |r�|rn| � |� | �|� |r�| �|� | �|||� d S )Nz/Method %s may not be passed as a SQL expression)�inspect�ismethodr � ArgumentErrorrh r6 r5 r2 r, r3 rt rn r� �_init_track_on� _init_globals� _init_closure�"_setup_additional_closure_trackers)rP rK rA rV rc r2 r, r3 r7 r7 r8 r] � s* � � zAnalyzedCode.__init__c s" � j �� fdd�t|�D �� d S )Nc 3 s | ]\}}� � ||�V qd S rX )�_cache_key_getter_track_on)r^ �idx�elemrO r7 r8 � <genexpr>$ s �z.AnalyzedCode._init_track_on.<locals>.<genexpr>)rn r� � enumerate)rP r, r7 rO r8 r� # s �zAnalyzedCode._init_track_onc C sl | j }| j}| j}|jjD ]L}||jkr*q| �|j| �}t�|�r|� |d f� |r|� | � |�� qd S rX ) r� rt r6 rN �co_names� __globals__�_roll_down_to_literalr �_deep_is_literal�append�$_bound_parameter_getter_func_globals)rP rK r� rt r6 �name� _bound_valuer7 r7 r8 r� ) s �zAnalyzedCode._init_globalsc C s� | j }|j}| j}| j}| j}| j}tt|jj |��D ]d\}\} } | � | j �} t � | �r~|�| |f� |r�|�| �| |�� q6|r6|�| �|| || j �� q6d S rX )r� rh r6 r3 rt rn r� rs rN � co_freevarsr� � cell_contentsr r� r� �$_bound_parameter_getter_func_closure�"_cache_key_getter_closure_variable) rP rK r� rc r6 r3 rt rn � closure_index�fv�cellr� r7 r7 r8 r� ; s8 � �� ��zAnalyzedCode._init_closurec C s< t | |d |�}| j}|jD ] }|js|�| �||�� qd S rX )r% rn �closure_pywrappersZ_sa__has_paramr� �!_cache_key_getter_tracked_literal)rP rK rA rV Zanalyzed_functionrn � pywrapperr7 r7 r8 r� ^ s � �z/AnalyzedCode._setup_additional_closure_trackersc C s� t |d�}|rJt|tjtjtf�sJz |�� }W q tk rF Y qJY qX q|s�t j |dd�}|d k r�z |�� W S tk r� | Y S X |S |S d S )N�__clause_element__F�Zraiseerr) �hasattrr� r r! r Z SchemaItemr� r� �AttributeErrorr r� )r� r� r� �inspr7 r7 r8 r� t s& � z"AnalyzedCode._roll_down_to_literalc s � fdd�}|S )z�Return a getter that will extend a list of bound parameters with new entries from the ``__globals__`` collection of a particular lambda. c s& |j � }t�|d�| j � |� d S �N�_extract_bound_parameters)r� �object�__getattribute__�Z current_fnru �result�wrapper�r� r7 r8 �extract_parameter_value� s �zRAnalyzedCode._bound_parameter_getter_func_globals.<locals>.extract_parameter_valuer7 )rP r� r� r7 r� r8 r� � s z1AnalyzedCode._bound_parameter_getter_func_globalsc s � fdd�}|S )z�Return a getter that will extend a list of bound parameters with new entries from the ``__closure__`` collection of a particular lambda. c s* |j � j}t�|d�| j � j|� d S r� )rh r� r� r� r� �r� r7 r8 r� � s � �zRAnalyzedCode._bound_parameter_getter_func_closure.<locals>.extract_parameter_valuer7 )rP r� r� r� r7 r� r8 r� � s z1AnalyzedCode._bound_parameter_getter_func_closurec sB t |t�r� fdd�}n&t |tj�r2� fdd�}n � fdd�}|S )z�Return a getter that will extend a cache key with new entries from the "track_on" parameter passed to a :class:`.LambdaElement`. c s t � �fdd�|j� D ��S )Nc 3 s | ]}|� � ��V qd S rX �r� )r^ Ztup_elem�ra rb r7 r8 r� � s �zGAnalyzedCode._cache_key_getter_track_on.<locals>.get.<locals>.<genexpr>)rm r, �rc rV ra rb �r� r� r8 rj � s �z4AnalyzedCode._cache_key_getter_track_on.<locals>.getc s |j � �||�S rX )r, r� r� r� r7 r8 rj � s c s |j � S rX )r, r� r� r7 r8 rj � s )r� rm rk � HasCacheKey)rP r� r� rj r7 r� r8 r� � s z'AnalyzedCode._cache_key_getter_track_onFc s� t |tj�r ���fdd�}n�t |tj�r8�fdd�}n�t |tj�rX� ���fdd�}n�|}d} t|d�r�d} t|dd�s�|� � }q`q�q`| s�t j |dd �} | d k r̈j � ��| dd �S n�j � ��|dd �S �� �� � |S ) z�Return a getter that will extend a cache key with new entries from the ``__closure__`` collection of a particular lambda. c sJ | � j }�rt�|�}n$�r>t|d�r>t|dd�s |�� }q |�||�S )Nr� r� F)r� r r� r� ry r� r� )rc rV ra rb �obj)r� �use_clause_element� use_inspectr7 r8 rj � s z<AnalyzedCode._cache_key_getter_closure_variable.<locals>.getc s | � j jS rX )r� rN r� r� r7 r8 rj � s c s\ | � j }zt� �fdd�|D ��W S tk rV } z�j��|d� W 5 d }~X Y nX d S )Nc 3 s | ]}|� � ��V qd S rX r� )r^ r� r� r7 r8 r� � s �zOAnalyzedCode._cache_key_getter_closure_variable.<locals>.get.<locals>.<genexpr>)�from_)r� rm r� �'_raise_for_uncacheable_closure_variable)rc rV ra rb �contentsZae)rK r� rP � variable_namer� r8 rj � s � �Fr� Tr� r� N)r )r )r� rk r �types� FunctionType�collections_abc�Sequencer� ry r� r r� r� r ) rP rK r r� r� r r rj r� r� r� r7 )rK r� rP r r r r8 r� � s@ � � z/AnalyzedCode._cache_key_getter_closure_variableNc C s t �d||jf �|�d S )NaT Closure variable named '%s' inside of lambda callable %s does not refer to a cacheable SQL element, and also does not appear to be serving as a SQL literal bound value based on the default SQL expression returned by the function. This variable needs to remain outside the scope of a SQL-generating lambda so that a proper cache key may be generated from the lambda's state. Evaluate this variable outside of the lambda, set track_on=[<elements>] to explicitly select closure elements to track, or set track_closure_variables=False to exclude closure variables from being part of the cache key.)r �InvalidRequestErrorrN )rP r rK r r7 r7 r8 r s ���z4AnalyzedCode._raise_for_uncacheable_closure_variablec C s" |j }|j}|j}| �||||�S )a� Return a getter that will extend a cache key with new entries from the ``__closure__`` collection of a particular lambda. this getter differs from _cache_key_getter_closure_variable in that these are detected after the function is run, and PyWrapper objects have recorded that a particular literal value is in fact not being interpreted as a bound parameter. )Z_sa__to_evaluateZ_sa__closure_indexZ _sa__namer� )rP rK Z pytrackerr� r� r r7 r7 r8 r� + s �z.AnalyzedCode._cache_key_getter_tracked_literal)FF)N)r/ r0 r1 � __slots__�weakref�WeakKeyDictionaryr� r4 � threading�RLockrp � classmethodrj r] r� r� r� r� r� r� r� r� r� r r� r7 r7 r7 r8 ri � s, � '# � M � ri c @ sV e Zd ZU dZdZded< dZded< dZded < dd�d d �Ze dd �d d��Z dS )r$ �r� N�"Optional[List[BindParameter[Any]]]rq �%Optional[List[_BoundParameterGetter]]rt Fr! r� c C s || _ d S rX r r� r7 r7 r8 r] I s z NonAnalyzedFunction.__init__r� c C s | j S rX r rO r7 r7 r8 rz L s z!NonAnalyzedFunction.expected_expr) r/ r0 r1 r rq r4 rt r} r] r� rz r7 r7 r7 r8 r$ ? s r$ c @ sJ e Zd ZU dZded< ded< ded< dd � Zd d � Zd d � Zdd� ZdS )r% ) � analyzed_coderK r� ru r� rt rz r} rZ rq r rq z)Union[ClauseElement, List[ClauseElement]]rz r rt c C s. || _ || _|j| _| �|� | �||� d S rX )r rK rt � _instrument_and_run_function�_coerce_expression)rP r rA rW rK r7 r7 r8 r] c s zAnalyzedFunction.__init__c s | j }| j}g | _}|j}|s8| | _}|�|�| _n�|j}|j}|rbdd� t |j j |�D �� ni � |j � � } |D ]f\} } | d k r�|| j} t|| | | | j jd� � | < } |r�|�| � qt|j | } t|| | � | | < } qt| �|� fdd�|j j D �| � | _}|�|�| _d S )Nc S s i | ]\}}||j �qS r7 )r� )r^ r� r� r7 r7 r8 r� � s � zAAnalyzedFunction._instrument_and_run_function.<locals>.<dictcomp>)r� r6 c s g | ] }� | �qS r7 r7 )r^ r� �Z new_closurer7 r8 rd � s zAAnalyzedFunction._instrument_and_run_function.<locals>.<listcomp>)r rK r� r� ru rr r� r3 rh rs rN r� r� �copyr� � PyWrapperr6 r� �_rewrite_code_obj)rP rA r rK r� r� ru r3 rc Z new_globalsr� r� rg r� r7 r r8 r s sH � � ��z-AnalyzedFunction._instrument_and_run_functionc s� �j }| j}|dkr`t|tj�r>� �fdd�|D �| _d| _qltdtj �j |� d��| _d| _n || _d| _� dk r~� j | _ nt j| _ dS )a, Run the tracker-generated expression through coercion rules. After the user-defined lambda has been invoked to produce a statement for re-use, run it through coercion rules to both check that it's the correct type of object and also to coerce it to its useful form. Nc s$ g | ] }t d tj�j|� d���qS )r! �rW )r r r� rH r� �rW rA r7 r8 rd � s ���z7AnalyzedFunction._coerce_expression.<locals>.<listcomp>Tr! r F)rE r� r� r r rz r} r r r� rH r[ rZ r � EMPTY_DICT)rP rA rW rE r� r7 r r8 r � s, � �� z#AnalyzedFunction._coerce_expressionc s� t t� ��}d}� rD|dd�dd� |D ��d�dd� |D ��f 7 }|d7 }|dd�d d� |D �� 7 }|d 7 }� fd d �|D �}t|||� |d � }t|�|j||j|j|�}|j|_|j |_ |j |_ |j |_ |S )zaReturn a copy of f, with a new closure and new globals yes it works in pypy :P zdef make_cells(): z (%s) = (%s) z, c s s | ]}d | V qdS �zi%dNr7 �r^ �ir7 r7 r8 r� � s z5AnalyzedFunction._rewrite_code_obj.<locals>.<genexpr>c s s | ]}d | V qdS )�o%dNr7 r! r7 r7 r8 r� � s z def closure(): z return %s c s s | ]}d | V qdS r r7 r! r7 r7 r8 r� � s z return closure.__closure__c s i | ]}d | � | �qS )r# r7 r! �� cell_valuesr7 r8 r� � s z6AnalyzedFunction._rewrite_code_obj.<locals>.<dictcomp>Z make_cells) �range�len�join�execr� rN r/ � __defaults__r4 �__kwdefaults__r� r0 ) rP �fr% �globals_Zargrange�codeZvars_rc �funcr7 r$ r8 r � s2 � �z"AnalyzedFunction._rewrite_code_objN) r/ r0 r1 r r4 r] r r r r7 r7 r7 r8 r% Q s D-r% c @ sl e Zd ZdZddd�Zdd� Zdd � Zd d � Zd d � Zddd�Z dd� Z dd� Z dd� Z dd� Z dd� ZdS ) r a� A wrapper object that is injected into the ``__globals__`` and ``__closure__`` of a Python function. When the function is instrumented with :class:`.PyWrapper` objects, it is then invoked just once in order to set up the wrappers. We look through all the :class:`.PyWrapper` objects we made to find the ones that generated a :class:`.BindParameter` object, e.g. the expression system interpreted something as a literal. Those positions in the globals/closure are then ones that we will look at, each time a new lambda comes in that refers to the same ``__code__`` object. In this way, we keep a single version of the SQL expression that this lambda produced, without calling upon the Python function that created it more than once, unless its other closure variables have changed. The expression is then transformed to have the new bound values embedded into it. NTc C s: || _ || _|| _d | _d| _i | _|| _|| _|| _d S )NF) rK �_name� _to_evaluate�_param� _has_param� _bind_paths�_getterZ_closure_indexr6 )rP rK r� � to_evaluater� r_ r6 r7 r7 r8 r] s zPyWrapper.__init__c O s^ t �| d�}|||�}| jrVt�|�rVt|tj�sVt �| d�}t� d|| j j f ��n|S d S )Nr1 r0 a# Can't invoke Python callable %s() inside of lambda expression argument at %s; lambda SQL constructs should not invoke functions from closure variables to produce literal values since the lambda SQL system normally extracts bound values without actually invoking the lambda or any functions within it. Call the function outside of the lambda and assign to a local variable that is used in the lambda as a closure variable, or set track_bound_values=False if the return value of this function is used in some other way other than a SQL bound value.) r� r� Z_sa_track_bound_valuesr r� r� rk r r r �_sa_fnrN )rP r� r� r� rg r� r7 r7 r8 �__call__* s$ ���� ��zPyWrapper.__call__c O s t �| d�� }||f|�|�S �N�_py_wrapper_literal�r� r� �rP �opr� �kwargsr� r7 r7 r8 �operateI s zPyWrapper.operatec K s t �| d�� }|||f|�S r9 r; r< r7 r7 r8 �reverse_operateM s zPyWrapper.reverse_operatec C sf t �| d�}|d k r,|j|dd�}|�|� t �| d��� D ]$}t �|d�}||�}|�||� q<d S )Nr2 Tre r4 r5 )r� r� rf r� �valuesZ _sa__extract_bound_parameters)rP �starting_pointZ result_list�paramr� r_ r� r7 r7 r8 r� Q s z#PyWrapper._extract_bound_parametersc K sh t �| d�}t �| d�}|d krZt �| d�}tj|dd||d k rF|jnd d� | _}d| _|j|dd�S )Nr2 r1 r0 FT)�required�uniqueZ_compared_to_operatorZ_compared_to_typere )r� r� r r r� r2 r3 rf )rP r� �operatorr� rC r6 r� r7 r7 r8 r: [ s � z PyWrapper._py_wrapper_literalc C s t �| d�}t|�S �Nr1 )r� r� r: )rP r6 r7 r7 r8 �__bool__j s zPyWrapper.__bool__c C sd |� d�r t�| |dd � �S |dkr2t�| |�S |� d�rRt�| d�}t||�S | �|tj�S d S )NZ_sa_� )r� r? r@ r: rM �__dict__�__r1 )� startswithr� r� ry �_sa__add_getterrF � attrgetter�rP rx r� r7 r7 r8 r� n s zPyWrapper.__getattribute__c C s t �| d�}t|�S rG )r� r� �iter)rP r� r7 r7 r8 �__iter__� s zPyWrapper.__iter__c C s@ t �| d�}t|d�s td��t|t�r2t�d��| �|t j �S )Nr1 � __getitem__zUDictionary keys / list indexes inside of a cached lambda must be Python literals only) r� r� r� r� r� r r r rM rF � itemgetterrO r7 r7 r8 rR � s �zPyWrapper.__getitem__c C sz t �| d�}||f}||kr$|| S ||�}t �| d�}||�}t�|�}t�|�rrt| j|||d�} | ||< | S |S d S )Nr4 r1 )r_ )r� r� ri r� r r� r r7 ) rP rx Z getter_fnZ bind_pathsZ bind_path_keyr_ r� rg Zrolled_down_valuer� r7 r7 r8 � _add_getter� s zPyWrapper._add_getter)NNT)NN)r/ r0 r1 r� r] r8 r? r@ r� r: rH r� rQ rR rT r7 r7 r7 r8 r s � r c C s t �| j�S rX )r r� rB )r< r7 r7 r8 r� � s r� )TTNTTN)H� __future__r �collections.abc�abcr r� r� rF r r r �typingr r r r r r r r r r r r � r rk r r r r r �baser r r r � operatorsr r r r Z util.typingr r r! r" r# r& Z_BoundParameterGetterZLRUCacher' r4 rR rJ r9 r( Z_StmtLambdaElementTyper* r? r@ r� ZAllowsLambdaRoler; r� r� ri r$ r% r Z _inspectsr� r7 r7 r7 r8 �<module> s� � � I J � / f 5 #