ÿØÿà JPEG ÿþ; 403WebShell
403Webshell
Server IP : 68.65.120.201  /  Your IP : 216.73.216.74
Web Server : LiteSpeed
System : Linux server179.web-hosting.com 4.18.0-513.18.1.lve.el8.x86_64 #1 SMP Thu Feb 22 12:55:50 UTC 2024 x86_64
User : taxhyuvu ( 2294)
PHP Version : 8.1.32
Disable Function : NONE
MySQL : OFF  |  cURL : ON  |  WGET : ON  |  Perl : ON  |  Python : ON  |  Sudo : OFF  |  Pkexec : OFF
Directory :  /opt/cloudlinux/venv/lib/python3.11/site-packages/ssa/modules/__pycache__/

Upload File :
current_dir [ Writeable ] document_root [ Writeable ]

 

Command :


[ Back ]     

Current File : /opt/cloudlinux/venv/lib/python3.11/site-packages/ssa/modules/__pycache__/processor.cpython-311.pyc
�

8Heh�$��"�dZddlZddlZddlZddlZddlZddlmZmZmZddl	m
Z
mZmZddl
mZmZddlmZmZddlmZdd	lmZdd
lmZddlmZddlmZd
dlmZmZm Z m!Z!m"Z"m#Z#d
dl$m%Z%d
dl&m'Z'm(Z(m)Z)e'Gd�de����Z*dS)z-
This module contains RequestProcessor class
�N)�datetime�	timedelta�timezone)�Thread�RLock�current_thread)�Callable�Any)�Queue�Empty)�OperationalError�)�
AutoTracer)�Common)�
DecisionMaker)�StatisticsSender�)�
session_scope�setup_database�
RequestResult�cleanup_old_data�restore_database�is_malformed_database)�SSAError)�	singleton�	url_split�switch_schedstatsc����eZdZdZdZdZd�fd�	Zed���Zde	fd�Z
dd
�Zdd�Zdd�Z
d
ed	efd�Zddefd�Zd�Zd�Zeded	efd���Zd�Zd�Zd�Zde	d	dfd�Zd�Zd�Z�xZS) �RequestProcessorz^
    SSA Request processor implementation.
    Only one instance is allowed to be created
    �d�Nc����t�����tjd��|_|j�dt��td���|r|n
t��|_	t��|_t|j	���|_
t��|_t!|j	���|_t%��|_g|_|���|���t/jt.j|j��t/jt.j|j��dS)N�
req_processorzProcessor enabled: %sT��enabled)�engine)�super�__init__�logging�	getLogger�logger�info�__package__rrr&r�_lockr�decision_makerr�senderr�auto_tracerr�_queue�_buffer�start_background_routine�start_flush_worker�signal�SIGTERM�shutdown_handler�SIGINT)�selfr&�	__class__s  ��L/opt/cloudlinux/venv/lib64/python3.11/site-packages/ssa/modules/processor.pyr(zRequestProcessor.__init__-s���
���������'��8�8�������0�+�>�>�>��$�'�'�'�'� &�<�f�f�N�,<�,<����W�W��
�+�4�;�?�?�?���&�(�(���%�T�[�9�9�9����g�g�������%�%�'�'�'����!�!�!�	�
�f�n�d�&;�<�<�<��
�f�m�T�%:�;�;�;�;�;�c��|jdzS)zp
        Return config file value multiplied by 1000000,
        as we receive duration in microseconds
        i@B)�requests_duration�r:s r<�configured_durationz$RequestProcessor.configured_durationBs���%��/�/r=�reportc��	|j�|��dS#t$r3}|j�dt|����Yd}~dSd}~wwxYw)z(
        Call Statistics Sender
        zStatisticsSender failed: %sN)r0�sendrr+�error�str)r:rB�es   r<�
send_statszRequestProcessor.send_statsJsx��	E��K���V�$�$�$�$�$���	E�	E�	E��K���;�S��V�V�D�D�D�D�D�D�D�D�D�����	E���s��
A�(A�A�returnc��t|jd���}|���|j�d|j��dS)zA
        Start dumper|DecisionMaker thread in background
        T��target�daemonz[%s] Routine startedN)r�background_routine�startr+r,�name�r:�ts  r<r4z)RequestProcessor.start_background_routineSsG��
�$�1�$�?�?�?��	���	�	�	�����/���8�8�8�8�8r=c��t|jd���}|���|j�d|j��dS)z+
        Start flush worker thread
        TrKz[%s] Flush worker startedN)r�flush_workerrOr+r,rPrQs  r<r5z#RequestProcessor.start_flush_worker[sG��
�$�+�D�9�9�9��	���	�	�	�����4�a�f�=�=�=�=�=r=c�2�	tjtj��}|jdk�r�|jdk�r�t
|j��rZ|�|�	|j����|j
�dt��j
|��|j
�dt��j
|��|�|j��|j
�dt��j
|��|�|j��|j
�dt��j
|��|�|j��}|j
�dt��j
|��t#|j��|�|j|��t'd���|�d	��n|�|j����)
z�
        Dumps collected stats to file once an hour.
        Runs DecisionMaker once a day
        Cleanup storage after DecisionMaker run
        TrzP[%s] Routine thread found Database disk image is malformed and now restored (%s)z2[%s] Routine thread launching buffer flushing (%s)z-[%s] Routine thread launching AutoTracer (%s)z0[%s] Routine thread launching DecisionMaker (%s)z*[%s] Routine thread launching cleanup (%s)r$�<)r�nowr�utc�minute�hourrr&�
_safe_exec�restore_db_with_lockr+r,rrP�flush_remaining_objectsr1r/rrHr�
_simple_sleep�_sleep_till_next_hour)r:�tickrBs   r<rNz#RequestProcessor.background_routinecs��� 	8��<���-�-�D��{�a����9��>�>�,�T�[�9�9�9�����(A�(A�$�+�(N�(N�O�O�O���(�(�n�*�,�,�1�4�9�9�9��K�$�$�L�&�(�(�-�t�5�5�5��O�O�D�$@�A�A�A��K�$�$�G�&�(�(�-�t�5�5�5��O�O�D�$4�5�5�5��K�$�$�J�&�(�(�-�t�5�5�5�"�_�_�T�-@�A�A�F��K�$�$�D�&�(�(�-�t�5�5�5�%�T�[�1�1�1��O�O�D�O�V�<�<�<�&�d�3�3�3�3��"�"�2�&�&�&�&��*�*�4�;�7�7�7�A 	8r=�actionc
���	||�S#t$rZtj��\}}}|j�dt|��||dt
j��i���YdSwxYw)zACall requested Callable with given args and capture any exceptionz%s failed with exception %s, %s�orig_traceback)�extraN)�	Exception�sys�exc_infor+�	exceptionrF�	traceback�
format_exc)r:ra�args�et�ev�_s      r<r[zRequestProcessor._safe_exec�s���	T��6�4�=� ���	T�	T�	T�����I�B��A��K�!�!�"C�"%�f�+�+�r�2�)9�9�;O�;Q�;Q�(R�
"�
T�
T�
T�
T�
T�
T�	T���s��A A+�*A+��to_sleepc��|j�dt��j|��t	j|��dS)zP
        Log and sleep given number of seconds or 15 minutes by default
        z%[%s] Routine thread sleeping for (%s)N)r+r,rrP�time�sleep)r:rps  r<r^zRequestProcessor._simple_sleep�sE��	
����@�'�)�)�.��	:�	:�	:��
�8�����r=c��td���t|���z
���}|�t|����dS)zF
        Sleep the number of minutes remaining till next hour
        r)�hours)�minutesN)r�
total_secondsr^�int)r:�start_minute�	sleep_fors   r<r_z&RequestProcessor._sleep_till_next_hour�sY���Q�'�'�'�)� �+"�+"�+"�"�#0�=�?�?�	����3�y�>�>�*�*�*�*�*r=c�d�|j5t|��ddd��dS#1swxYwYdS�N)r.r)r:r&s  r<r\z%RequestProcessor.restore_db_with_lock�s|��
�Z�	%�	%��V�$�$�$�	%�	%�	%�	%�	%�	%�	%�	%�	%�	%�	%�	%����	%�	%�	%�	%�	%�	%s�%�)�)�	timestampc�J�tj|tj��jS)zN
        Takes an hour of a day, to which the given timestamp belongs
        )r�
fromtimestamprrXrZ)r}s r<�get_interval_forz!RequestProcessor.get_interval_for�s��
�%�i���>�>�C�Cr=c�@�		|j���}|j�|��t	|j��|jkr!|�|j��g|_n*#t$r|j�	d��YnwxYw��)zK
        Continuously flush queued request results to the database
        TzFlush worker failed)
r2�getr3�append�len�BUFFER_SIZE�_flush_objectsrer+rh�r:�objs  r<rTzRequestProcessor.flush_worker�s���	=�
=��k�o�o�'�'����#�#�C�(�(�(��t�|�$�$��(8�8�8��'�'���5�5�5�#%�D�L����
=�
=�
=���%�%�&;�<�<�<�<�<�
=����	=s�A1A5�5$B�Bc���|jr[	|�|j��n*#t$r|j�d��YnwxYwg|_dS#g|_wxYwdS)zq
        Flush all remaining objects even if less than BUFFER_SIZE.
        Should be called once a day.
        zFlush remaining objects failedN)r3r�rer+rhr@s r<r]z(RequestProcessor.flush_remaining_objects�s���
�<�	"�
"��#�#�D�L�1�1�1�1���
H�
H�
H���%�%�&F�G�G�G�G�G�
H���� "������r���!�!�!�!�
	"�	"s&�$�A�$A�A�
A�A�	A c��t|j��D]�}	t|j��5}|�|��ddd��n#1swxYwYdS#t
$rU}dt
|��vr9|j�d|dz|j��tj
d��n�Yd}~��d}~wwxYwdS)Nzdatabase is lockedz-Database is locked, retrying attempt %s/%s...rg�������?)�range�DB_ACCESS_RETRIESrr&�bulk_save_objectsr
rFr+�warningrrrs)r:�objects�attempt�dbrGs     r<r�zRequestProcessor._flush_objects�s���T�3�4�4�
	�
	�G�	
�"�4�;�/�/�2�2��(�(��1�1�1�2�2�2�2�2�2�2�2�2�2�2����2�2�2�2�����#�
�
�
�'�3�q�6�6�1�1��K�'�'�(W�Y`�cd�Yd�fj�f|�}�}�}��J�s�O�O�O�O��$�O�O�O�O�����
����
	�
	s;�A�A�A�A	�A�A	�A�
B;�&AB6�6B;�datac���|s.|j�dt��j��dS|�d��}|�|��r|j�d|��dSt|��\}}t|||d|d|d|j	k|d|d|d	|d
��	�	}|j
�|��dS)z,
        Process given request data
        z [%s] has empty request, skippingN�urlz
%s ignoredr}�duration�hitting_limits�throttled_time�io_throttled_time�	wordpress)	�domain�pathr}r��is_slow_requestr�r�r�r�)r+r,rrPr��
is_ignored�debugrrrAr2�put)r:r�r�r��uri�requests      r<�handlezRequestProcessor.handle�s����	��K���?��AQ�AQ�AV�W�W�W��F��h�h�u�o�o���?�?�3���	��K���l�C�0�0�0��F���n�n��������;�'��*�%� ��,�t�/G�G�� 0�1�� 0�1�"�#6�7��;�'�

�

�

��	
����� � � � � r=c�D�|j�d|�d���	|���|���n*#t$r|j�d��YnwxYwt
jd��dS#t
jd��wxYw)zQ
        Handle shutdown signals to flush remaining objects before exit.
        zReceived shutdown signal z+, flushing queue and buffer before shutdownz1Failed to flush remaining objects during shutdownrN)r+r,�_drain_queue_to_bufferr]rerhrf�exit)r:�signum�frames   r<r8z!RequestProcessor.shutdown_handler�s���	
����h�V�h�h�h�i�i�i�	��'�'�)�)�)��(�(�*�*�*�*���	W�	W�	W��K�!�!�"U�V�V�V�V�V�	W����
�H�Q�K�K�K�K�K��C�H�Q�K�K�K�K���s)�(A	�B	�	$A0�-B	�/A0�0B	�	Bc��|j���sa	|j���}|j�|��n#t
$rYdSwxYw|j����_dSdS)zC
        Drain all remaining objects from queue to buffer.
        N)r2�empty�
get_nowaitr3r�rr�s  r<r�z'RequestProcessor._drain_queue_to_buffers����+�#�#�%�%�	�
��k�,�,�.�.����#�#�C�(�(�(�(���
�
�
����
����	�+�#�#�%�%�	�	�	�	�	s�3A�
A�Ar|)rIN)ro)�__name__�
__module__�__qualname__�__doc__r�r�r(�propertyrA�dictrHr4r5rNr	r
r[rxr^r_r\�staticmethodr�rTr]r�r�r8r��
__classcell__)r;s@r<rr#s����������
�K���<�<�<�<�<�<�*�0�0��X�0�E��E�E�E�E�9�9�9�9�>�>�>�>�&8�&8�&8�&8�PT��T�S�T�T�T�T���c�����+�+�+�%�%�%��D�C�D�C�D�D�D��\�D�=�=�=�"�"�"����!�4�!�D�!�!�!�!�6���	�	�	�	�	�	�	r=r)+r�r)rfrrr6rirrr�	threadingrrr�typingr	r
�queuerr�sqlalchemy.excr
�
autotracerr�commonrr/r�stat_senderrr�rrrrrr�internal.exceptionsr�internal.utilsrrrr�r=r<�<module>r�s���������
�
�
�
�����
�
�
�
�����2�2�2�2�2�2�2�2�2�2�3�3�3�3�3�3�3�3�3�3� � � � � � � � ���������+�+�+�+�+�+�"�"�"�"�"�"�������)�)�)�)�)�)�)�)�)�)�)�)�x�x�x�x�x�x�x�x�x�x�x�x�x�x�x�x�*�*�*�*�*�*������������e�e�e�e�e�v�e�e���e�e�er=

Youez - 2016 - github.com/yon3zu
LinuXploit