????
Your IP : 18.221.124.95
�
uy�e^
� � � d dl Z d dlZd dlZd dlmZmZ d dlmZmZmZm Z m
Z
m Z m Z m
Z
d dlmZ d dlmZ d dlmZ dZdZ e� � Z G d � d
e� � Zd � Zd � Zd
� Zd� Zd� Z dd�Z ej defd�� � Z dS )� N)�datetime� timedelta)�Column�Boolean�DateTime�Integer�String�
create_engine�event�func)�declarative_base)� Inspector)�Sessionz/var/lve/ssa.db� c �� � e Zd ZdZdZ eed�� � Z eedd�� � Z eedd�� � Z
eed�� � Z eed�� � Z ee
d�� � Z ee
d�� � Z eed�� � Z eed�� � Z ee
d�� � Z e ed�� � ej � � � � � Z e ed�� � ej � � ej � � �
� � Zd S ) �
RequestResultay
Describes processed request stored in database file.
E.g.
{
"timestamp": "1650008727",
"url": "http://mydomain.com/index.php",
"duration": 162077,
"hitting_limits": false,
"throttled_time": 0,
"io_throttled_time": 0,
"wordpress": true
}
Note: created_at, updated_at is saved in local TZ format
�
scrape_resultT)� primary_keyF)�index�nullable)r )�timezone)�server_default)�onupdater N)�__name__�
__module__� __qualname__�__doc__�
__tablename__r r �idr �domain�path� timestamp�durationr �is_slow_request�hitting_limits�throttled_time�io_throttled_time� wordpressr r �now�
created_at�
updated_at� � �=/opt/cloudlinux/venv/lib64/python3.11/site-packages/ssa/db.pyr r " sM � � � � � �� � $�M� ���T� *� *� *�B�
�V�F�$��
7�
7�
7�F� �6�&��u� 5� 5� 5�D���w��/�/�/�I��v�g��.�.�.�H� �f�W�u�5�5�5�O��V�G�e�4�4�4�N��V�G�e�4�4�4�N� ��w��7�7�7����w��/�/�/�I�����$�/�/�/����
�
�K�K�K�J�����$�/�/�/�(�$�(�*�*�U]�UY�U]�U_�U_�`�`�`�J�J�Jr- r c �B � t j � � t t �� � z
}t | � � 5 }|� t � � � t j |k � � � � � ddd� � dS # 1 swxY w Y dS )zD
Removes outdated records from database, saving disk space.
)�daysN)
r �todayr �RETENTION_TIME_DAYS�
session_scope�queryr �filterr* �delete)�engine�
n_days_ago�sessions r. �cleanup_old_datar: G s� � � � �!�!�I�3F�$G�$G�$G�G�J� �v� � � �'��
�
�m�$�$�
�V�M�,�z�9�
:�
:�
�V�X�X�X�� � � � � � � � � � � ���� � � � � � s �AB�B�Bc �f � t | � � s!t j � | � � d S d S �N)�
is_db_present�Base�metadata�
create_all)r7 s r. �create_db_if_not_existrA R s8 � � �� � � )� �
� � ��(�(�(�(�(�)� )r- c �� � t j � t � � sdS t j | � � }d� |� � � D � � }t |� � dk S )NFc � � g | ]}|��S r, r, )�.0�tables r. �
<listcomp>z!is_db_present.<locals>.<listcomp>[ s � �
G�
G�
G��e�
G�
G�
Gr- r )�osr! �isfile�SSA_DBr � from_engine�get_table_names�len)r7 �database_inspection�tabless r. r= r= W s^ � �
�7�>�>�&� !� !� ��u�#�/��7�7��
G�
G�!4�!D�!D�!F�!F�
G�
G�
G�F� �v�;�;��?�r- c �0 � | � d� � d S )NzPRAGMA journal_mode = WAL)�execute)� dbapi_con�
con_records r. �setup_wal_moderS _ s � �
���1�2�2�2�2�2r- c � �� dt � ��| r�� d���fd�}t d|d�� � }t j |dt � � t |� � |S )Nzfile:z?mode=roc �0 �� t j � d�� � S )NT)�uri)�sqlite3�connect)�connection_strings �r. �<lambda>z!_setup_database.<locals>.<lambda>g s �� �g�o�&7�T�B�B�B� r- z sqlite:////F)�creator�echorX )rI r
r �listenrS rA )�readonlyr[ r7 rY s @r. �_setup_databaser_ c sz �� �(��(�(��� ;� 0� :� :� :��B�B�B�B�G�
��w�U�� � �F�
�L���N�3�3�3��6�"�"�"� �Mr- Fc � � t | � � S r< )r_ )r^ s r. �setup_databasera p s � � �8� $� $�$r- �returnc # �� K � t | �� � } |V � |� � � n# |� � � � xY w |� � � dS # |� � � w xY w)zF
Provide a transactional scope around a series of operations.
)�bindN)r �commit�rollback�close)r7 r9 s r. r3 r3 t s� � � � �
�6�"�"�"�G���
�
�
����������������
���� �
�
�
��������
�
�������s �- �A �A�A � A4)F) rG �
contextlibrW r r �
sqlalchemyr r r r r r
r r �sqlalchemy.ext.declarativer
� sqlalchemy.engine.reflectionr �sqlalchemy.ormr rI r2 r> r r: rA r= rS r_ ra �contextmanagerr3 r, r- r. �<module>rn s� ��
� � � � � � � � ���� (� (� (� (� (� (� (� (�� � � � � � � � � � � � � � � � � � � � 8� 7� 7� 7� 7� 7� 2� 2� 2� 2� 2� 2� "� "� "� "� "� "� ��� ������"a� "a� "a� "a� "a�D� "a� "a� "a�J� � �)� )� )�
� � �3� 3� 3�
�
�
�%� %� %� %� �� �W� � � � �� � � r-