Format: application/x-python-code
1 o
2
3 `�hk �
4 @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlmZ d dlm Z d dl
5 m Z d dl m
6 Z
7 e je jd� e �e�Zedd�d d
8 � �Zd efd d
9 �Zddd�Z ddededededed ef dd�ZdS )� N)� lru_cache)� AsyncClient)�available_functions)�SYSTEM_PROMPTS)�level� )�maxsizec C s t � S )N)� list_models� r
10 r
11 �>C:\Users\shubh\Videos\agent\agent\modules\llm\ollama_client.py�list_models_cached s r �returnc
12 C st zdd l } | �d�}|�� dd� |�� �dg �D �W S ty9 } zt�dt|�� �� g W Y d }~S d }~ww )Nr z http://localhost:11434/api/tagsc S s g | ]}|d �qS )�namer
13 )�.0�modelr
14 r
15 r �
16 <listcomp> s z list_models.<locals>.<listcomp>�modelszModel listing failed: )�requests�get�raise_for_status�json� Exception�logger�error�str)r �response�er
17 r
18 r r s
19 ��r c
20 C s� dd� } dd� }zdd l }|�d�}|jdkr t�d� W d S W n ty; t�d � | d
21 �r9t�d � |d
22 � Y nw ztjd d
23 gtjtjd� t�d� W d S tyk } zt� d|� �� W Y d }~d S d }~ww )Nc S sF t � t jt j��}|�d| f�dkW d � S 1 s w Y d S )N� localhostr )�socket�AF_INET� SOCK_STREAM�
24 connect_ex)�port�sr
25 r
26 r �is_port_in_use s $�z-ensure_ollama_running.<locals>.is_port_in_usec S s� t �ddg�D ]8}|jdd�D ]/}|jj| kr>z |�� W d S ty= } zt�d| � d|� �� W Y d }~qd }~ww qqd S )N�pidr Zinet)�kindz Failed to kill process on port z: ) �psutilZ process_iterZnet_connections�laddrr" �killr r r )r" �proc�connr r
27 r
28 r � free_port" s
29 "�����z(ensure_ollama_running.<locals>.free_portr zhttp://localhost:11434�� zOllama is already running.z-Ollama not running. Attempting to start it...i�, z#Port 11434 is in use, freeing it...�ollamaZserve)�stdout�stderrzOllama server started.zFailed to start Ollama: )
30 r r � status_coder �infor �
31 subprocess�Popen�DEVNULLr )r$ r, r r r r
32 r
33 r �ensure_ollama_running s.
34
35
36
37 �
38
39 �� ��r6 �core_llm�promptr �tools�context�
40 agent_typec
41 � sf �t �|�� t d �}d|d�g| �dt|�d��}zzt� }|j|||ddid�I d H }|j} | j}
42 t� d| j
43 � | j
44 r�| j
45 d } | j j } | j j
46 }
47 t|
48 t�rP|
49 nt�|
50 �}d
51 d � |�� D �}| tv r�tjt| fi |��I d H }dd |� d
52 | d d � �d�}|j||gddid�I d H }|jjW S |
53 W S ty� } zt�d� dt|�� �W Y d }~S d }~ww )NZCORE_LLM�system)�role�contentr: Z temperatureg�������?)r �messagesr9 �optionsz
54 Assistant: %sr c S s8 i | ]\}}||d krt |t�r|�� rt|�n|�qS )� max_results)�
55 isinstancer �isdigit�int)r �k�vr
56 r
57 r �
58 <dictcomp>^ s 8 z query_ollama.<locals>.<dictcomp>zBased on this result:
59 z/, try to answer the original question by user: �����r> g )r r? r@ zError in query_ollama:zOllama Tool Call Error: )r r �upperr r �chat�messager> r r2 Z
60 tool_calls�functionr � argumentsrB �dictr �loads�itemsr �asyncio� to_threadr � exception)r8 r r9 r: r; Z
61 system_promptZformatted_messages�clientr �msg�assistant_textZ tool_call�fn_nameZraw_args�args�resultZmini_sysZfollowupr r
62 r
63 r � query_ollama> sP ��� � �
64 �
65 �
66
67 ��rZ )r
68 N)r7 )�loggingr r3 r' r rQ � functoolsr r. r �
69 modules.toolsr �%modules.system_prompts.system_promptsr � basicConfig�INFO� getLogger�__name__r r �listr r6 r rN rZ r
70 r
71 r
72 r �<module> s<
73
74
75
76 &�������