+ }i$^RIHt^RIHt^RIHt^RIHt^RIH t ^RI H t H t H t ^RIHt]'d^RIHt]!]4t]!R 4!R R 44tR #) ) annotations) timedelta) getLogger) TYPE_CHECKING)pairwise) LoadRatioInfoSnapshot SystemInfo) docs_group) Snapshotter Autoscalingc ]tRt^tRtR]!^R7RRRRRR R R /R R lltRRltRRltRR/RRllt R!RRllt R!RRllt R!RRllt R!RRllt RRltR tR#)" SystemStatusaProvides a simple interface for evaluating system resource usage from snapshots collected by `Snapshotter`. This class aggregates and interprets snapshots from a Snapshotter instance to evaluate the current and historical status of system resources like CPU, memory, event loop, and client API usage. It exposes two methods `get_current_system_info` and `get_historical_system_info`. The system information is computed using a weighted average of overloaded messages in the snapshots, with the weights being the time intervals between the snapshots. Each resource is computed separately, and the system is considered as overloaded whenever at least one resource is overloaded. `get_current_system_info` returns a `SystemInfo` data structure that represents the current status of the system. The length of the current timeframe in seconds is configurable by the `max_snapshot_age` option and represents the max age of snapshots to be considered for the computation. `SystemStatus.get_historical_system_info` returns a `SystemInfo` that represents the long-term status of the system. It considers the full snapshot history available in the `Snapshotter` instance. max_snapshot_age)secondscpu_overload_thresholdg?memory_overload_thresholdg?event_loop_overload_thresholdg333333?client_overload_thresholdg333333?c4V^8dQhRRRRRRRRRRR RR R /#)  snapshotterr rrrfloatrrrreturnNone)formats"t/Users/ahmad/.openclaw/workspace/my-crawler/.venv/lib/python3.14/site-packages/crawlee/_autoscaling/system_status.py __annotate__SystemStatus.__annotate__'sYDD D$ D !& D $) D(-D$)D Dc NWnW nW0nW@nWPnW`nR#)aInitialize a new instance. Args: snapshotter: The `Snapshotter` instance to be queried for `SystemStatus`. max_snapshot_age: Defines max age of snapshots used in the `SystemStatus.get_current_system_info` measurement. cpu_overload_threshold: Sets the threshold of overloaded snapshots in the CPU sample. If the sample exceeds this threshold, the system will be considered overloaded. memory_overload_threshold: Sets the threshold of overloaded snapshots in the memory sample. If the sample exceeds this threshold, the system will be considered overloaded. event_loop_overload_threshold: Sets the threshold of overloaded snapshots in the event loop sample. If the sample exceeds this threshold, the system will be considered overloaded. client_overload_threshold: Sets the threshold of overloaded snapshots in the Client sample. If the sample exceeds this threshold, the system will be considered overloaded. N) _snapshotter_max_snapshot_age_cpu_overload_threshold_memory_overload_threshold_event_loop_overload_threshold_client_overload_threshold)selfrrrrrrs&&$$$$$r__init__SystemStatus.__init__'s(2(!1'=$*C'.K+*C'r!cV^8dQhRR/#rrr r)rs"rrr Gs M M Mr!c :VPVPR7#)a)Retrieve and evaluates the current status of system resources. Considers snapshots within the `_max_snapshot_age` timeframe and determines if the system is currently overloaded based on predefined thresholds for each resource type. Returns: An object representing the current system status. )sample_duration)_get_system_infor$r)s&rget_current_system_info$SystemStatus.get_current_system_infoGs$$T5K5K$LLr!cV^8dQhRR/#r-r)rs"rrr Rs ' 'J 'r!c "VP4#)a+Retrieve and evaluates the historical status of system resources. Considers the entire history of snapshots from the Snapshotter to assess long-term system performance and determines if the system has been historically overloaded. Returns: An object representing the historical system status. )r0r1s&rget_historical_system_info'SystemStatus.get_historical_system_infoRs$$&&r!r/Nc V^8dQhRRRR/#)rr/timedelta | Nonerr r)rs"rrr ]s  3C z r!c VPV4pVPV4pVPV4pVPV4p\ VVVVR7#)amGet system information based on the overload state of different resources within a specified duration. Args: sample_duration: Specific duration for which to evaluate the system status. If None, evaluates across the entire history available in the snapshotter. Returns: Aggregated system status indicating whether the system is idle or overloaded. ) memory_infoevent_loop_infocpu_info client_info)_is_memory_overloaded_is_event_loop_overloaded_is_cpu_overloaded_is_client_overloadedr )r)r/mem_infor<r=r>s&$ rr0SystemStatus._get_system_info]s]--o>88I**?;00A  +#   r!c V^8dQhRRRR/#rr/r9rrr)rs"rrr ss P P2B Pm Pr!c nVPPV4pVPW P4#)aDetermine if the CPU has been overloaded within a specified time duration. Args: sample_duration: The duration within which to analyze CPU snapshots. If None, evaluates across the entire history available in the snapshotter. Returns: CPU load ratio information. )r#get_cpu_sample_is_sample_overloadedr%r)r/samples&& rrASystemStatus._is_cpu_overloadedss1""11/B))&2N2NOOr!c V^8dQhRRRR/#rFr)rs"rrr S S5E SQ^ Sr!c nVPPV4pVPW P4#)aDetermine if memory has been overloaded within a specified time duration. Args: sample_duration: The duration within which to analyze memory snapshots. If None, evaluates across the entire history available in the snapshotter. Returns: Memory load ratio information. )r#get_memory_samplerIr&rJs&& rr?"SystemStatus._is_memory_overloaded1""44_E))&2Q2QRRr!c V^8dQhRRRR/#rFr)rs"rrr s W W9I WUb Wr!c nVPPV4pVPW P4#)a-Determine if the event loop has been overloaded within a specified time duration. Args: sample_duration: The duration within which to analyze event loop snapshots. If None, evaluates across the entire history available in the snapshotter. Returns: Event loop load ratio information. )r#get_event_loop_samplerIr'rJs&& rr@&SystemStatus._is_event_loop_overloadeds1""88I))&2U2UVVr!c V^8dQhRRRR/#rFr)rs"rrr rNr!c nVPPV4pVPW P4#)a!Determine if the client has been overloaded within a specified time duration. Args: sample_duration: The duration within which to analyze client snapshots. If None, evaluates across the entire history available in the snapshotter. Returns: Client load ratio information. )r#get_client_samplerIr(rJs&& rrB"SystemStatus._is_client_overloadedrRr!c$V^8dQhRRRRRR/#)rrKzlist[Snapshot] thresholdrrrr)rs"rrr s'"]"]N"]u"]Q^"]r!c V'g\V^R7#\V4^8Xd(\V\V^,P4R7#RpRp\ V4FfwrVVP VP , P 4pV^8d \R4hVP'd W7, pK^WG, pKh W4,;p^8XdRp MW8, p \V\V ^4R7#)aDetermine if a sample of snapshot data is overloaded based on a specified ratio. Args: sample: A list of snapshot data to analyze. threshold: The threshold ratio to use for determining if the sample is overloaded. Returns: An object with an `is_overloaded` property set to `True` if the sample is considered overloaded based on the specified threshold ratio. Otherwise, `is_overloaded` is set to `False`. ) limit_ratio actual_ratiogzLNegative time. Code assumptions are not valid. Expected time sorted samples.) rlenr is_overloadedr created_at total_seconds ValueErrorround) r)rKr\overloaded_timenon_overloaded_timepreviouscurrenttime total_timeoverloaded_ratios &&& rrI"SystemStatus._is_sample_overloadeds YQG G v;!  YU6RS9KbKbEcd d!!)&!1 H&&)<)<<KKMDax !opp$$$'#+#"2*? ?JA E" .; GWYZA[\\r!)r(r%r'r$r&r#)N)__name__ __module__ __qualname____firstlineno____doc__rr*r2r6r0rAr?r@rBrI__static_attributes__rr!rrrs"D'0&: D ), D ,/ D03D,/D@ M ' d , P S W S"]"]r!rN) __future__rdatetimerloggingrtypingrmore_itertoolsrcrawlee._autoscaling._typesrr r crawlee._utils.docsr crawlee._autoscalingr rnloggerrrr!rr}sS# #KK*0 8  Mt]t]t]r!