+ }ih^RIHt^RIHtHt^RIHt^RIHtH t ^RI H t ]'d;^RI H t ^RIHt^RIHt^R IHt^R IHt^R IHtHtHt^R IHt^R IHt^RIHt] !R4!RR] 44t ]!RR7] !R4!RR444t!] !R4!RR]44t"R#)) annotations)ABCabstractmethod) dataclass) TYPE_CHECKINGProtocol) docs_group) AsyncIterator)AbstractAsyncContextManager) timedelta) TracebackType)Request) HttpHeaders HttpMethod HttpPayload) ProxyInfo)Session) StatisticsOtherct]tRt^tRt]RRl4t]RRl4t]RRl4tRR lt R R lt R t R #) HttpResponsezBDefine the interface that any HTTP response object must implement.cV^8dQhRR/#)returnstr)formats"l/Users/ahmad/.openclaw/workspace/my-crawler/.venv/lib/python3.14/site-packages/crawlee/http_clients/_base.py __annotate__HttpResponse.__annotate__s55c5c R#)z&The HTTP version used in the response.Nrselfs&r http_versionHttpResponse.http_versionr!cV^8dQhRR/#)rrintr)rs"rrr s==S=r!c R#)z.The HTTP status code received from the server.Nrr#s&r status_codeHttpResponse.status_coder'r!cV^8dQhRR/#)rrrr)rs"rrr #s999r!c R#)z*The HTTP headers received in the response.Nrr#s&rheadersHttpResponse.headers"r'r!cV^8dQhRR/#)rrbytesr)rs"rrr &s  E r!c "R#5i)a4Read the entire content of the response body. This method loads the complete response body into memory at once. It should be used for responses received from regular HTTP requests (via `send_request` or `crawl` methods). Raises: RuntimeError: If called on a response received from the `stream` method. Nrr#s&rreadHttpResponse.read&cV^8dQhRR/#)rrzAsyncIterator[bytes]r)rs"rrr 0s   1  r!c R#)aIterate over the content of the response body in chunks. This method should be used for responses received from the `stream` method to process large response bodies without loading them entirely into memory. It allows for efficient processing of potentially large data by yielding chunks sequentially. Raises: RuntimeError: If the stream has already been consumed or if the response was not obtained from the `stream` method. Nrr#s&r read_streamHttpResponse.read_stream0r'r!rN) __name__ __module__ __qualname____firstlineno____doc__propertyr%r+r/r4r:__static_attributes__rr!rrrsNL 55==99    r!rT)frozenzCrawling contextsc&]tRt^=t$RtR]R&RtR#)HttpCrawlingResultzResult of an HTTP-only crawl. Mainly for the purpose of composing specific crawling contexts (e.g. `BeautifulSoupCrawlingContext`, `ParselCrawlingContext`, ...). r http_responserN)r<r=r>r?r@__annotations__rBrr!rrErE=s  5r!rEz HTTP clientsc  ]tRt^JtRt]RR/RRll4t]RRl4t]RR R R R R R R /R Rll4t ]RRRR RR RR R R R R /RRll4t ]RRRR RR RR R R R R /RRll4t ]RRl4t RRlt RRltRtR #) HttpClientzUAn abstract base class for HTTP clients used in crawlers (`BasicCrawler` subclasses).persist_cookies_per_sessionTc V^8dQhRRRR/#)rrJboolrNoner)rs"rrHttpClient.__annotate__Os  &*   r!c WnRVnR#)zpInitialize a new instance. Args: persist_cookies_per_session: Whether to persist cookies per HTTP session. FN)_persist_cookies_per_session_active)r$rJs&$r__init__HttpClient.__init__Ns-H) r!cV^8dQhRR/#)rrrLr)rs"rrrN_sr!c VP#)z'Indicate whether the context is active.)rQr#s&ractiveHttpClient.active^s||r!sessionN proxy_info statisticstimeoutc 0V^8dQhRRRRRRRRR R R R /#) rrequestrrXSession | NonerYProxyInfo | NonerZzStatistics | Noner[timedelta | NonerrEr)rs"rrrNdsF     %  &  "   r!c "R#5i)aPerform the crawling for a given request. This method is called from `crawler.run()`. Args: request: The request to be crawled. session: The session associated with the request. proxy_info: The information about the proxy to be used. statistics: The statistics object to register status codes. timeout: Maximum time allowed to process the request. Raises: ProxyError: Raised if a proxy-related error occurs. Returns: The result of the crawling. Nr)r$r]rXrYrZr[s&&$$$$rcrawlHttpClient.crawlcr6r7methodGETr/payloadc8V^8dQhRRRRRRRRR R R R R RRR/#)rurlrrdrr/#HttpHeaders | dict[str, str] | NonerfHttpPayload | NonerXr^rYr_r[r`rrr)rs"rrrNsZ     5  $    % "   r!c "R#5i)aGSend an HTTP request via the client. This method is called from `context.send_request()` helper. Args: url: The URL to send the request to. method: The HTTP method to use. headers: The headers to include in the request. payload: The data to be sent as the request body. session: The session associated with the request. proxy_info: The information about the proxy to be used. timeout: Maximum time allowed to process the request. Raises: ProxyError: Raised if a proxy-related error occurs. Returns: The HTTP response received from the server. Nrr$rhrdr/rfrXrYr[s&&$$$$$$r send_requestHttpClient.send_requestr6r7c8V^8dQhRRRRRRRRR R R R R RRR/#)rrhrrdrr/rirfrjrXr^rYr_r[r`rz)AbstractAsyncContextManager[HttpResponse]r)rs"rrrNsZ     5  $    % "  3 r!c R#)aStream an HTTP request via the client. This method should be used for downloading potentially large data where you need to process the response body in chunks rather than loading it entirely into memory. Args: url: The URL to send the request to. method: The HTTP method to use. headers: The headers to include in the request. payload: The data to be sent as the request body. session: The session associated with the request. proxy_info: The information about the proxy to be used. timeout: The maximum time to wait for establishing the connection. Raises: ProxyError: Raised if a proxy-related error occurs. Returns: An async context manager yielding the HTTP response with streaming capabilities. Nrrls&&$$$$$$rstreamHttpClient.streamr'r!cV^8dQhRR/#)rrrMr)rs"rrrNs  t r!c "R#5i)zClean up resources used by the client. This method is called when the client is no longer needed and should be overridden in subclasses to perform any necessary cleanup such as closing connections, releasing file handles, or other resource deallocation. Nrr#s&rcleanupHttpClient.cleanupr6r7cV^8dQhRR/#)rrrIr)rs"rrrNs  * r!c "VP'd$\RVPP R24hRVnV#5i)z~Initialize the client when entering the context manager. Raises: RuntimeError: If the context manager is already active. The z is already active.T)rQ RuntimeError __class__r<r#s&r __aenter__HttpClient.__aenter__s< <<<dnn&=&=%>>QRS S  s?Ac(V^8dQhRRRRRRRR/#)rexc_typezBaseException | None exc_value tracebackzTracebackType | NonerrMr)rs"rrrNs,  , 9M Zn   r!c "VP'g$\RVPP R24hVP 4GRjxL RVnR#L 5i)zDeinitialize the client and clean up resources when exiting the context manager. Raises: RuntimeError: If the context manager is already active. ryz is not active.NF)rQrzr{r<ru)r$rrrs&&&&r __aexit__HttpClient.__aexit__sJ|||dnn&=&=%>oNO Olln  sA A A A)rQrP)r<r=r>r?r@rrRrArVrbrmrqrur|rrBrr!rrIrIJs5_ -1   #'  (,  )-  %)  6 #  8<  '+  #' (, %)  > #  8<  '+  #' (, %)  @     r!rIN)# __future__rabcrr dataclassesrtypingrrcrawlee._utils.docsr collections.abcr contextlibr datetimer typesr crawleercrawlee._typesrrrcrawlee.proxy_configurationrcrawlee.sessionsrcrawlee.statisticsrrrErIrr!rrs"#!**-6"#CC5(- G# 8# # L $  66!6 NVVVr!