+ [mh<^RIt^RIt!RR]4t!RR4t!RR4t!RR 4t!R R 4t!R R 4t!RR4t !RR4t R#)Nc2aa]tRt^toV3RltRtVtV;t#)RequestExceededExceptionc N<WnW nRV RV 2p\SV` V4R#)a`Error when requested amount exceeds what is allowed The request that raised this error should be retried after waiting the time specified by ``retry_time``. :type requested_amt: int :param requested_amt: The originally requested byte amount :type retry_time: float :param retry_time: The length in time to wait to retry for the requested amount zRequest amount z) exceeded the amount available. Retry in N) requested_amt retry_timesuper__init__)selfrrmsg __class__s&&& 6/usr/lib/python3/dist-packages/s3transfer/bandwidth.pyr !RequestExceededException.__init__s2+$ .WXbWcd rr)__name__ __module__ __qualname____firstlineno__r __static_attributes____classdictcell__ __classcell__)r __classdict__s@@r rrsrrc]tRt^%tRtRtR#) RequestTokenzDA token to pass as an identifier when consuming from the LeakyBucketN)rrrr__doc__rrrr rr%sNrrc,a]tRt^+toRtRtRtVtR#) TimeUtilsc ,\P!4#)zOGet the current time back :rtype: float :returns: The current time in seconds )timer s&r r TimeUtils.time,s yy{rc .\P!V4#)z_Sleep for a designated time :type value: float :param value: The time to sleep for in seconds )r sleep)r values&&r r$TimeUtils.sleep4s zz%  rrN)rrrrr r$rrrs@r rr+s!!rrc4a]tRt^=toRRltRRltRtVtR#)BandwidthLimiterNc HWnW nVf\4VnR#R#)zLimits bandwidth for shared S3 transfers :type leaky_bucket: LeakyBucket :param leaky_bucket: The leaky bucket to use limit bandwidth :type time_utils: TimeUtils :param time_utils: Time utility to use for interacting with time. N) _leaky_bucket _time_utilsr)r leaky_bucket time_utilss&&&r r BandwidthLimiter.__init__>s%*%  ({D  rc v\WPW P4pV'gVP4V#)aWraps a fileobj in a bandwidth limited stream wrapper :type fileobj: file-like obj :param fileobj: The file-like obj to wrap :type transfer_coordinator: s3transfer.futures.TransferCoordinator param transfer_coordinator: The coordinator for the general transfer that the wrapped stream is a part of :type enabled: boolean :param enabled: Whether bandwidth limiting should be enabled to start )BandwidthLimitedStreamr+r,disable_bandwidth_limiting)r fileobjtransfer_coordinatorenabledstreams&&&& r get_bandwith_limited_stream,BandwidthLimiter.get_bandwith_limited_streamLs6( '')=?O?O   - - / r)r+r,N)T)rrrrr r7rrr's@r r)r)=s +rr)cpa]tRt^ctoRRltRtRtRtRtRt Rt RR lt R t R t R tR tRtVtR#)r1Nc WnW nW0nW@nVf\ 4VnRVn\ 4Vn^VnWPn R#)aLimits bandwidth for reads on a wrapped stream :type fileobj: file-like object :param fileobj: The file like object to wrap :type leaky_bucket: LeakyBucket :param leaky_bucket: The leaky bucket to use to throttle reads on the stream :type transfer_coordinator: s3transfer.futures.TransferCoordinator param transfer_coordinator: The coordinator for the general transfer that the wrapped stream is a part of :type time_utils: TimeUtils :param time_utils: The time utility to use for interacting with time NT) _fileobjr+_transfer_coordinatorr,r_bandwidth_limiting_enabledr_request_token _bytes_seen_bytes_threshold)r r3r-r4r.bytes_thresholds&&&&&&r r BandwidthLimitedStream.__init__dsK0 )%9"%  ({D +/(*n /rc RVnR#)z0Enable bandwidth limiting on reads to the streamTNr>r!s&r enable_bandwidth_limiting0BandwidthLimitedStream.enable_bandwidth_limitings +/(rc RVnR#)z1Disable bandwidth limiting on reads to the streamFNrEr!s&r r21BandwidthLimitedStream.disable_bandwidth_limitings +0(rc PVP'gVPPV4#V;PV, unVPVP8dVPPV4#VP 4VPPV4#)zXRead a specified amount Reads will only be throttled if bandwidth limiting is enabled. )r>r<readr@rA_consume_through_leaky_bucket)r amounts&&r rKBandwidthLimitedStream.reads ///==%%f- - F"   d33 3==%%f- - **,}}!!&))rcVVPP'g;VPPVPVP 4^VnR#VPPh \ d1pTPPTP4Rp?KRp?ii;i)rN) r= exceptionr+consumer@r?rr,r$r)r es& r rL4BandwidthLimitedStream._consume_through_leaky_buckets ,,666 5""**$$d&9&9$% ,,66 6, 5  &&q||44 5s7A-- B(8%B##B(c &VP4R#)z6Signal that data being read is being transferred to S3N)rFr!s&r signal_transferring*BandwidthLimitedStream.signal_transferrings &&(rc &VP4R#)z:Signal that data being read is not being transferred to S3N)r2r!s&r signal_not_transferring.BandwidthLimitedStream.signal_not_transferrings '')rc<VPPW4R#r9)r<seek)r wherewhences&&&r r[BandwidthLimitedStream.seeks 5)rc6VPP4#r9)r<tellr!s&r r`BandwidthLimitedStream.tells}}!!##rcVP'd#VP'dVP4VPP 4R#r9)r>r@rLr<closer!s&r rcBandwidthLimitedStream.closes7  + + +0@0@0@  . . 0 rcV#r9rr!s&r __enter__ BandwidthLimitedStream.__enter__s rc&VP4R#r9)rc)r argskwargss&*,r __exit__BandwidthLimitedStream.__exit__s  r)r>r@rAr<r+r?r,r=)Ni)r)rrrrr rFr2rKrLrUrXr[r`rcrfrkrrr's@r r1r1csG!0F01*(7$)**$rr1cHa]tRt^toR RltRtRtRtRtRt Rt Vt R#) LeakyBucketNc \V4VnW nVf\4Vn\P !4VnW0nVf\4VnW@n Vf\4Vn R#R#)aA leaky bucket abstraction to limit bandwidth consumption :type rate: int :type rate: The maximum rate to allow. This rate is in terms of bytes per second. :type time_utils: TimeUtils :param time_utils: The time utility to use for interacting with time :type rate_tracker: BandwidthRateTracker :param rate_tracker: Tracks bandwidth consumption :type consumption_scheduler: ConsumptionScheduler :param consumption_scheduler: Schedules consumption retries when necessary N) float _max_rater,r threadingLock_lock _rate_trackerBandwidthRateTracker_consumption_schedulerConsumptionScheduler)r max_rater. rate_trackerconsumption_schedulers&&&&&r r LeakyBucket.__init__sf.x%  ({D ^^% )  !5!7D &;# (*>*@D ' )rc VP;_uu_4VPP4pVPP V4'dVP WV4uuRRR4#VP W4'dVPWV4MVPW4uuRRR4#RRR4R# +'giR#;i)aConsume an a requested amount :type amt: int :param amt: The amount of bytes to request to consume :type request_token: RequestToken :param request_token: The token associated to the consumption request that is used to identify the request. So if a RequestExceededException is raised the token should be used in subsequent retry consume() request. :raises RequestExceededException: If the consumption amount would exceed the maximum allocated bandwidth :rtype: int :returns: The amount consumed N) rtr,r rw is_scheduled,_release_requested_amt_for_scheduled_request_projected_to_exceed_max_rate!_raise_request_exceeded_exception_release_requested_amtr amt request_tokentime_nows&&& r rQLeakyBucket.consumes$ZZZ'',,.H**77 FFHHZ 33CBB66223AZZZZsA B=-:B== C cTVPPW4pW0P8#r9)ruget_projected_raterq)r rrprojected_rates&&& r r)LeakyBucket._projected_to_exceed_max_rates%++>>sM..rcZVPPV4VPW4#r9)rwprocess_scheduled_consumptionrrs&&&&r r8LeakyBucket._release_requested_amt_for_scheduled_requests. ##AA  **399rcV\VP4, pVPPWV4p\ WR7h)r)rprqrwschedule_consumptionr)r rrrallocated_timers&&&& r r-LeakyBucket._raise_request_exceeded_exception#sBuT^^4400EE  '  rc<VPPW4V#r9)rurecord_consumption_rate)r rrs&&&r r"LeakyBucket._release_requested_amt,s 223A r)rwrtrqrur,)NNN) rrrrr rQrrrrrrr's@r rnrns+!AFB>/: rrnc8a]tRtRtoRtRtRtRtRtVt R#)rxi1c "/Vn^VnR#)z*Schedules when to consume a desired amountN _tokens_to_scheduled_consumption _total_waitr!s&r r ConsumptionScheduler.__init__2s02-rc WP9#)zIndicates if a consumption request has been scheduled :type token: RequestToken :param token: The token associated to the consumption request that is used to identify the request. )r)r tokens&&r r~!ConsumptionScheduler.is_scheduled7s====rc V;PV, unRVPRV/VPV&VP#)aLSchedules a wait time to be able to consume an amount :type amt: int :param amt: The amount of bytes scheduled to be consumed :type token: RequestToken :param token: The token associated to the consumption request that is used to identify the request. :type time_to_consume: float :param time_to_consume: The desired time it should take for that specific request amount to be consumed in regardless of previously scheduled consumption requests :rtype: float :returns: The amount of time to wait for the specific request before actually consuming the specified amount. wait_durationtime_to_consume)rr)r rrrs&&&&r r)ConsumptionScheduler.schedule_consumption@sE& O+ T-- 8 --e4rc VPPV4p\VPVR,, ^4VnR#)zProcesses a scheduled consumption request that has completed :type token: RequestToken :param token: The token associated to the consumption request that is used to identify the request. rN)rpopmaxr)r rscheduled_retrys&& r r2ConsumptionScheduler.process_scheduled_consumptionZs=??CCEJ   /@A A1 rrN) rrrrr r~rrrrr's@r rxrx1s > 4   rrxcRa]tRtRtoR Rlt]R4tRtRtRt Rt Rt Vt R #) rvigc .WnRVnRVnR#)aZTracks the rate of bandwidth consumption :type a: float :param a: The constant to use in calculating the exponentional moving average of the bandwidth rate. Specifically it is used in the following calculation: current_rate = alpha * new_rate + (1 - alpha) * current_rate This value of this constant should be between 0 and 1. N)_alpha _last_time _current_rate)r alphas&&r r BandwidthRateTracker.__init__hs !rc :VPfR#VP#)zUThe current transfer rate :rtype: float :returns: The current tracked transfer rate )rrr!s&r current_rate!BandwidthRateTracker.current_ratexs ?? "!!!rc DVPfR#VPW4#)a"Get the projected rate using a provided amount and time :type amt: int :param amt: The proposed amount to consume :type time_at_consumption: float :param time_at_consumption: The proposed time to consume at :rtype: float :returns: The consumption rate if that amt and time were consumed r)r*_calculate_exponential_moving_average_rater rtime_at_consumptions&&&r r'BandwidthRateTracker.get_projected_rates' ?? ">>   rc xVPfW nRVnR#VPW4VnW nR#)zRecord the consumption rate based off amount and time point :type amt: int :param amt: The amount that got consumed :type time_at_consumption: float :param time_at_consumption: The time at which the amount was consumed Nr)rrrrs&&&r r,BandwidthRateTracker.record_consumption_rates; ?? "1O!$D  !LL  .rcZW P, pV^8:d \R4#W, #)rinf)rrp)r rr time_deltas&&& r _calculate_rate$BandwidthRateTracker._calculate_rates*(??: ? < !!rcVPW4pVPV,^VP, VP,,#))rrr)r rrnew_rates&&& r r?BandwidthRateTracker._calculate_exponential_moving_average_rates;''A{{X%T[[Drsk y(  !!$##LnnbZZz3 3 lNONOr