+ G%@ipq^RIt^RIt^RIt^RIHt^RIHt^RIHtH t ^RI t Rt ^RI t Rt!RR4tR# ] dRt Li;i ] dRtL&i;i) N)getpass)_sos) is_executableTIMEOUT_DEFAULTTFca]tRt^ toRtRtRtRtRtRt Rt Rt Rt Rt RtRtRtRtRtRtRtRtRtRtRtRtRtRtRtRt/R RbR RbR R bR .bRRbRRbRRbRRbRRbRR bRRbRRbRRbRRbRRbRRbRRbRR/CtRARltRt Rt!]"R 4t#R!t$R"t%R#t&R$t'R%t(R&t)R't*R(t+R)t,R*t-R+t.RBR,lt/R-t0R.t1R/t2R0t3R1t4R2t5R3t6R4t7R5t8R6t9R7t:RAR8lt;R9tRCR<lt?R=t@RDR>ltARER?ltBR@tCVtDR#)F UploadTargetz This class is designed to upload files to a distribution defined location. These files can be either sos reports, sos collections, or other kind of files like: vmcores, application cores, logs, etc. z Upload a file (can be an sos report, a must-gather, or others) to a distribution defined remote location zGeneric UploadgenericN/zhttps://s3.amazonaws.com upload_filecase_id low_priorityFprofiles upload_urlupload_directory upload_user upload_pass upload_methodautoupload_no_ssl_verifyupload_protocolupload_s3_endpointupload_s3_regionupload_s3_bucketupload_s3_access_keyupload_s3_secret_keyupload_s3_object_prefix upload_targetc`\P!R4VnWnW0nW nR#)sos_uiN)logging getLoggerui_logparsercmdlineargs)selfr$r&r%s&&&&=/usr/lib/python3/dist-packages/sos/upload/targets/__init__.py__init__UploadTarget.__init__as#''1    c R#)a3This should be overridden by upload targets This is called by sos upload on each target type that exists, and is meant to return True when the upload target matches a criteria that indicates that is the local upload target that should be used. Only the first upload target to determine a match is selectedFr's&r(check_distributionUploadTarget.check_distributionhsr+cVP#)N)upload_target_idr.s&r( get_target_idUploadTarget.get_target_idrs$$$r+c rVP'd VP#VPP4#)z-Returns the upload target's name as a string.)upload_target_name__name__lower)clss&r(nameUploadTarget.nameus/  ! ! !)) )||!!##r+c RVPR,RVPR,RVPR,PRVPR,P/#) cmdlineoptspolicyr r) hook_commonsr rr.s&r( get_commonsUploadTarget.get_commons|sX 4,,]; d''1 t((7??  1 1- @     r+c WnR#)z9Set common host data for the Upload targets to reference N)commons)r'rCs&&r( set_commonsUploadTarget.set_commonss  r+cWnVP4VnVPR,pVPR,pVP'dVP 4VP VnVP VnVPVnVPVn RVn VPVn VPVn VPVn VPVnVPVnVP VnVP"'gVP$'gVP'4'd3VP(R8Xg"VP+4VP-4MQVP(R8XdAVP/4VP14VP34VP54VP6P9R4R#R#R#)r=r>r s3N)r?r@rCr_configure_low_priorityrrrrupload_passwordupload_archive_namerrrrrrbatchquietget_upload_urlrprompt_for_upload_userprompt_for_upload_passwordprompt_for_upload_s3_bucketprompt_for_upload_s3_endpointprompt_for_upload_s3_access_keyprompt_for_upload_s3_secret_keyr#info)r'r? cmdline_optsr>s&& r(pre_workUploadTarget.pre_works('') ||M2 h'  $ $ $  * * , '11'33 , = =+77#% "."A"A , = =$0$E$E! , = ='3'K'K$$0$E$E!!!!"""""$$$44<++-//1--5002224446446 KK  R #"r+c VP4'gARVP4 RVP4 R2p\\ V44VnR#R#)zeShould be overridden by targets to determine if an access key needs to be provided for upload or not z0Please provide the upload access key for bucket  via endpoint : N)get_upload_s3_access_keyget_upload_s3_bucketget_upload_s3_endpointinput_rr'msgs& r(rR,UploadTarget.prompt_for_upload_s3_access_keys^,,..--/01//12"6  ).af D %/r+c VP4'g8RVP4 RVP4 R2p\V4VnR#R#)zdShould be overridden by targets to determine if a secret key needs to be provided for upload or not z0Please provide the upload secret key for bucket rYrZN)get_upload_s3_secret_keyr\r]rrr`s& r(rS,UploadTarget.prompt_for_upload_s3_secret_keysZ,,..--/01//12"6  )0 D % /r+c @VP'gVP'dFVPPR4'd%VPR,VnVP#\\ R44pVP R4VnVP#)z`Should be overridden by targets to determine if a bucket needs to be provided for upload or not s3://NNz"Please provide the upload bucket: r )rr startswithr^r_strip)r' user_inputs& r(rP(UploadTarget.prompt_for_upload_s3_buckets}$$$4??#=#=g#F#F(,(;%$$$#1%I#JK (2(8(8(=%$$$r+c VPpVP'g=RVP4 RV R2p\\ V44pT;'gTVnVP#)zcShould be overridden by targets to determine if an endpoint needs to be provided for upload or not z.Please provide the upload endpoint for bucket z (default: z): )_upload_s3_endpointrr\r^r_)r'default_endpointrarls& r(rQ*UploadTarget.prompt_for_upload_s3_endpointsq 33&&&--/0./s4  qvJ&0&D&D4DD #&&&r+c VP4'g0RVP4 R2p\\V44VnR#R#)zSShould be overridden by targets to determine if a user needs to be provided or not zPlease provide upload user for rZN)get_upload_userrMr^r_rr`s& r(rN#UploadTarget.prompt_for_upload_users@##%%3D4G4G4I3J"MC$QsV}D &r+c VP4'gHVP4VP8wd'RVP4 R2p\V4VnR#R#R#)zbShould be overridden by targets to determine if a password needs to be provided for upload or not z'Please provide the upload password for rZN)get_upload_passwordrs _upload_userrrIr`s& r(rO'UploadTarget.prompt_for_upload_passwords]''))t/C/C/E/3/@/@0A<**,-R1C#*3 0$7++))++** ,r+c ^VP'gVP4VP#)zHelper function to determine if we should use the target default upload endpoint or one provided by the user :returns: The S3 Endpoint to use for upload :rtype: ``str`` )rrQr.s&r(r]#UploadTarget.get_upload_s3_endpointgs(&&&  . . 0&&&r+c BVP;'g VP#)zHelper function to determine if we should use the target default upload region or one provided by the user :returns: The S3 region to use for upload :rtype: ``str`` )r_upload_s3_regionr.s&r(get_upload_s3_region!UploadTarget.get_upload_s3_regionrs$$>>(>(>>r+c VP'dqVPPR4'dPVPR,PR^4pV^,Vn\ V4^8dV^,VnVP'gVP 4VP;'g VP#)zHelper function to determine if we should use the target default upload bucket or one provided by the user :returns: The S3 bucket to use for upload :rtype: ``str`` rgrhr )rrjrrlenrrP_upload_s3_bucket)r'bucket_and_prefixs& r(r\!UploadTarget.get_upload_s3_bucket{s ???t99'BB $ 3 9 9#q A $5a$8D !$%)/@/C,$$$  , , .$$>>(>(>>r+c BVP;'g VP#)zHelper function to determine if we should use the target default upload object prefix or one provided by the user :returns: The S3 object prefix to use for upload :rtype: ``str`` )r_upload_s3_object_prefixr.s&r(get_upload_s3_object_prefix(UploadTarget.get_upload_s3_object_prefixs++LLt/L/LLr+c \P!RR4;'g!VP;'g VP#)zHelper function to determine if we should use the target default upload secret key or one provided by the user :returns: The S3 secret key to use for upload :rtype: ``str`` SOSUPLOADS3SECRETKEYN)rrr_upload_s3_secret_keyr.s&r(rd%UploadTarget.get_upload_s3_secret_keyrr+c ,VP'gdVP'dRVP'd@VP'd.VP 4pVP 4pRV RV 2VnVP;'g VP #)zHelper function to determine if we should use the target default upload url or one provided by the user :returns: The URL to use for upload :rtype: ``str`` rgr )rrrrr\r _upload_url)r'bucketprefixs& r(rMUploadTarget.get_upload_urlsz  ! ! !  % % %  % % %..0F557F!&vhax8D 22$"2"22r+c:Rp\P!VRV4pV#)z([^:]+://[^:]+:)([^@]+)(@.+)z \1********\3)resub)r'urlpatternobfuscated_urls&& r(_get_obfuscated_upload_url'UploadTarget._get_obfuscated_upload_urls1#>r+c @VPVP44#)zUsed by upload targets to potentially change the string used to report upload location from the URL to a more human-friendly string )rrMr.s&r(r|"UploadTarget.get_upload_url_strings..t/B/B/DEEr+c \P!RR4;'g!VP;'g VP#)zHelper function to determine if we should use the target default upload user or one provided by the user :returns: The username to use for upload :rtype: ``str`` SOSUPLOADUSERN)rrrrwr.s&r(rsUploadTarget.get_upload_users= /40""  ""!! #r+c \P!RR4;'g!VP;'g VP#)a/Helper function to determine if we should use the target default upload password or one provided by the user A user provided password, either via option or the 'SOSUPLOADPASSWORD' environment variable will have precendent over any target value :returns: The password to use for upload :rtype: ``str`` SOSUPLOADPASSWORDN)rrrI_upload_passwordr.s&r(rv UploadTarget.get_upload_passwords> -t4&&$$&&%% 'r+c \R4'g \R4h^RIpRpT'gTP 4pT'gTP 4pTP 4PRR4pRT R T 2pTPTR R 7p R R RTPTP.p T PT ^R7p T ^8XdRpMT ^8XdwT PT4R RTPTP.p T PT ^ R7^8HpT'g-T P4\RTP4 24hMfT ^8Xd\RTP4 R24hT ^8Xd\RTP4 24hT ^8Xd\RT P 24hT'g-T P4\RTP4 24hRTP RT'dT R2MR TP#4 2p T PT 4RTPTPR.pT PT^R7pT^8XdT PR4R#T^8Xd \R4hT^8Xd\RT P 24hT^8Xd \R 4h\R!T P 24h \dp\R4ThRp?ii;i)"a}Attempts to upload the archive to an SFTP location. Due to the lack of well maintained, secure, and generally widespread python libraries for SFTP, sos will shell-out to the system's local ssh installation in order to handle these uploads. Do not override this method with one that uses python-paramiko, as the upstream sos team will reject any PR that includes that dependency. rzSFTP is not locally supportedNzFSFTP upload requires python3-pexpect, which is not currently installedFzsftp://r z sftp -oStrictHostKeyChecking=no @zutf-8)encodingzsftp>z password:zConnection refusedtimeoutTzPermission deniedz#Incorrect username or password for zConnection refused by z. Incorrect port?z!Timeout hit trying to connect to z,Unexpected error trying to connect to sftp: zUnable to connect via SFTP to zput  r z100%zNo such file or directorybyezTimeout expired while uploadingzUnknown error during upload: z&Unable to write archive to destinationz!Unexpected response from server: )rrzpexpect ImportErrorrsrvrMreplacespawnTIMEOUTEOFexpectsendlinecloser|beforerJ_get_sftp_upload_name)r'rruser_dirrerrsftp_connectedsftp_urlsftp_cmdret sftp_expectsidx pass_expectsput_cmd put_expects put_successs&&&& r(rUploadTarget.upload_sftpsV$$;< <  @  '')D//1H&&(00B?5dV1XJGmmHwm7   OO KK  jjrj2 !8!N AX LL "# L !ZZ bZAQFN!  E#'#=#=#?"@!BCC"AX4#99;<? ? AXJ"zzl,- - IIK<#99;<>? ? 4++,A!)(1~r2))+, .  W  OO KK '  jjcj: !  LL  ! => > ! ;CJJ<HI I ! DE E;CJJ<HIIc @67E r+c x\P!VP4VVP4V\R7#)zIf upload_https() needs to use requests.put(), use this method. Targets should override this method instead of the base upload_https() :param archive: The open archive file object )datarverifyr)rputrMrr)r'r}rs&&&r(_upload_https_putUploadTarget._upload_https_putGs5||D//1!%!;!;!=#)?D Dr+c /#)zJDefine any needed headers to be passed with the POST request here r-r.s&r(_get_upload_headers UploadTarget._get_upload_headersRs  r+c RVPPR4R,VVP43/p\P!VP 4VVP 4V\R7#)zIf upload_https() needs to use requests.post(), use this method. Targets should override this method instead of the base upload_https() :param archive: The open archive file object filer )filesrrrr)r:rrrpostrMrr)r'r}rrs&&& r(_upload_https_postUploadTarget._upload_https_postWsj W\\'',R0'--/1 }}T002%"&"<"<">$*OE Er+c z\'g \R4h\VPR4;_uu_4pVPR,P R8XdVP pMVPR,P pVPR,PRJpVR8XdVPW4pMVPW4pVPR 9dBVPR8Xd \R4h\R VP R VP 24hR R R 4R # +'giR #;i)zAttempts to upload the archive to an HTTPS location. :returns: ``True`` if upload is successful :rtype: ``bool`` :raises: ``Exception`` if upload was unsuccessful z7Unable to upload due to missing python requests libraryrbr=rFriz/Authentication failed: invalid user credentialszPOST request returned rZNT)) REQUESTS_LOADEDrzopenrJrCr_upload_methodrrr status_codereason)r'arcmethodrrs& r(rUploadTarget.upload_httpsfs &' '$**D 1 1S||M*88FB,,m4BB\\-0EENF**37++C8}}J.==C'#I "8r#$88*!.//#2 1 1 1s C)D)) D: c ^^RIp^RIpV'gVP4pVf \R4hVP RR4pV'gVP 4pV'gVP 4pV'g!VP;'g VPpVPWV^R7pV'g \R4hVPV4\!TP"R4;_uu_4p TP%RTP"PR4R, 2T 4RRR4TP'4R# TPdp\RT 24ThRp?iTPdp\RT 24ThRp?iTPdp\T4P4^,p T R 8Xd\R T R 24ThT R 8Xd\R T R 24ThT R8Xd\RT 24Th\R\T4 24ThRp?ii;i +'giL;i)aAttempts to upload the archive to either the target defined or user provided FTP location. :param url: The URL to upload to :type url: ``str`` :param directory: The directory on the FTP server to write to :type directory: ``str`` or ``None`` :param user: The user to authenticate with :type user: ``str`` :param password: The password to use for `user` :type password: ``str`` :returns: ``True`` if upload is successful :rtype: ``bool`` :raises: ``Exception`` if upload in unsuccessful NzPno FTP server specified by upload target, use --upload-url to specify a locationzftp://r rz3connection failed, did you set a user and password?z timeout hit while connecting to zunable to connect to 503zcould not login as ''530zinvalid password for user '550z"could not set upload directory to z#error trying to establish session: rzSTOR r Tr)ftplibsocketrMrzrrsrvr_upload_directoryFTPcwdrgaierror error_permstrrrrJ storbinaryquit) r'r directoryrrr r sessionrerrno_arcfiles &&&&& r(rUploadTarget.upload_ftps* %%'C ;EF Fkk(B''')D//1H--GG1G1GI jjHbjAG!,-- KK ""$**D 1 1X   0066s;B?@A8 2  +~~ O>seDE3 N D3C59: C  HNN$Q'E~"6tfA >?SH~"=dV1 EFCO~ D#,+!/0589A#c(LM  2 1sI8E16HHE!!H4H5FHHArBBC  ! !$":":"( / H6s1vh?@a G Hs'AE-- F8FF)rr&r%rCr?r$r#rJrrIrrrrrrrr)NNN)NN)T)NNNN)NNNNNN)Er7 __module__ __qualname____firstlineno____doc__descr6r2 _upload_filerr rwrrrorrrrrrrrIrrrrrrr arg_defaultsr)r/r3 classmethodr:r@rDrVrRrSrPrQrNrOrr{rr[r]rr\rrdrMrr|rsrvrrrrrrrr__static_attributes____classdictcell__) __classdict__s@r(rr sF D* LKLN4  !JKO"Mr2  B  d  D  t t   6 d D D  !" "4#$ %L*%$$   (!T 6 5 % '-06p,;& , '?? M ,3" F # 'dJL  D E>DL?H?Hr+r)rrr!rsosrr_ sos.utilitiesrrrrrr"r rr-r+r(r9sl 8OL j Hj HO Ls ;A AA AA