U Ldr'@sdZddlZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z ddl mZddlmZmZdd lmZdd lmZmZmZmZd d gZd ZGddde ZeddeddeddgZeddeddeddeddedded d!ed"d#ed$d%ed&d'ed(d)ed*d)ed+d,g Zed-d.d/Zed-d0d1Z dHd2d3Z!d4d5Z"d6d7Z#d8d9Z$d:d;Z%dd?Z'dIe(d@dAdBZ)dCdDZ*dEdFZ+e,dGkre-e+dS)JzGDefine 'collect-logs' utility and handler to include in cloud-init cmd.N)datetime)Path) NamedTuple)read_cfg_paths)Paths)ProcessExecutionErrorsubp)tempdir)chdircopy ensure_dir write_filez/var/log/cloud-init.logz/var/log/cloud-init-output.logz/run/cloud-initc@seZdZUeed<eed<dS) ApportFilepathZlabelN)__name__ __module__ __qualname__str__annotations__rr:/usr/lib/python3/dist-packages/cloudinit/cmd/devel/logs.pyrs rz(/var/log/installer/autoinstall-user-dataZAutoInstallUserDataz/autoinstall.yamlZAutoInstallYAMLz'/etc/cloud/cloud.cfg.d/99-installer.cfgZInstallerCloudCfgz//var/log/installer/ubuntu_desktop_installer.logZUdiLogz-/var/log/installer/subiquity-server-debug.logZSubiquityServerDebugz-/var/log/installer/subiquity-client-debug.logZSubiquityClientDebugz%/var/log/installer/curtin-install.logZ CurtinLogz0/var/log/installer/subiquity-curtin-install.confZCurtinInstallConfigz8/var/log/installer/curtin-install/subiquity-initial.confZCurtinConfigInitialz:/var/log/installer/curtin-install/subiquity-curthooks.confZCurtinConfigCurtHooksz8/var/log/installer/curtin-install/subiquity-extract.confZCurtinConfigExtractz=/var/log/installer/curtin-install/subiquity-partitioning.confZCurtinConfigPartitioningz(/var/log/installer/curtin-error-logs.tarZ CurtinErrorz$/var/log/installer/curtin-errors.tarz(/var/log/installer/block/probe-data.jsonZ ProbeData)returncCst}|dS)NZ userdata_raw)rZ get_ipath_curpathsrrr_get_user_data_fileNsrcCst}|dS)Ndata)rZ get_cpathrrrr_get_cloud_data_pathSsrc Cs`|stjddd}|jdddddd d |jd d d ddt}|jdddddd|d|S)a2Build or extend and arg parser for collect-logs utility. @param parser: Optional existing ArgumentParser instance representing the collect-logs subcommand which will be extended to support the args of this utility. @returns: ArgumentParser with proper argument configuration. collect-logsz)Collect and tar all cloud-init debug info)progZ descriptionz --verbosez-vcountr verbosityzBe more verbose.)actiondefaultdesthelpz --tarfilez-tzcloud-init.tar.gzzOThe tarfile to create containing all collected logs. Default: cloud-init.tar.gz)r"r$z--include-userdataz-uF store_trueuserdatazPOptionally include user-data from {0} which could contain sensitive information.)r"r!r#r$)argparseArgumentParser add_argumentrformat)parseruser_data_filerrr get_parserXs>   r-cCs*dg}tdkr&|tijd|S)z>Return a list of files to ignore for /run/cloud-init directoryzhook-hotplug-cmdrZinstance_data_sensitive)osgetuidappendrZlookups)curdirfilesZ ignored_filesrrr_copytree_rundir_ignore_filess  r3c Csttj|zt|j}Wn@tk r^}z"t|t|t d|d|W5d}~XYn Xt||t d|d||SdS)CHelper which runs a command and writes output or error to filename.collecting %s failed. N collected %s ) r r.rdirnamerstdoutrr r_debug)cmdfilenamemsgr outputerrr_write_command_output_to_files" r@c Csttj|z*t|d}tj|||dW5QRXWn@tk rz}z"t|t |t d|d|W5d}~XYnXt d|d|dS)r4w)r9stderrr5r6Nr7) r r.rr8open subprocesscallOSErrorr rr:)r;r<r=r fr?rrr_stream_command_output_to_files "rHcCs||krtj|dS)N)sysrBwrite)r=levelr rrrr:sr:cCs<tj|r(t||td|d|ntd|d|dS)Nzcollected file: %s r6zfile %s did not exist )r.risfiler r:)rZout_dirr rrr _collect_files  rNcCstD]:}t||jj}|s,tt|t|jt||q|rtD]:}t||jj}|sptt|t|jt||qHdS)z'Obtain subiquity logs and config files.N) INSTALLER_APPORT_FILESrrparentexistsr rrN INSTALLER_APPORT_SENSITIVE_FILES)log_dirinclude_userdatar Zsrc_fileZdestination_dirrrrcollect_installer_logss  rU)rTc Cs|r tdkr tjddStj|}t d}t dd}tj ||}t ddgtj |d d |d }t d d ddgtj |dd|d }|s|r|nd}td|td|d|tdgtj |dd|d tddddgtj |dd|d tD]}t|||q|r2t}t|||t|||tj |d} t| tjtrztjttj | dtdWnFtjk r} z$tjdtjt| d W5d!} ~ XYnXtd"td|ntd#td|tjtj td$r2tt} | r2tt| t|t| t|"t d%d&||!|d'd(gW5QRXW5QRXtjd)|dS)*zCollect all cloud-init logs and tar them up into the provided tarfile. @param tarfile: The path of the tar-gzipped file to create. @param include_userdata: Boolean, true means include user-data. rzMTo include userdata, root user is required. Try sudo cloud-init collect-logs r6zcloud-init-logs-%Y-%m-%dz/tmp)dirz cloud-initz --versionversionzcloud-init --version)r;r<r=r z dpkg-queryz--showz-f=${Version} z dpkg-versionz dpkg versionz not-availablez version: z!collected cloud-init version: %s Zdmesgz dmesg.txtz dmesg outputZ journalctlz--boot=0z-oz short-precisez journal.txtzsystemd journal of current bootrun)ignorez(Failed collecting file(s) due to error:  Nzcollected dir %s zdirectory '%s' did not exist ZdisabledZtarZczvf/z Wrote %s )"r.r/rIrBrJrabspathrZutcnowdatestrftimer joinr@printr:rHCLOUDINIT_LOGSrNrrUr rQCLOUDINIT_RUN_DIRshutilZcopytreer3Errorrrrr rreplace) tarfilerTr rSZtmp_dirrWZdpkg_verlogr,Zrun_dirr?Zcloud_data_dirrrr collect_logss              &   0ricCst|j|j|jS)z:Handle calls to 'cloud-init collect-logs' as a subcommand.)rirgr&r )nameargsrrrhandle_collect_logs_argssrlcCst}td|S)z4Tool to collect and tar all cloud-init related logs.r)r-rl parse_args)r+rrrmain"srn__main__)N)r).__doc__r'r.rdrDrIrpathlibrtypingrZcloudinit.cmd.develrZcloudinit.helpersrZcloudinit.subprrZcloudinit.temp_utilsr Zcloudinit.utilr r r r rbrcrrRrOrrrr-r3r@rHr:rNrUboolrirlrnrexitrrrrs       % .  U