U LdxD@sFdZddlZddlZddlZddlZddlmZmZddlm Z ddl m Z m Z m Z mZmZmZmZddlZddlmZddlmZddlmZdd lmZdd lmZdd lmZmZmZm Z dd l!m"Z"e#e$Z%d Z&dZ'dZ(dddddddZ)e*dddZ+d;ee e*e e*e fdddZ,GdddeZ-GdddeZ.GdddeZ/e*e0d d!d"Z1Gd#d$d$ej2Z3e4dd%d&Z5dffgZ?d5d6Z@e$d7krBddlAZAd8ZBeAjCeBd9ZDeDEeFeGe=e:jaDatasource for LXD, reads /dev/lxd/sock representation of instance data. Notes: * This datasource replaces previous NoCloud datasource for LXD. * Older LXD images may not have updates for cloud-init so NoCloud may still be detected on those images. * Detect LXD datasource when /dev/lxd/sock is an active socket file. * Info on dev-lxd API: https://documentation.ubuntu.com/lxd/en/latest/dev-lxd/ N)Flagauto)JSONDecodeError)AnyDictListOptionalTupleUnioncast) HTTPAdapter)HTTPConnection)HTTPConnectionPool) atomic_helper)log)sourcessubp url_helperutil)find_fallback_nicz /dev/lxd/sockz1.0z http://lxd user-datanetwork-config vendor-data)cloud-init.user-datazcloud-init.network-configcloud-init.vendor-datauser.user-datazuser.network-configuser.vendor-datareturnc Csd}tdrztdg\}}Wn8tjk rZ}ztd||WYSd}~XYnX|dkrtdd}|dkrdS|d krd Sd S|S) NZeth0zsystemd-detect-virtzHUnable to run systemd-detect-virt: %s. Rendering default network config.)ZkvmZqemuunameZppc64leZenp0s5Zs390xZenc9Zenp5s0)rZwhichZProcessExecutionErrorLOGwarningstriprZ system_info)Z default_nameZ virt_type_errZarchr&A/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceLXD.py_get_fallback_interface_name0s$  r()nicsrcCsFt}|rtd|nt}td|dd|dddgdgd S) zCReturn network config V1 dict representing instance network config.zCLXD datasource generating network from discovered active device: %szVLXD datasource generating network from systemd-detect-virt platform default device: %sZphysicalZdhcpr)typeZcontrol)r+nameZsubnets)versionconfig)rr!debugr()r)Z primary_nicr&r&r'generate_network_configJs$  r0cs$eZdZfddZddZZS)SocketHTTPConnectioncstd||_dSNZ localhost)super__init__ socket_pathselfr5 __class__r&r'r4qs zSocketHTTPConnection.__init__cCs$ttjtj|_|j|jdSN)socketZAF_UNIXZ SOCK_STREAMZsockconnectr5r7r&r&r'r<uszSocketHTTPConnection.connect)__name__ __module__ __qualname__r4r< __classcell__r&r&r8r'r1ps r1cs$eZdZfddZddZZS)SocketConnectionPoolcs||_tddSr2)r5r3r4r6r8r&r'r4{szSocketConnectionPool.__init__cCs t|jSr:)r1r5r=r&r&r' _new_connszSocketConnectionPool._new_conn)r>r?r@r4rCrAr&r&r8r'rBzs rBc@seZdZdddZdS)LXDSocketAdapterNcCsttSr:)rBLXD_SOCKET_PATH)r7urlZproxiesr&r&r'get_connectionszLXDSocketAdapter.get_connection)N)r>r?r@rGr&r&r&r'rDsrD) metadata_typerc Cst|tr|S|dkriSzt|}Wn8tk r`}ztdj||d|W5d}~XYnX|dkr~tdj||d|S)a6Convert raw instance data from str, bytes, YAML to dict :param metadata_type: string, one of as: meta-data, vendor-data, user-data network-config :param metadata_value: str, bytes or dict representing or instance-data. :raises: InvalidMetaDataError on invalid instance-data content. NzAInvalid {md_type}. Expected str, bytes or dict but found: {value})Zmd_typevaluez:Invalid {md_type} format. Expected YAML but found: {value}) isinstancedictr load_yamlAttributeErrorrInvalidMetaDataExceptionformat)rHZmetadata_valueZparsed_metadataexcr&r&r'_raw_instance_data_to_dicts. rQcseZdZUdZejZeee fe d<ejZ eee fe d<ej j dZ ee dfe d<dZedd fd d Zeed d dZed ddZe d ddZe d ddZeed ddZZS) DataSourceLXDZLXD_network_config_crawled_metadata)user.meta-datarrrr.sensitive_metadata_keysTN)ci_pkl_versionrcst|d|_dS)NT)r3 _unpickleskip_hotplug_detect)r7rWr8r&r'rXs zDataSourceLXD._unpicklercCstS)z@Check platform environment to report if this datasource may run.)is_platform_viabler&r&r&r' ds_detectszDataSourceLXD.ds_detectcCstjtjdtd|_td|jd|_|jdi}|di}|rPtd|}t |jt stt t |j|g|_d|jkr|jd|_ d|jkrtd|jd|_d|jkr|jd|_d S) z=Crawl LXD socket API instance data and return True on successzCrawl of metadata service)Zlogfuncmsgfunc meta-datar.rUrrrT)rZlog_timer!r/ read_metadatarTrQgetmetadatarJrKZ mergemanydictrLZ userdata_rawrSZvendordata_raw)r7r.Z user_metadatar&r&r' _get_datas<        zDataSourceLXD._get_datacCsdjttdS)z.Return subplatform details for this datasourcez"LXD socket API v. {ver} ({socket}))Zverr;)rOLXD_SOCKET_API_VERSIONrEr=r&r&r'_get_subplatformszDataSourceLXD._get_subplatformcCsBttjd}|di}t|ts,t|}|d|jdkS)z%Return True if instance_id unchanged. metadata_keysr^z instance-id) r_ MetaDataKeys META_DATAr`rJrKrrLra)r7Zsys_cfgresponsemdr&r&r'check_instance_ids     zDataSourceLXD.check_instance_idcCs|jtjkr~|jtjkr |t|jtr~|jdrPt d|jd|_n.|jdr~dd|jd D}t ||_|jtjkrt dt |_t t|jS)zNetwork config read from LXD socket config/user.network-config. If none is present, then we generate fallback configuration. rz,LXD datasource using provided network configdevicescSs g|]\}}|ddkr|qS)r+Znicr&).0kvr&r&r' s z0DataSourceLXD.network_config..z8LXD datasource generating network config using fallback.) rSrUNSETrTrbrJrKr`r!r/itemsr0r )r7rlr&r&r'network_configs(         zDataSourceLXD.network_config)r>r?r@ZdsnamerrqrSr rstr__annotations__rT DataSourcerVr rYintrX staticmethodboolr[rbrdrkpropertyrKrsrAr&r&r8r'rRs   rRcCs"tjtrtttjSdS)z=Return True when this platform appears to have an LXD socket.F)ospathexistsrEstatS_ISSOCKlstatst_moder&r&r&r'rZs rZT)sessionrFdo_raisec Cstt|||}|js*td||j|jiSz |WStk rn}zt dj ||jd|W5d}~XYnXdS)NSkipping %s on [HTTP:%d]:%szFUnable to process LXD config at {url}. Expected JSON but found: {resp})rFresp) _do_requestokr!r/ status_codetextZjsonrrrNrO)rrFrZ url_responserPr&r&r'_get_json_responses(  r)rrFrrcCstdddD]:}||}d|jkrBtdtd|j||q qHq td|j||r||js|t dj |j||j d |S) Nrig?z,[GET] [HTTP:%d] %s, retrying %d more time(s)z[GET] [HTTP:%d] %sz3Invalid HTTP response [{code}] from {route}: {resp})codeZrouter) ranger`rtimesleepr!r"r/rrrNrOr)rrFrZretriesrir&r&r'r-s*    rc@s0eZdZeZeZeZeZeeBeBZdS)rgN) r>r?r@rZNONECONFIGDEVICESrhALLr&r&r&r'rgJs rgc@s@eZdZefedddZejedddZ e eddd Z d S) _MetaDataReader api_versioncCs||_tt|j|_dSr:)rr combine_urlLXD_URL _version_url)r7rr&r&r'r4Ssz_MetaDataReader.__init__)rrc Csdii}t|jd}t||}t|D]}tt|}t||dd}|jsbt d||j |j q(| dd}|j |d|<|t kr(t ||kr|j |t |<q(td||dd d q(|S) aIterate on LXD API config items. Promoting CONFIG_KEY_ALIASES Any CONFIG_KEY_ALIASES which affect cloud-init behavior are promoted as top-level configuration keys: user-data, network-data, vendor-data. LXD's cloud-init.* config keys override any user.* config keys. Log debug messages if any user.* keys are overridden by the related cloud-init.* key. r.Frr/rz,Ignoring LXD config %s in favor of %s value.userz cloud-initr*)rrrrsortedrrrr!r/rr rpartitionCONFIG_KEY_ALIASESr"replace) r7rr.Z config_urlZ config_routesZ config_routeZconfig_route_urlZconfig_route_responseZcfg_keyr&r&r'_process_configWs@      z_MetaDataReader._process_config)rfrc Cst}||jtd|ji}tj|krLt |jd}t ||j |d<tj |krf| ||tj|krt |jd}t||dd}|r||d<|W5QRSQRXdS)NZ_metadata_api_versionr^rlFr)requestsSessionZmountrrDrrgrhrrrrrupdaterrr)r7rfrrjZmd_routerFrlr&r&r'__call__s"     z_MetaDataReader.__call__N) r>r?r@rcrtr4rrrKrrgrr&r&r&r'rRs7r)rrfrcCst|d|dS)a8Fetch metadata from the /dev/lxd/socket routes. Perform a number of HTTP GETs on known routes on the devlxd socket API. Minimally all containers must respond to /meta-data when the LXD configuration setting `security.devlxd` is true. When `security.devlxd` is false, no /dev/lxd/socket file exists. This datasource will return False from `is_platform_viable` in that case. Perform a GET of /config` and walk all `user.*` configuration keys, storing all keys and values under a dict key LXD_SOCKET_API_VERSION: config {...}. In the presence of the following optional user config keys, create top level aliases: - user.user-data -> user-data - user.vendor-data -> vendor-data - user.network-config -> network-config :param api_version: LXD API version to operated with. :param metadata_keys: Instance of `MetaDataKeys` indicating what keys to fetch. :return: A dict with the following optional keys: meta-data, user-data, vendor-data, network-config, network_mode, devices. Below is a dict representation of all raw configuration keys and values provided to the container surfaced by the socket under the /1.0/config/ route. rre)r)rrfr&r&r'r_s#r_cCs t|tSr:)rZlist_from_depends datasources)Zdependsr&r&r'get_datasource_listsr__main__z*Query LXD metadata and emit a JSON object.) descriptionre)N)T)T)H__doc__r{r;r~renumrrZ json.decoderrtypingrrrrr r r rZrequests.adaptersr Zurllib3.connectionr Zurllib3.connectionpoolrZ cloudinitrrZloggingrrrrZ cloudinit.netrZ getLoggerr>r!rErcrrrtr(r0r1rBrDrKrQrvrRryrZrrZResponserrgrrr_ZDEP_FILESYSTEMrrargparserArgumentParserparser parse_argsprintZ json_dumpsr&r&r&r's  $          &  j  Q *