o /ѹg^,@sddlZddlmZddlmZddlmZddlZddlZddl m Z m Z m Z m Z ddlmZddlmZmZddlmZmZmZmZmZmZdd lmZdd lmZeZGd d d eZ Gd ddeZ!GdddeZ"GdddeZ#GdddeZ$ddZ%e GdddeZ&e GdddeZ'e GdddeZ(e Gddde(Z)e Gdd d e(Z*e Gd!d"d"eZ+Gd#d$d$eZ,e Gd%d&d&e,Z-e Gd'd(d(e,Z.e Gd)d*d*e,Z/Gd+d,d,eZ0dS)-N)ABC) HTTPStatus)Optional)asdictdefinefield validators)ModelScopeConfig)API_RESPONSE_FIELD_DATAAPI_RESPONSE_FIELD_MESSAGE)NotLoginExceptionNotSupportError RequestErrorhandle_http_responseis_okraise_for_http_status) get_endpoint) get_loggerc@eZdZdZdZdS) AcceleratorcpuZgpuN)__name__ __module__ __qualname__CPUGPUrrY/Users/admin/.pyenv/versions/3.10.0/lib/python3.10/site-packages/modelscope/hub/deploy.pyrrc@seZdZdZdS)VendorZeasN)rrrEASrrrrrsrc@r) EASRegionz cn-beijingz cn-hangzhouN)rrrZbeijingZhangzhourrrrr!!rr!c@ eZdZdZdZdZdZdZdS)EASCpuInstanceTypezTEAS Cpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.c6.2xlargezecs.c6.4xlargezecs.c6.6xlargezecs.c6.8xlargeNrrr__doc__ZtinysmallZmediumZlargerrrrr#& r#c@r")EASGpuInstanceTypezTEAS Gpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.gn5-c28g1.7xlargezecs.gn5-c8g1.4xlargezecs.gn6i-c24g1.12xlargezecs.gn6e-c12g1.3xlargeNr$rrrrr(/r'r(cCs ||jkrtd||jfdS)NzG'min_replica' value: %s has to be smaller than 'max_replica' value: %s!) max_replica ValueError)instance attributevaluerrrmin_smaller_than_max8s r.c@sJeZdZUdZededdZee d<edede gdZ ee d<dS)ServiceScalingConfigzResource scaling config Currently we ignore max_replica Args: max_replica: maximum replica min_replica: minimum replica defaultZ validatorr) min_replicaN) rrrr%rrger)int__annotations__r.r3rrrrr/?s r/c@sFeZdZUdZeed<eed<eej e ej ej gdZ eed<dS)ServiceResourceConfigzEas Resource request. Args: accelerator: the accelerator(cpu|gpu) instance_type: the instance type. scaling: The instance scaling config. Z instance_typeZscalingr1 acceleratorN)rrrr%strr6r/rrrrin_rr8rrrrr7Ls r7c@s eZdZdS)ServiceProviderParametersN)rrrrrrrr;\sr;c@sZeZdZUdZeed<eed<eed<dZeeed<ee j e e j gdZ eed<dS) EASDeployParametersaAParameters for EAS Deployment. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' region access_key_idaccess_key_secretNresource_groupr1vendor)rrrr%r9r6r@rrrr rr:rArrrrr<as  r<c@sZeZdZUdZeed<eed<dZeed<dZeed<ee j e e j gdZ eed<dS) EASListParametersa@EAS instance list parameters. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' r>r?Nr=r@r1rA)rrrr%r9r6r=r@rrr rr:rArrrrrBts    rBc@s:eZdZUdZeed<eed<eed<eed<eed<dS)DeployServiceParametersa Deploy service parameters Args: instance_name: the name of the service. model_id: the modelscope model_id revision: the modelscope model revision resource: the resource requirement. provider: the cloud service provider. instance_namemodel_idrevisionresourceproviderN)rrrr%r9r6r7r;rrrrrCs   rCc@seZdZdZddZdS)AttrsToQueryStringz7Convert the attrs class to json string. Args: cCsDt|jddd}t|}t|tj|}t|d|}|S)NcSs|duSNr)attrr-rrrsz1AttrsToQueryString.to_query_str..)filterz provider=%s)rrHjsondumpsprinturllibparse quote_plus)selfZ self_dictZjson_strZsafe_strZ query_paramrrr to_query_strs   zAttrsToQueryString.to_query_strN)rrrr%rUrrrrrIs rIc@s.eZdZUeed<dZeed<dZeed<dS)ListServiceParametersrHrskipdlimitN)rrrr;r6rWr5rYrrrrrVs  rVc@eZdZUeed<dS)GetServiceParametersrHNrrrr;r6rrrrr[ r[c@rZ)DeleteServiceParametersrHNr\rrrrr^r]r^c @seZdZdZdddZdedededed ef d d Zded efd d Z ded efddZ  dd ede e de e fddZ dS)ServiceDeployerzEFacilitate model deployment on to supported service provider(s). NcCsB|dur|nt|_dti|_t|_|jdurtddS)Nz user-agentz5Token does not exist, please login with HubApi first.)rendpointr Zget_user_agentheadersZ get_cookiescookiesr )rTr`rrr__init__s  zServiceDeployer.__init__rErFrDrGrHc Cs|jtjkr td|jt|||||d}|jd}t|}tj|||j |j d} t | t |j d| j tjkrU| j tjkrUt| rM| t} | St| tt| dS)aDeploy model to cloud, current we only support PAI EAS, this is an async API , and the deployment could take a while to finish remotely. Please check deploy instance status separately via checking the status. Args: model_id (str): The deployed model id revision (str): The model revision instance_name (str): The deployed model instance name. resource (ServiceResourceConfig): The service resource information. provider (ServiceProviderParameters): The service provider parameter Raises: NotSupportError: Not supported platform. RequestError: The server return error. Returns: ServiceInstanceInfo: The information of the deployed service instance. z1Not support vendor: %s ,only support EAS current.)rDrErFrGrHz/api/v1/deployer/endpoint)rNrbraZcreate_serviceN)rArr r rCr`rrequestspostrbrarlogger status_coderOKMULTIPLE_CHOICESrrNr rr r) rTrErFrDrGrHZ create_paramspathbodyrdatarrrcreates4     zServiceDeployer.createcCt|d}d|j||f}tj||j|jd}t|t|jd|j t j kr=t | r5| t}|St| tt|dS)aQuery the specified instance information. Args: instance_name (str): The deployed instance name. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed from server. Returns: Dict: The information of the requested service instance. rH!%s/api/v1/deployer/endpoint/%s?%srbraZ get_serviceN)r[r`rUrdgetrbrarrfrgrrhrrNr rr rrTrDrHparamsrjrlrmrrrrss     zServiceDeployer.getcCro)a Delete deployed model, this api send delete command and return, it will take some to delete, please check through the cloud console. Args: instance_name (str): The instance name you want to delete. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed. Returns: Dict: The deleted instance information. rprqrrZdelete_serviceN)r^r`rUrddeleterbrarrfrgrrhrrNr rr rrtrrrrvs     zServiceDeployer.deleterrXrWrYcCst|||d}d|j|f}tj||j|jd}t|t|jd|j t j kr>t | r6| t}|St| tt|dS)aList deployed model instances. Args: provider (ServiceProviderParameters): The cloud service provider parameter, for eas, need access_key_id and access_key_secret. skip (int, optional): start of the list, current not support. limit (int, optional): maximum number of instances return, current not support Raises: RequestError: The request is failed from server. Returns: List: List of instance information )rHrWrYz%s/api/v1/deployer/endpoint?%srrZlist_service_instancesN)rVr`rUrdrsrbrarrfrgrrhrrNr rr r)rTrHrWrYrurjrlrmrrrlist1s   zServiceDeployer.listrJ)rrX)rrrr%rcr9r7r;rnrsrvrr5rwrrrrr_s&   . r_)1rQabcrhttprtypingrrNrdattrsrrrrZmodelscope.hub.apir Zmodelscope.hub.constantsr r Zmodelscope.hub.errorsr r rrrrZmodelscope.hub.utils.utilsrZmodelscope.utils.loggerrrfobjectrrr!r#r(r.r/r7r;r<rBrCrIrVr[r^r_rrrrsN