{KgIdZddlZddlmZmZddlmZmZddlmZddl Z ddl m Z ddl mZdd lmZmZmZdd lmZdd lmZdd lmZdd lmZmZddlmZdZGddeeeZy)zBase class for mixture models.N)ABCMetaabstractmethod)IntegralReal)time) logsumexp)cluster) BaseEstimator DensityMixin _fit_context)kmeans_plusplus)ConvergenceWarning)check_random_state)Interval StrOptions)check_is_fittedctj|}|j|k7rtd|d|d|jy)zValidate the shape of the input parameter 'param'. Parameters ---------- param : array param_shape : tuple name : str zThe parameter 'z' should have the shape of z , but got N)nparrayshape ValueError)param param_shapenames Y/home/alanp/www/video.onchill/myenv/lib/python3.12/site-packages/sklearn/mixture/_base.py _check_shapers? HHUOE {{k![%++ /  "ceZdZUdZeedddgeedddgeedddgeedddgeedddgehdgd gd gd geedddgd Ze e d <dZ e dZ dZe dZd&dZedd&dZdZe dZe dZe dZdZd&dZdZdZd'dZdZe d Ze d!Zd"Zd#Z d$Z!d%Z"y)( BaseMixturezBase class for mixture models. This abstract class specifies an interface for all mixture classes and provides basic common methods for mixture models. Nleft)closedgr>kmeansrandomrandom_from_data k-means++ random_statebooleanverbose n_componentstol reg_covarmax_itern_init init_paramsr( warm_startr*verbose_interval_parameter_constraintsc ||_||_||_||_||_||_||_||_| |_| |_ yNr+) selfr,r-r.r/r0r1r(r2r*r3s r__init__zBaseMixture.__init__AsN)"   &($ 0rcy)zCheck initial parameters of the derived class. Parameters ---------- X : array-like of shape (n_samples, n_features) Nr7Xs r_check_parameterszBaseMixture._check_parametersY rc|j\}}|jdk(rxtj||jf}t j |jd|j|j}d|tj||f<n:|jdk(rI|j||jf}||jdddtjfz}n|jdk(rdtj||jf}|j||jd }d||tj|jf<no|jd k(r`tj||jf}t||j| \}}d||tj|jf<|j|y) a?Initialize the model parameters. Parameters ---------- X : array-like of shape (n_samples, n_features) random_state : RandomState A random number generator instance that controls the random seed used for the method chosen to initialize the parameters. r$r!) n_clustersr0r(r%sizeaxisNr&F)rBreplacer')r()rr1rzerosr,r KMeansfitlabels_arangeuniformsumnewaxischoicer _initialize)r7r<r( n_samples_resplabelindicess r_initialize_parametersz"BaseMixture._initialize_parameterscsww 1   x '88Y(9(9:;D#00Q 12D9%u, -    )''i9J9J-K'LD DHH!H$Q ]3 3D   !3 388Y(9(9:;D")) 1 15*G;} |j!| |r|j#|||rtj n |j$} |j&dk(r|j)} d} jd} td|j&dzD]o}| }|j+|\}}|j-|||j/||} | |z }|j1||t3||j4ksmd } n|j7| | | |kDs|tj k(s$| }|j)} } | |_ A|js)|j&dkDrt9j:d t<|j?  |_ ||_|j+|\}}|jCd S) aEstimate model parameters using X and predict the labels for X. The method fits the model n_init times and sets the parameters with which the model has the largest likelihood or lower bound. Within each trial, the method iterates between E-step and M-step for `max_iter` times until the change of likelihood or lower bound is less than `tol`, otherwise, a :class:`~sklearn.exceptions.ConvergenceWarning` is raised. After fitting, it predicts the most probable label for the input data points. .. versionadded:: 0.20 Parameters ---------- X : array-like of shape (n_samples, n_features) List of n_features-dimensional data points. Each row corresponds to a single data point. y : Ignored Not used, present for API consistency by convention. Returns ------- labels : array, shape (n_samples,) Component labels. r )dtypeensure_min_samplesrz:Expected n_samples >= n_components but got n_components = z, n_samples = converged_r!FTzBest performing initialization did not converge. Try different init parameters, or increase max_iter, tol, or check for degenerate data.rC)"_validate_datarfloat64float32rr,rr=r2hasattrr0infr_rr(range_print_verbose_msg_init_begrU lower_bound_r/_get_parameters_e_step_m_step_compute_lower_bound_print_verbose_msg_iter_endabsr-_print_verbose_msg_init_endwarningswarnr_set_parametersn_iter_argmax)r7r<rZdo_initr0max_lower_boundr(rPrQinit lower_bound best_params best_n_iter convergedn_iterprev_lower_bound log_prob_normlog_respchanges rrXzBaseMixture.fit_predicts|8   "**bjj)AVW  X 771:)) )**.*;*;)<= wwqzl,  q!F74+FG 'Q66')$*;*;< ww 1&MD  , ,T 2++A|<%,266'$2C2CK}}!"224  ! #At}}q'89F'2$.2ll1o+M8LLH-"&";";Hm"TK(+;;F44VVD6{TXX-$( :00iH0Ow4N&1O"&"6"6"8K"(K&/DOC"L4==1#4 MM9#   [)" + ll1o 8A&&rcX|j|\}}tj||fS)aE step. Parameters ---------- X : array-like of shape (n_samples, n_features) Returns ------- log_prob_norm : float Mean of the logarithms of the probabilities of each sample in X log_responsibility : array, shape (n_samples, n_components) Logarithm of the posterior probabilities (or responsibilities) of the point of each sample in X. )_estimate_log_prob_resprmean)r7r<r}r~s rrizBaseMixture._e_step"s- #'">">q"A xww}%x//rcy)a*M step. Parameters ---------- X : array-like of shape (n_samples, n_features) log_resp : array-like of shape (n_samples, n_components) Logarithm of the posterior probabilities (or responsibilities) of the point of each sample in X. Nr:)r7r<r~s rrjzBaseMixture._m_step5s rcyr6r:r7s rrhzBaseMixture._get_parametersC rcyr6r:)r7paramss rrqzBaseMixture._set_parametersGrrcvt||j|d}t|j|dS)aCompute the log-likelihood of each sample. Parameters ---------- X : array-like of shape (n_samples, n_features) List of n_features-dimensional data points. Each row corresponds to a single data point. Returns ------- log_prob : array, shape (n_samples,) Log-likelihood of each sample in `X` under the current model. Fresetr!rC)rr`r_estimate_weighted_log_probr;s r score_sampleszBaseMixture.score_samplesKs9      /99!<1EErc@|j|jS)aCompute the per-sample average log-likelihood of the given data X. Parameters ---------- X : array-like of shape (n_samples, n_dimensions) List of n_features-dimensional data points. Each row corresponds to a single data point. y : Ignored Not used, present for API consistency by convention. Returns ------- log_likelihood : float Log-likelihood of `X` under the Gaussian mixture model. )rrrYs rscorezBaseMixture.score^s"!!!$))++rct||j|d}|j|jdS)aPredict the labels for the data samples in X using trained model. Parameters ---------- X : array-like of shape (n_samples, n_features) List of n_features-dimensional data points. Each row corresponds to a single data point. Returns ------- labels : array, shape (n_samples,) Component labels. Frr!rC)rr`rrsr;s rpredictzBaseMixture.predictqs@      ///299q9AArct||j|d}|j|\}}tj|S)aEvaluate the components' density for each sample. Parameters ---------- X : array-like of shape (n_samples, n_features) List of n_features-dimensional data points. Each row corresponds to a single data point. Returns ------- resp : array, shape (n_samples, n_components) Density of each Gaussian component for each sample in X. Fr)rr`rrexp)r7r<rQr~s r predict_probazBaseMixture.predict_probasD      /2215 8vvhrcjt||dkrtd|jz|jj\}}t |j }|j||j}|jdk(retjt|j|j|Dcgc]"\}}}|j||t|$c}}}} n|jdk(ratjt|j|Dcgc]+\}}|j||jt|-c}}} nutjt|j|j|Dcgc]3\}}}||j!||ftj"|zz5c}}}} tj$t'|D cgc]!\} }tj(|| t#c}} } | | fScc}}}wcc}}wcc}}}wcc}} w)ayGenerate random samples from the fitted Gaussian distribution. Parameters ---------- n_samples : int, default=1 Number of samples to generate. Returns ------- X : array, shape (n_samples, n_features) Randomly generated sample. y : array, shape (nsamples,) Component labels. r!zNInvalid value for 'n_samples': %d . The sampling requires at least one sample.fulltiedrA)r])rrr,means_rrr( multinomialweights_covariance_typervstackzip covariances_multivariate_normalintstandard_normalsqrt concatenate enumerater) r7rPrQ n_featuresrngn_samples_compr covariancesampler<jrZs rrzBaseMixture.samples  q=$'+'8'8:   )) : !2!23DMMB   6 ) 7: T%6%6772z6++D*c&kJ7A ! !V + +.dkk>*J*Jv++D$2C2CS[Q*JA 7: T%6%67 72z6)) /C)Dggj)**7  A NNrcy)a9Estimate the log-probabilities log P(X | Z). Compute the log-probabilities per each component for each sample. Parameters ---------- X : array-like of shape (n_samples, n_features) Returns ------- log_prob : array, shape (n_samples, n_component) Nr:r;s rrzBaseMixture._estimate_log_probs rc|j|}t|d}tjd5||ddtjfz }ddd||fS#1swY|fSxYw)a@Estimate log probabilities and responsibilities for each sample. Compute the log probabilities, weighted log probabilities per component and responsibilities for each sample in X with respect to the current state of the model. Parameters ---------- X : array-like of shape (n_samples, n_features) Returns ------- log_prob_norm : array, shape (n_samples,) log p(X) log_responsibilities : array, shape (n_samples, n_components) logarithm of the responsibilities r!rCignore)underN)rrrerrstaterM)r7r<weighted_log_probr}r~s rrz#BaseMixture._estimate_log_prob_respsj&!<*>>HI(0$ # /rc |rdnd}|jdk(rtd|dy |jdk\r/t|jz }td|d|dd |ddy y ) z.Print verbose message on the end of iteration.rzzdid not converger!zInitialization .r z . time lapse z.5fzs lower bound N)r*rrr)r7lbinit_has_converged converged_msgts rrnz'BaseMixture._print_verbose_msg_init_end+sw'9 ?Q <<1  OM?!4 5 \\Q ---A !- aWEs81 rr6)r!)#__name__ __module__ __qualname____doc__rrrrr4dict__annotations__r8rr=rUrOrHr rXrirjrhrqrrrrrrrrrrfrlrnr:rrr r +s"(AtFCDsD89tS$v>?h4?@Haf=> L M (( k;%h4GH $D 10  )"V    <5g'6g'R0&        F&,&B$ &<| I      '48 0 rr ) metaclass)rroabcrrnumbersrrrnumpyr scipy.specialrr baser r r r exceptionsrutilsrutils._param_validationrrutils.validationrrr r:rrrsK$ '"#<<%+&:. &J, Jr