Rkh*ddlmZddlmZddlmZddlmZmZddlm Z ddl m Z ddl m Z mZmZmZmZddlmZdd lmZmZdd lmZmZmZmZmZmZmZdd lm Z dd l!m"Z"dd l#m$Z$ddl%m&Z&m'Z'ddl(m)Z)ddlm Z  d'dedede*de*de'e+de,de&fdZ-d(de.fdZ/dZ0dede*defdZ1dededefdZ2dede*dedefdZ3dede*ddfdZ4ded e+fd!Z5ded"e'e+de&e*e ffd#Z6dede*d$e'e*fd%Z7dede*fd&Z8y)))datetime)UUID)Session) HTTPExceptionstatus) APIException)QueryPaginator)funccastIntegerand_or_) WordAlias) WorkGroupWorkGroupWebCrawler)WorkGroupCreateSchemaWorkGroupOutputSchemaWorkGroupUpdateSchemaWorkGroupFilterSchema!WorkGroupWebCrawlerAdditionSchemaWorkGroupWebCrawlerUpdateSchemaWorkGroupWebCrawlerOutputSchema) WebCrawler) API_PREFIXES)settings)DictList) nullslastNdbpayloadpageper_pagesort_by paginatedreturnc K |jtjtjj d}t ||}t |}|r|j|}n6|jttjj}|s3|j}|D cgc]} tj| c} S|dz |z} t|tdjt!t#j$t&j(g| |d} | j+Scc} w#t,$r-} t/ddt!| it0j2d d} ~ wwxYww) zc Get all work groups with pagination and filtering. Returns all if paginated is False. NT)queryschemaurloffsetlimituse_ormget_all_work_groups_service exceptionzFailed to get all work groupsmoduleerror status_codemessage)r)rfilter deleted_atis_apply_work_group_search_filterbuild_work_group_sort_queryorder_byrnameascallrmodel_validater joinstrr api_base_urlr WORK_GROUPpaginate ExceptionrrHTTP_500_INTERNAL_SERVER_ERROR) rr r!r"r#r$r) sort_queryrecordsitr, paginatores b/var/www/html/wine-match-dev/backend/winematch-backend/src/apps/web_crawler/services/work_group.pyr/r/sI# #**9+?+?+C+CD+IJ/ug>19 "ENNJ/ENN9Y^^-?-?-A#BCEiikGGNO)88<O O(h&"(X2245|7N7NOP  !!##P  0A'==3    sHE>B6E:EEE>A&E?E>E E;(E66E;;E>cg}|r|ndg}|D]} |jdd}|dvrLtt|}|jdr|j }|j t |n!tdd|dtjd |S#t$r"tdd|dtjd wxYw) Nr<-r()r< created_at updated_atidr/z&Cannot sort with unidentified column ''zError retrieving work groups.r1) replacegetattrr startswithdescappendrrrHTTP_422_UNPROCESSABLE_ENTITYAttributeError)r#rG sort_fieldsscol sort_orders rLr:r:MsJ$'6(K  ))C$C@@$Y4 <<$!+!2J!!)J"78"8B1#QG & D D; 9,  4>qcC"@@7   s BB+Cct|drJ|jr>d|jd}|jtjj |}|S)z1 Apply search filter to WorkGroup query. search%)hasattrr_r6rr<ilike)r)r search_terms rLr9r9isIw!gnn'..)+  Y^^11+>? L work_group_idcK |jtjtj|k(tjj dj }|stdd|itjd|S#t$r-}tddt|itjdd}~wwxYww)zK Get a work group by its ID. Raises APIException if not found. Nget_work_group_by_id_servicerezWork group not foundr1r0zFailed to get work group by ID) r)rr6rQr7r8firstrrHTTP_404_NOT_FOUNDrErArFrre work_grouprKs rLrgrgrs XXi(// 0MyOcOcOgOghlOmnttv 5& 6"55.     1A'==4    s)CBBC B>(B99B>>Cc(Kt||jd{t||jd{} t |j}|j ||j t||jt|jd{|j|tj|S777.#t$r-}tddt!|it"j$dd}~wwxYww)z" Create a new work group. N)r<create_work_group_servicer0Failed to create work groupr1)check_duplicate_work_group_namer<!fetch_web_crawlers_for_work_groupretailer_codesraddcommit&associate_web_crawlers_with_work_grouprQlistkeysrefreshrr?rErrArrF)rr web_crawler_map new_grouprKs rLrmrms *"gll ;;;>b'BXBXYYO   y 5RtOL`L`LbGcddd 9$33I>>!<Z e  .A'==1    sVDCDCDA(C(C))CDDC D"(D  DDcK t||d{}|jr7|j|jk7rt||jd{|jr|j|_|jt ||j d{}t ||d{t||t|jd{|j|tj|S777n7\72#t$r-}tddt|it j"dd}~wwxYww)z( Update an existing work group. Nupdate_work_group_servicer0zFailed to update work groupr1)rgr<rorsrprq)clear_work_group_web_crawler_associationsrtrurvrwrr?rErrArrF)rrer rkrxrKs rLr{r{s$ 7MJJ  <AA.AA>A A;(A66A;;A>r<cK |jtjtj|k(tjj dj }|rtdd|itjdy#t$r-}tddt|itjdd}~wwxYww)zr Check if a work group with the given name already exists. Raises APIException if duplicate is found. Nrmr<z(Work group with this name already existsr1r0rn) r)rr6r<r7r8rhrrHTTP_409_CONFLICTrErArF)rr<existing_grouprKs rLroros  ),33INNd4JIL`L`LdLdeiLjkqqs 2tn"44B     .A'==1    s)CBBC B=(B88B==CrqcK |jtjtjj |r|ngtj j dj}|Dcic]}|j|c}Scc}w#t$r-}tddt|itjdd}~wwxYww)zv Fetch web crawlers by retailer codes and return a map of id to WebCrawler. Raises APIException on error. Nrmr0z/Failed to fetch web crawlers for the work groupr1)r)rr6codein_r7r8r>rQrErrArrF)rrq web_crawlerswcrKs rLrprps  xx +22 OO  .b I  ! ! % %d +  #% %11br 111  .A'==E    s;CA5B9B BCB C (CC  Cweb_crawler_idscK |D] }t||}|j|"|jy#t$r-}t ddt |it jdd}~wwxYww)zf Create associations between a work group and web crawlers. Raises APIException on error. )reweb_crawler_idrmr0z4Failed to associate web crawlers with the work groupr1N)rrrrsrErrArrF)rrerwc_id associationrKs rLrtrtsz  $ E-+$K FF;    .A'==J    s%A35:A3 A0(A++A00A3c&K |jtjtj|k(j |j y#t $r-}tddt|itjdd}~wwxYww)zo Delete all WorkGroupWebCrawler associations for a given work group. Raises APIException on error. r{r0z3Failed to clear work group web crawler associationsr1N) r)rr6redeletersrErrArrF)rrerKs rLr|r|+sy   $%,,-@-N-NR_-_`ggi  .A'==I    s)BAAB B!(B  BB)r' NT)N)9ruuidrsqlalchemy.ormrfastapirrsrc.core.exceptionsrsrc.utils.paginationr sqlalchemyr r r r r*src.apps.wine.word_alias.models.word_aliasr*src.apps.wine.validation.models.validationrr'src.apps.web_crawler.schemas.work_grouprrrrrrr'src.apps.web_crawler.models.web_crawlerrsrc.utils.constantsrsrc.core.configrtypingrrsqlalchemy.sql.expressionrintrAboolr/rur:r9rgrmr{r~rorprtr|rdrLrs"),/33@U?,$/,  / / "/  /  / #Y /  /  / d8    4  "  B' ' ' #'  ' T     , g S ,  c W[\_ak\kWl & W S cghkcl *  PS rd