y:iL ddlZddlZddlmZmZddlmZmZddlmZddl Z ddl m Z m Z mZddlmZddlmZmZddlmZdd lmZdd lmZdd lmZdd lmZmZdd lm Z m!Z!m"Z"ddl#m$Z$m%Z%m&Z&ddl'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ>m?Z?m@Z@mAZAmBZBmCZCmDZDmEZEddlFmGZGddlHmIZIddlJmKZKddlLmMZMddlNmOZOmPZPdede"de!fdZQe"fdede"deRfdZSe"fdede"deRfdZTdedeUdeRfdZVdeMdfdedeUdeeUdeeUdeeUde!f d ZWe"fded!e de"de!fd"ZXded#eOfd$ZYded%eUd&eUfd'ZZdedeUfd(Z[y))N)datetimetimezone)CallableOptional)UUID) HTTPException UploadFilestatus) FileResponse)Stringcast)IntegrityError)Session)StreamingResponse)Country)Region SubRegion)DownloadFilesCreateSchemaDownloadFilesOutputSchemaExportDataFilterSchema)create_download_fileget_all_latest_download_filesget_all_latest_uploaded_files) generate_appellation_export_file generate_bottle_size_export_file(generate_colour_substitution_export_file!generate_global_noise_export_filegenerate_mongo_map_export_file%generate_producer_keyword_export_file#generate_producer_noise_export_file!generate_spread_table_export_filegenerate_varieties_export_filegenerate_wine_alias_export_filegenerate_wine_db_export_file!generate_wine_keyword_export_filegenerate_wine_noise_export_file%generate_word_elimination_export_file"generate_word_reserved_export_fileupdate_appellation_from_csvupdate_bottle_size_from_csv#update_colour_substitution_from_csvupdate_global_noise_from_csvupdate_mongo_map_from_csv update_producer_keyword_from_csvupdate_producer_noise_from_csvupdate_spread_table_from_csvupdate_varieties_from_csvupdate_wine_alias_from_csvupdate_wine_db_from_csvupdate_wine_keyword_from_csvupdate_wine_noise_from_csv update_word_elimination_from_csvupdate_word_reserved_from_csv)CreateFileWithPathSchema)create_file_from_path) APIException)EXPORT_DATA_SUB_FOLDER)ExportDataTypesExportDataTypesFileNamedbpayloadreturncdKt||d{}d}|j23d{}||jdz }7076t|jj t jjdd}t||||jd{7}|Sw)a Generates and stores a download file based on the provided payload. :param db: Database session :param payload: ExportDataFilterSchema containing export type and other parameters :return: DownloadFilesOutputSchema containing details of the stored download file r>r?Nutf-8%Y-%m-%d-%H%M%S.txt)r> file_namecontent file_type) get_export_file body_iteratordecoder=typevaluernowstrftimestore_files_locally)r>r? data_streamrHchunkrG download_files c/var/www/html/wine-match-dev/backend/winematch-backend/src/apps/export_data/services/export_data.pygenerate_download_filerVBs(2w??KG"00))e5<<(( @)0+7<<8>>? @W@WXi@j?kkopI- ,, M s<B0AB0AAAB0AA B0(B+)B0cvK|jxtjk(rt}|ddSxtjk(rt }|ddSxtj k(rt}|ddSxtjk(rt}|ddSxtjk(rt}|ddSxtjk(rt}|ddSxtjk(rt}|ddSxtj k(rt#}|ddSxtj$k(rt'}|ddSxtj(k(rt+}|ddSxtj,k(rt/}|ddSxtj0k(rt3}|ddSxtj4k(rt7}|ddSxtj8k(rt;}|ddStj<k(rt?}|ddS tAddditBjDdw)z Fetches the export file based on the provided payload type. :param db: Database session :param payload: ExportDataFilterSchema containing export type and other parameters queuedtaskr rJ exceptionzInvalid export typeInvalid export type provided.moduleerror status_codemessage)#rMr<WINE_DBr$ MONGO_MAPr WINE_KEYWORDr%PRODUCER_KEYWORDr GLOBAL_NOISErPRODUCER_NOISEr WINE_NOISEr& SPREAD_TABLEr! WORD_RESERVEDr( BOTTLE_SIZEr WINE_ALIASr# VARIETIESr"COLOUR_SUBSTITUTIONSrWORD_ELIMINATIONr' APPELLATIONrr:r HTTP_400_BAD_REQUEST)r>r?rZs rUrJrJ_s ,, $_ $ $/1D H5 5 &_ & &13D H5 5 )_ ) )46D H5 5 -_ - -8:D H5 5 )_ ) )46D H5 5 +_ + +68D H5 5 '_ ' '24D H5 5 )_ ) )46D H5 5+_ * *57D H5 5 (_ ( (35D H5 5 '_ ' '24D H5 5 &_ & &13D H5 5 1_ 1 1;=D H5 5 -_ - -8:D H5 5  ( (35D H5 5("$9:"777  sH7H9cKt|d{}|stddditjd|j |j s-tddd|j d itjd |j |j }t jjt jtd |j d }t jj|s"tddd |itjdt||j d dS7.w)a= Downloads a specific export file based on the provided type. Args: db (Session): Database session dependency. payload (ExportDataFilterSchema): Filter criteria for the export file, including type. Returns: StreamingResponse: Contains the export file data or an error message. r>NrTr[No export files available.+No export files are available for download.r]#No export file available for type: ..The requested export file type does not exist. masterdatarGFile not found at path: 7The requested export file does not exist on the server.application/octet-streampathfilename media_type) rr:r HTTP_404_NOT_FOUNDgetrMosr~joingetcwdr;isfiler )r>r? latest_files files_objr~s rUrTrTs%7"==L " <=11A      GLL )""Egll^ST UV11D     .I 77<< %;\9==YdKe fD 77>>$ "":4& AB11M     {+- 9>sEED.ErGcK tjjtjtd}tjj||}tjj |s"t ddd|itjdt||dS#t$r-}t ddt|itjd d }~wwxYww) a# Downloads a specific export file based on the provided file name. Args: db (Session): Database session dependency. file_name (str): The name of the file to be downloaded. Returns: StreamingResponse: Contains the export file data or an error message. rydownload_file_by_namer[rzz0The requested file does not exist on the server.r]r|r}z&Failed to download the specified file.N) rr~rrr;rr:r rr ExceptionstrHTTP_500_INTERNAL_SERVER_ERROR)r>rGdownload_locationr~es rUrrs GGLL6Ll[ww||-y9ww~~d#."&>tf$EF"55J  1   *A'==<    s)C#B%B*)C#* C 3(CC  C#rH subfolderrIcRKtjjtj|}tj|dtjj||}|(t |dd5}|j |dddtjjt|jdd}t|t||d  d{}t|t|j|  d{} | S#1swYxYw7<7w) z Store the given content in a file under the specified subfolder in the current working directory. Stores the file in database and returns the DownloadFilesOutputSchema. Texist_okNwrDencoding\/z text/plain) file_pathrGmimerB)file_idrI)rr~rrmakedirsopenwriter;replacer9r8rrid) r>rGrHrrIrrfnew_filenew_download_files rUrQrQs RYY[)<KK!D1 . :I )S7 3 q GGG   3Y?GGcRI* ( H3 0PYZ '   s=A:D'<DAD'&D#')D'D%D'D D'%D'filec6K|jd{}|jd}t|jjt j jdd}tjjtjtd}tj|dtjj||}t|dd 5}|j|dddd ||d S7#1swYxYww) z Saves an uploaded export file based on the provided type. :param db: Database session :param payload: ExportDataFilterSchema containing export type and other parameters :return: DownloadFilesOutputSchema NrDrErF uploaddataTrrrsuccess)r rGr~)readrLr=rMrNrrOrPrr~rrr;rrr) r>rr?rH file_contentrGupload_location local_pathrs rUsave_uploaded_filer-sIIKG>>'*L*7<<8>>? @W@WXi@j?kkopIggll299;0F UOKK$/oy9J j# 0A   i LL s(DD CD+D =D DDrMcKt|d{}|stddditjd|j |s#tddd|d itjd |j |}t j jt jtd |j d }t j j|s"tddd |itjd|j d }|xtjk(rt|}|ddSxtjk(rt|}|ddSxtj k(rt#|}|ddSxtj$k(rt'|}|ddSxtj(k(rt+|}|ddSxtj,k(rt/|}|ddSxtj0k(rt3|}|ddSxtj4k(rt7|}|ddSxtj8k(rt;|}|ddSxtj<k(rt?|}|ddSxtj@k(rtC|}|ddSxtjDk(rtG|}|ddSxtjHk(rtK|}|ddSxtjLk(rtO|}|ddStjPk(rtS|}|ddS tddditjTd7Nw)z Processes an uploaded export file based on the provided type. :param db: Database session :param payload: ExportDataFilterSchema containing export type and other parameters :return: Task status rsNrTr[rtrur]rvrwrxrrGrzr{)rGrXrYprocess_uploaded_file_dater\z+The provided export type is not recognized.)+rr:r rrrr~rrr;rr<rbr3rcr-rdr4rer.rfr,rgr/rhr5rir0rjr7rkr*rlr2rmr1rnr+ror6rpr)rq)r>rMrrr~rGrZs rUrrFs7"==L " <=11A      D !""EdV1 MN11D     &I 77<< %;\9==YdKe fD 77>>$ "":4& AB11M    k*I  $_ $ $*Y?D H5 5 &_ & &,yAD H5 5 )_ ) )/)DD H5 5 -_ - -3iHD H5 5 )_ ) )/)DD H5 5 +_ + +1IFD H5 5 '_ ' '- BD H5 5 )_ ) )/)DD H5 5+_ * *09ED H5 5 (_ ( (.CD H5 5 '_ ' '- BD H5 5 &_ & &,yAD H5 5 1_ 1 16KD H5 5 -_ - -3iHD H5 5  ( (.CD H5 53"$CD"77E  y>sM#M MM#codedatecjK |d|d}tjjtjdd|}tjj |s"t ddd|it jd t||d S#t$r}d t|d cYd}~Sd}~wwxYww)N-z -match.txtuploads match_outputsrTr[rzr{r]r|r}failedr r_ rr~rrrr:r rr rr)r>rrrGr~rs rUdownload_matched_filers5fAdV:. ww||BIIKOYOww~~d#&"&>tf$EF"55Q  1  5"SV445s5B3B BB3 B0 B+%B0&B3+B00B3cZK tjjtjdd|}tjj |s"t ddd|it jdt||d S#t$r}d t|d cYd}~Sd}~wwxYww) NrhistoryrTr[rzr{r]r|r}rrr)r>rGr~rs rUdownload_history_filers5ww||BIIKIyIww~~d#&"&>tf$EF"55Q  1  5"SV445s5B+BBB+ B( B#B(B+#B((B+)\iorrrtypingrruuidrpandaspdfastapirr r fastapi.responsesr sqlalchemyr r sqlalchemy.excrsqlalchemy.ormrstarlette.responsesrsrc.apps.base.models.countryrsrc.apps.base.models.regionsrr(src.apps.export_data.schemas.export_datarrr+src.apps.export_data.services.download_filerrr#src.apps.export_data.services.tasksrrrrrrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0r1r2r3r4r5r6r7src.apps.files.schemas.filer8src.apps.files.services.filer9src.core.exceptionsr:src.utils.constantsr;src.utils.enumsr<r=rVanyrJrTrrrQrrrrrUrs '%55*#)"10:  @A>,6D #>'=&>NN #N Nf'=&>-- #- -`# # #  # R"5# $$$c]$} $ } $  $T'=&>MM M$M M2kk k\5G535c5,555r