Ti"SSKJr SSKrSSKJr SSKJr SSKrSSK r SSK J r J r SSKJrJr SSKJr SSKJr SS KJrJr \"\R2S - 5\ lSS jrSr\R:\R<R>:Xa \b\"5r"S S 5r "SS\ 5r!"SS\ 5r""SS\ 5r#Sr$Sr%Sr&Sr'SSjr(SS Sjjr)S!Sjr*S"Sjr+SS#Sjjr,g!\a SrNf=f!\a Sr Nf=f)$) annotationsN)SequenceMatcher)List)SBDetectmodels)packagesettings) cache_spacy)Package)infowarningminisbdchXRS5(aS$S$![[4a gf=f)zFGet appropriate processors for a language, including MWT if available.mwtz tokenize,mwttokenize)getKeyError TypeError) lang_code resourcess d/var/www/html/backend/Backoffice_Marketplace/venv/lib/python3.13/site-packages/argostranslate/sbd.pyget_stanza_processorsrs<!*!5!9!9%!@!@~PjP i s11c*\rSrSr%S\S'SSjrSrg)ISentenceBoundaryDetectionModel(r pkgc[e)N)NotImplementedErrorselftexts rsplit_sentences/ISentenceBoundaryDetectionModel.split_sentences,s!!Nr!strreturnz List[str])__name__ __module__ __qualname____firstlineno____annotations__r"__static_attributes__r%r$rrr(s L"r$rc.\rSrSrSSjrSSjrSrSrg) SpacySentencizerSmall5cdXl[c [S5eURb?S[ UR5;a&[R "URS/S9UlO1[c [S5e[R "[S/S9UlUR RS5 g)z Packaging specific spacy when "xx_sent_ud_sm" doesn't cover the language improves performances over stanza. Please use small models ".._core/web_sm" for consistency. NzBSpaCy is not installed. Install spacy or change ChunkType settingsspacyparser)excludezSpaCy cache not initialized sentencizer) rr3 RuntimeErrorpackaged_sbd_pathr'loadnlp_cached_spacy_pathadd_piper rs r__init__SpacySentencizerSmall.__init__6s  =cd d  ,C@U@Ur"rJr.r%r$rr0r05s)$1 $r$r0c J\rSrSrSSSSSSSSS.rSS jrS rSS jrS rS r g)MiniSBDSentencizerQzh-hantzzh-hanspttrhien)ztzhpbazbneomstlcXlURS- nSnUR5(aT[R"U5Vs/sHoDR S5(dMUPM nnU(a[ X%S- 5nUbUnOmURRURUR5nU[R"5;a$[URRS35 SnX`l SUlgs snf)Nrz.onnxrz0 is not available in MiniSBD, falling back to enrU)r package_pathexistsoslistdirendswithr'LANGUAGE_CODE_MAPPINGrrBminisbd_models list_modelsr langdetector)r rsbd_path model_filef model_filesrgs rr>MiniSBDSentencizer.__init__`s##i/ ??  &(jj&:R&:jj>Q1&:KR N!:;  !D--11 s}}D >5577488--..^_`  'Ss D"DcURc*[UR[RS:HS9UlUR$)Ncuda)use_gpu)rhrrgr devicerIs r lazy_detector MiniSBDSentencizer.lazy_detector|s1 == $TYY68QRDM}}r$c[SURRS[U535 UR 5R U5$rA)r rrBr'rr sentencesrs rr""MiniSBDSentencizer.split_sentencessB 5dhh6H6H5ICPTI; WX!!#--d33r$cg)NrOr%rIs rrJMiniSBDSentencizer.__str__rLr$)rhrgrNrMr&) r)r*r+r,rdr>rrr"rJr.r%r$rrOrOQs8 8 4$r$rOc>\rSrSrSSS.rS SjrSrS SjrSrS r g ) StanzaSentencizerrQrR)rVrXcXl[c [S5eURR UR UR 5UlSUlg)NzDStanza is not installed. Install stanza or change ChunkType settings)rstanzar7rdrrBstanza_lang_codestanza_pipeliner=s rr>StanzaSentencizer.__init__sH >ef f $ : : > > MM3==!  $r$cURcX[R"UR[ UR R S- 5S[RS:HSS9UlUR$)Nr}rroWARNING)rgdir processorsrp logging_level) rr}Pipeliner~r'rr_r rqrIs r lazy_pipelineStanzaSentencizer.lazy_pipelines_    '#)??**--89% 61' $D ###r$c[SURRS[U535 UR 5"U5nUR Vs/sHo3R PM sn$s snfrA)r rrBr'rrur!rDs rr"!StanzaSentencizer.split_sentencessY 5dhh6H6H5ICPTI; WX  "4(&)mm4md m444sA+cg)Nrzr%rIs rrJStanzaSentencizer.__str__s"r$)rr~rNrMr&) r)r*r+r,rdr>rr"rJr.r%r$rrzrzs$ $ $5 #r$rza I walked down to the river. Then I went to the I walked down to the river. ---------- Argos Translate is machine translation software. It is also Argos Translate is machine translation software. ---------- Argos Translate is written in Python and uses OpenAI. It also supports Argos Translate is written in Python and uses OpenAI. ---------- zzz ----------ch[R"5nUHnURS:XdMUs $ g)Nsbd)rget_installed_packagestype)packagesrs rget_sbd_packagers0--/H 88u J r$c@USUn[S-U-n[SU5 U$)Nz generate_fewshot_sbd_prompt)fewshot_promptr ) input_textsentence_guess_lengthsentence_guess to_returns rrrs3 6!67N!@@>QI & 2 r$cUR[5n[SU5 [U5S:agUSRS5n[U5S:agUS$)Nparse_fewshot_response )splitFEWSHOT_BOUNDARY_TOKENr len) response_textresponses rrrsZ""#9:H !8, 8}q|!!$'H 8}q B<r$c UR[5nUS:wasUSUn[SU5 SnSn[[ U55HDnUSUn[ 5nUR Xa5 UR5nUS:XdX:dM@UnUnMF U$g)Nrzsbd_translated_guess:rg)findSENTENCE_BOUNDARY_TOKENr rangerrset_seqsratio) rsbd_translated_guesssbd_translated_guess_index best_index best_ratioicandidate_sentencesmrs rprocess_seq2seq_sbdrs!5!:!:;R!S!R'34O5OP $&:;  s:'A!+BQ  "B KK* AHHJEAv+ " (r$cjUSUn[SU5 UR[U-5n[X5$)axGiven input text, return the index after the end of the first sentence. Args: input_text: The text to detect the first sentence of. sbd_translation: An ITranslation for detecting sentences. sentence_guess_length: Estimated number of chars > than most sentences. Returns: The index of the character after the end of the sentence. -1 if not found. Nzsentence_guess:)r translate DETECT_SENTENCE_BOUNDARIES_TOKENr)rsbd_translationrrrs rdetect_sentencersC 6!67N N+*44(>9 z @@r$)rr'rdictr(r')r(zPackage | None))rr'rintr(r')rr'r(z str | None)rr'rr'r(r)rr'rrr(r)- __future__rradifflibrtypingrr3 ImportErrorr}rrrreargostranslaterr argostranslate.networkingr argostranslate.packager argostranslate.utilsr r r'data_dir cache_dirrr; chunk_type ChunkTypeSPACYrr0rOrzrrrrrrrrrr%r$rrsR" #7,1*.x009<= (,,222u7H$""$;$85$85$p"#7"#V $B /!36,/*DGAA=@AAW E  Fs"C1C?1C<;C<?D  D