i ddlZddlZddlZddlZddlmZddlmZmZm Z m Z ddl Z ddl Z ddl Z ddlmZmZddlmZddlmZdd lmZmZmZmZmZej6d ej6d d ed deddd d eddddfde j8dedeedefdZd#dedeededdfdZ dede eddfdZ!d e eefd!edeefd"Z"y)$N)Path)IteratorOptionalSequenceUnion)Printermsg)Language) load_model)NAMEArgOptapp debug_cliprofileT)hidden.zTrained pipeline to load)helpz&Location of input file. '-' for stdin.)rexists allow_dash'z --n-textsz-nz+Maximum number of texts to use if availablectxmodelinputsn_textsc|jjjtk(rt j dt |||y)a\ Profile which functions take the most time in a spaCy pipeline. Input should be formatted as one JSON object per line with a key "text". It can either be provided as a JSONL file, or be read from sys.sytdin. If no input file is specified, the IMDB dataset is loaded via Thinc. DOCS: https://spacy.io/api/cli#debug-profile zThe profile command is now available via the 'debug profile' subcommand. You can run python -m spacy debug --help for an overview of the other available debugging commands.)rrN)parentcommandnamerr warnr)rrrrs b/var/www/vps2.regionflexible.com/Desarrollo/venv/lib/python3.12/site-packages/spacy/cli/profile.py profile_clir#s<2 zz$&  B  E&'2returnc.|/t|t}ttj||}|] ddl}tjd5j|d\}}t|\}}dddtjd|dtjd |d 5t|}dddtjd |d tjd t!t#dt%j&d}tj(d|j+j-dj/y#t $rtjddYAwxYw#1swYxYw#1swYxYw)NrzwThis command, when run without an input file, requires the ml_datasets library to be installed: pip install ml_datasetsr exitsz'Loading IMDB dataset via ml_datasets...) train_limit dev_limitzLoaded IMDB dataset and using z exampleszLoading pipeline 'z'...zLoaded pipeline ''zparse_texts(nlp, texts)z Profile.profz Profile statstime) _read_inputsr list itertoolsislice ml_datasets ImportErrorfailloadingimdbzipinfor goodcProfilerunctxglobalslocalspstatsStatsdivider strip_dirs sort_stats print_stats) rrrtextsr1 imdb_train_nlpss r"rr4s` VS)Y%%eW56 ~  [[B C (',,A,NMJJ'HE1 ( 1')DE )%5 6  HH q )* OO-wy&(NS ^$AKK LLNf%113%  HH*     ( (  s)E"E>* F  E;:E;>F FrFrCc^|jtj|ddD]}y)N)disable) batch_size)pipetqdm)rFrCdocs r" parse_textsrOPs,xx %62xF   r$locr c#K|dk(r,|jdtj}d|D}nrt|}|j r|j s|j d|d|jd|jd|j}|D] }tj|}|d }|"yw) N-zReading input from sys.stdinc3>K|]}|jdyw)utf8N)encode).0lines r" z_read_inputs..Ys7V$7szNot a valid input data filer r'zUsing data from text) r7sysstdinrris_filer3partsopensrsly json_loads)rPr file_ input_pathrWdatarZs r"r-r-Us cz/0 77#Y   "**<*<*> CHH2Cq A#J$4$4R$8#9:;!%F| sC C )Nr)#r9r/r=r[pathlibrtypingrrrrr`rMtyperwasabirr languager utilr _utilrrrrrrContextstrintr#rrOr-r$r"rps7 66 119 Yt$S9:  5   {D'T3 3 3 TN 33%3@43444PT48 X hsm  eD#I&W#r$