#i4ddlmZddlZddlZddlmZddlmZmZddl m Z ddl m Z ddlmZddlmZdd lmZdd lmZmZmZmZej4eZeGd d eZy) ) annotationsN)Callable) dataclassfield)Union)parse)TrainingArguments) __version__) ParallelMode) BatchSamplersDefaultBatchSamplerMultiDatasetBatchSamplersMultiDatasetDefaultBatchSamplerc,eZdZUdZgdZedddiZded<eejdd iZ d ed <ee jdd iZ d ed<eeddiZded<eeddiZded<edddiZded<fdZfdZxZS)BaseTrainingArgumentsa BaseTrainingArguments extends :class:`~transformers.TrainingArguments` with additional arguments specific to Sentence Transformers. See :class:`~transformers.TrainingArguments` for the complete list of available arguments. Args: output_dir (`str`): The output directory where the model checkpoints will be written. prompts (`Union[Dict[str, Dict[str, str]], Dict[str, str], str]`, *optional*): The prompts to use for each column in the training, evaluation and test datasets. Four formats are accepted: 1. `str`: A single prompt to use for all columns in the datasets, regardless of whether the training/evaluation/test datasets are :class:`datasets.Dataset` or a :class:`datasets.DatasetDict`. 2. `Dict[str, str]`: A dictionary mapping column names to prompts, regardless of whether the training/evaluation/test datasets are :class:`datasets.Dataset` or a :class:`datasets.DatasetDict`. 3. `Dict[str, str]`: A dictionary mapping dataset names to prompts. This should only be used if your training/evaluation/test datasets are a :class:`datasets.DatasetDict` or a dictionary of :class:`datasets.Dataset`. 4. `Dict[str, Dict[str, str]]`: A dictionary mapping dataset names to dictionaries mapping column names to prompts. This should only be used if your training/evaluation/test datasets are a :class:`datasets.DatasetDict` or a dictionary of :class:`datasets.Dataset`. batch_sampler (Union[:class:`~sentence_transformers.sentence_transformer.training_args.BatchSamplers`, `str`, :class:`~sentence_transformers.base.sampler.DefaultBatchSampler`, Callable[[...], :class:`~sentence_transformers.base.sampler.DefaultBatchSampler`]], *optional*): The batch sampler to use. See :class:`~sentence_transformers.sentence_transformer.training_args.BatchSamplers` for valid options. Defaults to ``BatchSamplers.BATCH_SAMPLER``. multi_dataset_batch_sampler (Union[:class:`~sentence_transformers.sentence_transformer.training_args.MultiDatasetBatchSamplers`, `str`, :class:`~sentence_transformers.base.sampler.MultiDatasetDefaultBatchSampler`, Callable[[...], :class:`~sentence_transformers.base.sampler.MultiDatasetDefaultBatchSampler`]], *optional*): The multi-dataset batch sampler to use. See :class:`~sentence_transformers.sentence_transformer.training_args.MultiDatasetBatchSamplers` for valid options. Defaults to ``MultiDatasetBatchSamplers.PROPORTIONAL``. router_mapping (`Dict[str, str] | Dict[str, Dict[str, str]]`, *optional*): A mapping of dataset column names to Router routes, like "query" or "document". This is used to specify which Router submodule to use for each dataset. Two formats are accepted: 1. `Dict[str, str]`: A mapping of column names to routes. 2. `Dict[str, Dict[str, str]]`: A mapping of dataset names to a mapping of column names to routes for multi-dataset training/evaluation. learning_rate_mapping (`Dict[str, float] | None`, *optional*): A mapping of parameter name regular expressions to learning rates. This allows you to set different learning rates for different parts of the model, e.g., `{'SparseStaticEmbedding\.*': 1e-3}` for the SparseStaticEmbedding module. This is useful when you want to fine-tune specific parts of the model with different learning rates. )accelerator_config fsdp_config deepspeedgradient_checkpointing_kwargslr_scheduler_kwargslearning_rate_mappingpromptsrouter_mappingNhelpzThe prompts to use for each column in the datasets. Either 1) a single string prompt, 2) a mapping of column names to prompts, 3) a mapping of dataset names to prompts, or 4) a mapping of dataset names to a mapping of column names to prompts.)defaultmetadataz;Union[str, None, dict[str, str], dict[str, dict[str, str]]]rzThe batch sampler to use.zRUnion[BatchSamplers, str, DefaultBatchSampler, Callable[..., DefaultBatchSampler]] batch_samplerz'The multi-dataset batch sampler to use.zvUnion[MultiDatasetBatchSamplers, str, MultiDatasetDefaultBatchSampler, Callable[..., MultiDatasetDefaultBatchSampler]]multi_dataset_batch_samplerzA mapping of dataset column names to Router routes, like "query" or "document". Either 1) a mapping of column names to routes or 2) a mapping of dataset names to a mapping of column names to routes for multi-dataset training/evaluation. )default_factoryrrzA mapping of parameter name regular expressions to learning rates. This allows you to set different learning rates for different parts of the model, e.g., {'SparseStaticEmbedding\.*': 1e-3} for the SparseStaticEmbedding module.z"Union[str, None, dict[str, float]]rc@tttdk\rdSdS)N5.0.0) parse_versiontransformers_versiony/var/www/vps2.regionflexible.com/Desarrollo/venv/lib/python3.12/site-packages/sentence_transformers/base/training_args.pyzBaseTrainingArguments.us 6J(K}]dOe(eknr&zThis argument is deprecated and will be removed in the future. If you're on Transformers v5+, then you should use `warmup_steps` instead as it also works with float values.z float | None warmup_ratioctttdk\rI|j|jdk(r|j|_d|_tj dnYt |jtr?d|jcxkrdkr*nn'|jdk(r|j|_d|_t|%t |jtrt|jn |j|_ t |jtrt|jn |j|_ t |jtr% t!j"|j|_|j& |j&ni|_t |j&tr% t!j"|j&|_|j* |j*ni|_t |j*tr% t!j"|j*|_d|_d |_|j0t2j4k(r&|j6d k7rtj d yy|j0t2j8k(r9|j:s,|j6d k7rtj d d|_yyy#t j$$rYzwxYw#t j$$r t)dwxYw#t j$$r t)dwxYw) Nr!raThe `warmup_ratio` argument is deprecated in Transformers v5+, and will also be removed from Sentence Transformers once support for Transformers v4 is dropped. Since you're using Transformers v5+, please use `warmup_steps` (as a float) to specify the warmup ratio instead.r"g?zThe `learning_rate_mapping` argument must be a dictionary mapping parameter name regular expressions to learning rates. A stringified dictionary also works.zThe `router_mapping` argument must be a dictionary mapping dataset column names to Router routes, like 'query' or 'document'. A stringified dictionary also works.TFunusedzCurrently using DataParallel (DP) for multi-gpu training, while DistributedDataParallel (DDP) is recommended for faster training. See https://sbert.net/docs/sentence_transformer/training/distributed.html for more information.zWhen using DistributedDataParallel (DDP), it is recommended to set `dataloader_drop_last=True` to avoid hanging issues with an uneven last batch. Setting `dataloader_drop_last=True`.)r#r$r) warmup_stepsloggerwarning isinstancefloatsuper __post_init__rstrr rrrjsonloadsJSONDecodeErrorr ValueErrorrprediction_loss_onlyddp_broadcast_buffers parallel_moder NOT_DISTRIBUTED output_dir DISTRIBUTEDdataloader_drop_last)self __class__s r'r2z#BaseTrainingArguments.__post_init__|s - .-2H H  ,1B1Ba1G$($5$5!$(!t$++U3d>O>O8URU8UZ^ZkZkorZr$($5$5!$%! 2rZs`" $(4K<3   8 $ G"9G" G"r&