* Allow invoking simulationMain with alternative action input
* Address review comments: rename CLI opts, extract pipeline, fix correctness issues
- Rename CLI options with --train- prefix (--train-input, --train-strategy,
--train-out, --train-row-offset, --train-worker) and document all options
- Extract runInputPipeline/runInputPipelineParallel to test/pipeline/trainPipeline.ts
- Preserve original row index through parse/replay/prompt pipeline to fix
sample numbering drift when rows are filtered out
- Fix parseSuggestedEdit: use JSON.parse for escaped text, handle missing delimiter
- Fix line number regex to accept optional space after | (WithoutSpace format)
- Clamp concurrency to >= 1, type samples as ISample[], wrap dispose in try/finally
- Gate verbose logging in loadAndParseInput behind verbose flag
- Use splitLines from existing utility instead of local duplicate
* move nes-datagen to a subcommand
* more code reuse around setting promptStrategy and model config
* Address review: use ResponseFormat, Limiter, assertNever, and raw messages
* minor refactor runPipeline
* finalize
* use POT instead of custom code
* move files from script/ to test/pipeline/
---------
Co-authored-by: ulugbekna <ulugbekna@gmail.com>
Enables the same `no-unexternalized-strings` with have in `vscode` in this repo. This make sure we have a more consistent style across repos and when generating edits
* add override for responses api for openai compatible endpoints via model config
* emoving the definition of supported_endpoints member because even though it is used, it is not part of the interface. But defining it in the interface causes issues.
* Modifications to allow direct-endpoint tests to use responses api
* add a little more defensiveness to how people encode the configuration file
* remove dead code
* the responses api flag moved, so adjusting the code that sets it
* put back accidentally removed code
* fix type issue
* add ability to specify modelConfig from file
* use custom model in test endpoint provider
* fix model check
* change model config to be independant from specifying model to run
* support yaml
* use readFileSync
* remove yaml parsing
* improve comment
* fix api key
* fix comment
* make opt parsing alig to comment
Federico Brancasi
Matt Bierner
Shaun Miller
Matt Bierner
SteVen Batten
Vritant Bhardwaj
Vritant Bhardwaj
Logan Ramos
Shantnu Suman
João Moreno
kieferrm