Change logs

2024-01-22

  • [Backend] fix bad optimization pipeline launch for variable keys MR(687)

2024-01-18

  • [Backend] Raise a warning when the turnover is not a float MR(686)

  • [Backend] Use aws in preprod2 MR(685)

  • [Backend] Use aws in preprod MR(684)

  • [Backend] fix check_health dataset doesnt have started_at MR(683)

  • [Backend] remove node selector vmsize MR(682)

  • [Backend] Some fixe to improve backend stability MR(678)

  • [Backend] Small bugfix dupe cols MR(681)

  • [Backend] fix for pipeline run log messages MR(680)

  • [Backend] Convert number to float MR(679)

  • [Backend] add new cp sat parameters MR(675)

  • [Backend] Fix monitor resource used for too fast oom killed job MR(677)

  • [Backend] Export turnover MR(676)

  • [Backend] Pipeline Run was not set to failed if step failed by Global Except MR(674)

  • [Backend] Fix stop job when stopping pipeline run MR(673)

  • [Backend] Update default cluster to go to aws MR(672)

  • [Backend] add aws cluster MR(665)

  • [Backend] fix check_health MR(671)

  • [Backend] Adoria cast date MR(669)

  • [Backend] AD export has no params MR(668)

  • [Backend] Exports do not have a name parameter MR(667)

  • [Backend] Add AD exporter MR(659)

  • [Backend] fix dataset stuck because of oom MR(666)

  • [Backend] fix step error when relaunching k8s job MR(664)

  • [Backend] Handle empty tab_name properly MR(663)

  • [Backend] Manage OOMKilled JOB MR(662)

  • [Backend] Add dataset to ram monitoring MR(658)

  • [Backend] Get rid of experiment MR(652)

  • [Backend] add exception handling to not bloc backend if exception is raised MR(655)

  • [Backend] Fix check job : pipeline_run not in Dataset MR(654)

  • [Backend] Fix job name MR(653)

  • [Backend] Refacto Check / Launch Job MR(650)

  • [Engine] upgrade or tools to 9.8 MR(1564)

  • [Engine] Upgrade to ORTools 9.8 MR(1563)

  • [Engine] tiny bugfix argparse MR(1562)

  • [Engine] throw error when finding decimal in cp-sat-solved system, add new params MR(1559)

  • [Engine] cp sat tweaks to work with int variables MR(1560)

  • [Engine] Convert float into integer when required MR(1558)

  • [Engine] Load variable col if present MR(1557)

  • [Engine] Mock name function MR(1555)

  • [Engine] fix to properly download files in optimisation constraints MR(1556)

  • [Engine] Allow to choose right backend depending on type MR(1554)

  • [Engine] Add multiplicative constraint MR(1553)

  • [Engine] Enable shapley for tree algorithms MR(1546)

  • [Engine] Multiplicative add constraint MR(1551)

  • [Engine] First test for aggregate_val_by_key MR(1536)

  • [Engine] Add support for boolean MR(1550)

  • [Engine] more info on solver output dtf, and also export into csv if requested MR(1545)

  • [Engine] Add CP-SAT solver MR(1548)

  • [Engine] Replace experiment by pipeline MR(1549)

  • [Front] feat: allow dataset download with dataset row action menu MR(1163)

  • [Front] fix: app run history on refresh keep his state MR(1164)

  • [Front] refacto: profile views MR(1158)

  • [Front] fix: pipeline step log is accessible only by verteego admin MR(1161)

  • [Front] Feat/project deletion MR(1160)

  • [Front] fix: No data overview message, wordings MR(1159)

  • [Front] fix: store project after loading MR(1157)

  • [Front] Refacto/projects view MR(1156)

  • [Front] Fix/created by on datasource creation MR(1151)

  • [Front] fix: dataset action menu separator, optimization unfeasibility empty message, no app run interface MR(1155)

  • [Front] Refacto/projects first step MR(1153)

  • [Front] Refacto/api and axios methods MR(1154)

  • [Front] fix: shapley and features values are available only on prediction dataset MR(1152)

  • [Front] feat: add tab name on gdrive dataset creation MR(1150)

  • [Front] Feat/notifications view MR(1148)

  • [Front] fix: configuration display MR(1147)

  • [Front] fix: badge fail step calculation MR(1146)

  • [Front] fix: rename test dataset to predict dataset MR(1144)

  • [Front] fix: allow business expert to consult resources MR(1143)

  • [Api] Revert “Merge branch ‘revert-7086acf7’ into ‘master’” MR(933)

  • [Api] Revert “Merge branch ‘allow-mixed-variable-types-in-opt’ into ‘master’” MR(932)

  • [Api] allow mixed variable types in optimizations, and new cp sat params MR(931)

  • [Api] feat: project suppression only available to verteego admin MR(929)

  • [Api] fix so that step configuration files contain file names rather than IDs MR(928)

  • [Api] Keep format MR(926)

  • [Api] Update vtg config MR(925)

  • [Api] Allow AD for export MR(922)

  • [Api] feat: add specific get event route MR(924)

  • [Api] feat: add tab_name on gdrive dataset creation payload MR(923)

  • [Api] update README and local scripts for tests MR(916)

  • [Api] Support boolean in optimization MR(921)

  • [Api] Fix: remove check on object self name on PATCH api call MR(918)

  • [Api] Test now that the env var has been declared MR(917)

2023-12-04

  • [Backend] fix scheduler errors MR(651)

  • [Backend] fix optimization monitoring MR(649)

  • [Backend] Improve job and pod management MR(647)

  • [Backend] python module ‘kubernetes.client’ has no attribute ‘BatchV1beta1Api’ MR(645)

  • [Backend] change memory request dev MR(644)

  • [Backend] add alembic script to create FTP Datatype MR(640)

  • [Backend] Launch rosetta job with right parameters MR(642)

  • [Backend] FTP path was not forwarded MR(643)

  • [Backend] Set parameters for AD dataset job MR(620)

  • [Backend] Fix error handling bad dataset in config MR(639)

  • [Backend] fix iteration with generator MR(627)

  • [Backend] add ftp connector MR(630)

  • [Backend] fix smtp relay MR(636)

  • [Api] Name export to bq using gsheet file_id MR(915)

  • [Api] Reload previous dataset into GSheet MR(914)

  • [Api] Add route to sync GDrive datasets to BQ internal storeage MR(913)

  • [Api] fix bad dataset error handling for opts, add tests MR(910)

  • [Api] filename -> path MR(912)

  • [Api] Support FTP datasource MR(911)

  • [Api] cherry pick good commits to change AD IMPORTER MR(906)

  • [Api] Feat/results for dataset MR(901)

  • [Engine] save optimization input files under X/Y/predictions/input MR(1544)

  • [Engine] Handle duplicated cols due to shapley MR(1537)

  • [Engine] removing csv from logic in counting nb rows in preprocessing/postprocessing MR(1542)

  • [Engine] Preprod MR(1541)

  • [Engine] Fully load data to ensure right type inference for big dataset. MR(1539)

  • [Front] fix: dataset overview in dataset view MR(1141)

  • [Front] fix: modal z-index higher than menu and loader MR(1140)

  • [Front] Feat/googlesheet integration MR(1133)

  • [Front] Fix/bugherd ticket 1 MR(1135)

  • [Front] feat: export with features and shapley value MR(1134)

2023-11-15

  • [Engine] Preprod MR(1541)

  • [Engine] Fix solo score on dataset failing MR(1540)

  • [Engine] Replace nullable int with int, or float if there are null values. MR(1535)

  • [Engine] Back port modif from prod MR(1534)

  • [Engine] refactored various csv/parquet loading into one method MR(1529)

  • [Engine] Get from dataset error message when a required column is missing MR(1533)

  • [Engine] fix build requirement for prod and preprod MR(1532)

  • [Engine] Fix pca MR(1528)

  • [Engine] adding new bank holidays countdown calculator MR(1527)

  • [Engine] add more validation of join_options in get_from_dataset MR(1520)

  • [Engine] remove postprocessing from arguments of optimization launch MR(1523)

  • [Engine] Revert “Merge branch ‘hotfix-casting-of-pyarrow-string-not-working’ into ‘master’” MR(1516)

  • [Engine] memory optimization for complex get_from_dataset MR(1514)

  • [Engine] Fix aggregation nonsense check MR(1511)

  • [Engine] Hotfix casting of pyarrow string not working MR(1513)

  • [Engine] add-ensure_type_retro_compatibility-in-scorer MR(1509)

  • [Front] Fix/app modal and history panel MR(1128)

  • [Front] Refacto/layout structure and style MR(1124)

  • [Front] Fix/parquet upload sanitize blob MR(1126)

  • [Front] fix: extension “parquet” is sent with payload MR(1125)

  • [Front] fix: UI component alignement isn’t broke anymore MR(1123)

  • [Front] chore: update cumulio vue component package to luzmo vue component package MR(1121)

  • [Front] fix: dropdown not working over other links MR(1112)

  • [Front] Merge branch ‘prod’ into ‘preprod’ MR(1119)

  • [Front] Revert “Merge branch ‘fix/preprod-missing-export-button-due-rename’ into ‘preprod’” MR(1113)

  • [Front] Preprod MR(1109)

  • [Front] feat: Allow parquet file type for datasets upload MR(1101)

  • [Front] Preprod MR(1107)

  • [Front] chore: add script for local api MR(1104)

  • [Front] Fix/view hot reload MR(1100)

  • [Api] cherry pick good commits to change AD IMPORTER MR(906)

  • [Api] UnboundLocalError: cannot access local variable ‘unverified_header’ where it… MR(907)

  • [Api] endpoint and method not cover by fga MR(908)

  • [Api] Feat/results for dataset MR(901)

  • [Api] allow upload of parquet dataset MR(903)

  • [Api] Finalize post dataset refacto MR(896)

  • [Api] Fix api test jsonschema requirement MR(897)

  • [Api] Preprod MR(894)

  • [Backend] Use duration instead of date_from MR(637)

  • [Backend] Handle timestamp and convert them to datetime. MR(634)

  • [Backend] Parquet is used everywhere now MR(633)

  • [Backend] Add project_id to dataset alembic migration MR(632)

  • [Backend] Fix report pyarrow types MR(629)

  • [Backend] fix dataset report so that not all columns are type “string” MR(628)

  • [Backend] fix: rename app run parameter MR(623)

  • [Backend] Factorize code (and fix bug) MR(622)

  • [Backend] Fix configuration versionning when launching optimization MR(617)

  • [Backend] Support parquet file as well MR(619)

  • [Backend] Support parquet files as well when exporting MR(618)

  • [Backend] remove postprocessing from arguments of optimization launch MR(621)

  • [Backend] Support export of csv files MR(616)

2023-10-18

  • [Engine] Fix wrong type infering of default get from dataset rebased MR(1524)

  • [Engine] Remove right on in get_from_dataset calculator MR(1508)

  • [Engine] Fix optim output as parquet MR(1507)

  • [Engine] Store optimization output as a parquet file MR(1504)

  • [Engine] Export postprocessor output as parquet MR(1505)

  • [Engine] Adapt evaluated column at postprocessing MR(1482)

  • [Engine] Store prediction files as parquet MR(1503)

  • [Engine] Clean error for cv coherency MR(1490)

  • [Api] add a new test: test_post_upload_dataset MR(893)

  • [Api] Preprod MR(894)

  • [Api] Fix/support old dataset path config MR(892)

  • [Api] refactoring for post method from PipelineDatasRoute MR(857)

  • [Api] More test for dataset creation MR(888)

  • [Api] Reset password MR(887)

  • [Api] Fix/app run patch MR(886)

  • [Api] fix: config filename not properly replaced MR(880)

  • [Api] Feat: dashboard auth MR(852)

  • [Api] Fix optimization step launch and optimization pipeline launch MR(882)

  • [Api] remove dataset step parameter MR(878)

  • [Api] Fix optimizations by pipeline run MR(877)

  • [Api] remove clone pipeline MR(876)

  • [Api] now validate that the notification content is within a predefined list MR(875)

  • [Api] remove all recipe MR(874)

  • [Api] create bigquery external table if not exist split function MR(873)

  • [Backend] fix standalone optimization launch MR(612)

  • [Backend] fix notification dev MR(611)

  • [Backend] export-postprocess-file-step-as-parquet MR(608)

  • [Backend] now download CSV /zip input files as parquet in internal storage MR(607)

  • [Backend] export step file as parquet MR(605)

  • [Backend] add scheduler script to adoria connector MR(598)

  • [Backend] allow empty pipeline_id for notification_check MR(602)

  • [Backend] remove dataset step parameter MR(601)

  • [Backend] remove clone pipeline MR(600)

  • [Backend] Fix notification at the step level, and adapt to latest renames MR(599)

  • [Backend] remove old recipe MR(597)

  • [Front] fix: no records displaying while loading app run resources MR(1110)

  • [Front] Preprod MR(1109)

  • [Front] Fix/post gs datasource MR(1108)

  • [Front] Preprod MR(1107)

  • [Front] Fix/finalizing status MR(1106)

  • [Front] Fix/refetch app run after create MR(1105)

  • [Front] fix: missing export button due to rename MR(1102)

  • [Front] fix: allow old apps to see export panel MR(1103)

  • [Front] Feat/password renewal MR(1098)

  • [Front] Fix/fine tuning right menu MR(1099)

  • [Front] refacto: use ActionType as enum MR(1097)

  • [Front] fix titles for right-panel MR(1092)

  • [Front] Fix/fine tune right menu MR(1096)

  • [Front] fix payload with prediction id MR(1094)

  • [Front] chore: add .nvmrc file MR(1095)

  • [Front] Merge/prod into master MR(1091)

  • [Front] chore: add vtg-prefix for true value column MR(1078)

  • [Front] Fix: add placeholder message instead of infinite spinner when there is no app run yet MR(1089)

  • [Front] Feat: app runs history from app run page MR(1048)

2023-09-27

  • [Front] feat: filter datasources without default from api MR(1085)

  • [Front] fetch authorized dashboards MR(1067)

  • [Front] fix: dataset upload not showing parameters MR(1083)

  • [Front] fix: upload without data MR(1084)

  • [Front] feat: add hidden exports page MR(1080)

  • [Front] Feat: rename default datasource to ‘Upload file’ MR(1081)

  • [Front] feat: display mode in dataset parameters, factorize function that allow to… MR(1079)

  • [Front] fix responsive issue for small screens on the header MR(1082)

  • [Front] fix: filter steps on pipeline run id MR(1077)

  • [Front] Feat/add psql mysql options MR(1076)

  • [Front] feat: add to snowflake datasource stage & export bucket options MR(1075)

  • [Front] fix: hpt values disappearing MR(1072)

  • [Front] Feat: snowflake connector MR(1073)

  • [Front] Feat: download features or shapley values options MR(1069)

  • [Front] Merge Preprod into Master MR(1071)

  • [Front] Merge prod into preprod MR(1070)

  • [Front] fix: duration calculation using more adequate property MR(1065)

  • [Front] fix: steps content for notifications MR(1064)

  • [Front] merge preprod into master MR(1063)

  • [Front] merge prod into preprod MR(1062)

  • [Front] Small Uloc project id cleanup MR(1059)

  • [Front] fix: rename file param MR(1058)

  • [Front] Merge preprod into master MR(1057)

  • [Api] Add test on db to api MR(856)

  • [Api] Update Auth0 sdk to v4 MR(722)

  • [Api] feat: filter datasources without default MR(871)

  • [Api] chore: change config sha for get-from-dataset dataset suggestion MR(868)

  • [Api] Chore/allow parallelizer for fga apps check MR(870)

  • [Api] add Adoria case in PipelineDataset route MR(859)

  • [Api] Stop versioning dataset path and extension MR(867)

  • [Api] feat: add pagination to exports, fix name of export_type MR(869)

  • [Api] change pipeline_id into pipeline_run_id for steps routes MR(864)

  • [Api] fix: rename experiment on columns_schema route MR(866)

  • [Api] fix: get boolean for use_ssh_tunnel variable MR(865)

  • [Api] feat: get args as boolean MR(863)

  • [Api] Feat/get last app run if id not set MR(846)

  • [Api] Feat/get app run page MR(851)

  • [Api] Upgrade vbrain config for recipes MR(862)

  • [Api] feat: add optional app_run for pipeline step export MR(848)

  • [Api] Migrate to python 3 11 MR(860)

  • [Api] Revert “Merge branch ‘migrate-to-python-above-3-10’ into ‘master’” MR(858)

  • [Api] Migrate to python above 3 10 MR(854)

  • [Api] Fix error when posting solo score or training MR(855)

  • [Api] create bigtable from gcs MR(850)

  • [Api] revert removing of /result MR(849)

  • [Api] change export as dataset from bq to gcs MR(844)

  • [Api] chore: add type hint for exportable models MR(845)

  • [Api] add AdoriaAPI in create_db MR(847)

  • [Api] remove /results routes MR(837)

  • [Api] merge preprod into master MR(840)

  • [Api] Merge prod into preprod MR(839)

  • [Api] Fix launching of solo task 2 MR(836)

  • [Api] update webhook, synapp -> project MR(833)

  • [Api] feat: add pagination to notifications MR(831)

  • [Api] fix: rename file param MR(818)

  • [Api] fix rename for pipeline MR(832)

  • [Engine] Load parquet file. If not possible, try csv. MR(1501)

  • [Engine] This is not an error, but an info. Test set are not required. MR(1500)

  • [Engine] Stop using csv files in preprocessing MR(1499)

  • [Engine] Stop using csv files in preprocessing MR(1498)

  • [Engine] Change date type MR(1497)

  • [Engine] Factor code for type retro compatibility MR(1495)

  • [Engine] Allow np type for int and float MR(1496)

  • [Engine] Complex filtering doesn’t work with pyarrow (not yet implemented) MR(1494)

  • [Engine] Handle date MR(1493)

  • [Engine] Check consistency between default values and dtf type MR(1492)

  • [Engine] Parquet for scoring MR(1489)

  • [Engine] Support parquet when predicting MR(1488)

  • [Engine] Retrieve parquet file if any MR(1487)

  • [Engine] Fix wrong types when reading parquet file in calculator MR(1486)

  • [Engine] add round operation to unary_operation MR(1485)

  • [Engine] Stop versioning dataset path and extension MR(1483)

  • [Engine] remove upload to bq MR(1484)

  • [Engine] Fix Monoprix prediction file that is an invalid CSV MR(1474)

  • [Engine] update debug scripts to work with new api and with config stored in db MR(1481)

  • [Engine] Upgrade vbrain config for recipes MR(1480)

  • [Engine] Allow zero duration MR(1479)

  • [Engine] Allow to use calculated columns in scores MR(1478)

  • [Engine] Speed up solver MR(1468)

  • [Backend] pull pubsub notification MR(594)

  • [Backend] use pyarrow as engine when loading csv MR(595)

  • [Backend] fix printout of END pipeline_run MR(593)

  • [Backend] Fix config renaming dataset to id for get from dataset MR(590)

  • [Backend] send notification to pubsub MR(589)

  • [Backend] Add CF to handle notifications MR(588)

  • [Backend] fix a ttl for k8s jobs MR(585)

  • [Backend] add the AD connector in Rosetta MR(571)

  • [Backend] migrate psql importer csv to parquet MR(581)

  • [Backend] Migrate mysql importer csv to parquet MR(580)

  • [Backend] fix: recipe google drive export by exporting to dataset_name by default MR(582)

  • [Backend] fix bucket name should depend on environment when exporting dataset from pipeline in recipes MR(578)

  • [Backend] Allow shapley and preprocessed for predictions dataset in recipe MR(576)

  • [Backend] Stop calling train with file names but rather with ids MR(577)

  • [Backend] script alembic to create Adoria datasource MR(575)

  • [Backend] Hotfix metrics export MR(574)

  • [Backend] Fix score export not exporting metrics MR(572)

  • [Backend] Store GD files as parquet MR(568)

  • [Backend] import parquet file from BQ dataset MR(565)

  • [Backend] Remove bq export MR(566)

  • [Backend] fix: rename file param MR(558)

2023-08-02

  • [Api] Fix missing renaming of dataset id in configurations of prediction and postprocessing MR(834)

  • [Api] fix create project role MR(830)

  • [Api] feat: add controller for app run scores MR(828)

  • [Api] Add warnings to tasks in model MR(827)

  • [Api] Fix api app post MR(826)

  • [Api] feat: add metrics from gcs files to Scores MR(825)

  • [Api] Update models according to backend MR(824)

  • [Api] Upgrade vbrain config MR(823)

  • [Api] fix: app resources returning systematic error MR(821)

  • [Api] fix deploy doc MR(822)

  • [Api] fix: rename last mr concepts MR(817)

  • [Api] rename db MR(802)

  • [Api] feat: make separate controller to get pipeline run resources MR(809)

  • [Api] chore: change config version MR(816)

  • [Api] fix business_expert_launch_app_run MR(810)

  • [Api] Merge preprod into master MR(808)

  • [Api] Merge preprod into master MR(806)

  • [Api] Final fix launch score MR(804)

  • [Api] Use right name MR(801)

  • [Api] Fix api scores on launch MR(799)

  • [Api] Feat: new route returning dataset’s columns (scores without reference dataset) MR(791)

  • [Api] enable solo score on pred or postproc MR(790)

  • [Api] fix: allow keeping the same name during project PATCH MR(797)

  • [Api] fix users/current MR(796)

  • [Api] fix backup user - add fga backoffice object MR(792)

  • [Api] Fix/merge preprod MR(795)

  • [Api] rename experiment to pipeline MR(789)

  • [Api] feat: new route returning a column names schema MR(787)

  • [Api] add deprecated status for PredictionDatasetRoute MR(759)

  • [Api] include-calculated-columns & include-shapley parameters MR(757)

  • [Api] Adapt score download MR(771)

  • [Api] feat: add pagination to notifications MR(771)

  • [Engine] Fix/build requirement image MR(1471)

  • [Engine] Fix remove duplicates from predictions files MR(1470)

  • [Engine] Upgrade vbrain config MR(1466)

  • [Engine] Deal with empty staging file MR(1458)

  • [Engine] added weights and aggregation to order column MR(1463)

  • [Engine] Fix requirement CI MR(1464)

  • [Engine] Chore change config version MR(1462)

  • [Engine] Now store unique values per categorical feature in model, not csv files MR(1455)

  • [Engine] * Pre filter using comon where clauses MR(1456)

  • [Engine] fix add row number MR(1453)

  • [Engine] Fix bug not finding files MR(1452)

  • [Engine] Fix stage MR(1454)

  • [Engine] Arrow for optim MR(1414)

  • [Engine] Improve code MR(1451)

  • [Engine] add a small test case for mathematical expression MR(1450)

  • [Engine] Uniformize score launching MR(1446)

  • [Engine] Add file exporter to docker image MR(1448)

  • [Engine] increase test duration countdown MR(1447)

  • [Engine] Python 3 11 MR(1445)

  • [Engine] Feat/create file exporter MR(1444)

  • [Engine] migration script copying old predictions files with new names MR(1439)

  • [Engine] Adapt score results upload MR(1435)

  • [Engine] Add support for where clauses MR(1443)

  • [Backend] Fix score from app run not launching MR(564)

  • [Backend] Missing prediction type for resource to evaluate in recipe scores MR(563)

  • [Backend] Fix renaming in steps types MR(562)

  • [Backend] script alembic to create the warnings column MR(557)

  • [Backend] Enable new task step in recipe MR(551)

  • [Backend] script alembic to create the warnings column MR(561)

  • [Backend] Use new name MR(560)

  • [Backend] Wrong rename MR(559)

  • [Backend] Fix /check_recipe_runs MR(556)

  • [Backend] Fix keyerror on type MR(554)

  • [Backend] rename db MR(550)

  • [Backend] Fix mising extension MR(549)

  • [Backend] Fix launch scores MR(548)

  • [Backend] Fix BQ export MR(547)

  • [Backend] Skip first line and use it as header MR(545)

  • [Backend] use right file name MR(544)

  • [Backend] Stop writing metrics in score object MR(543)

  • [Backend] Export preprocessed predictions MR(520)

  • [Front] feat: add optimization datasets to pipeline run graph MR(1060)

  • [Front] Merge preprod into master MR(1057)

  • [Front] revert: file rename MR(1055)

  • [Front] feat: sort datasources by name for new dataset MR(1053)

  • [Front] fix: adjust task color when there are warnings MR(1054)

  • [Front] Feat/score to app resources MR(1052)

  • [Front] fix: scores with metrics MR(1050)

  • [Front] feat: feedback-on-pipeline-run-graph MR(1051)

  • [Front] fix: update tests data MR(1049)

  • [Front] fix: rename secondary menu MR(1047)

  • [Front] Revert “fix: patch file param as Uppercase” MR(1045)

  • [Front] fix: link to app pipeline resource MR(1046)

  • [Front] refacto: rename objects according to DB changes MR(1043)

  • [Front] Feat: improve pipeline run screen MR(1041)

  • [Front] Preprod MR(1042)

  • [Front] Merge branch ‘fix/old-apps-params’ into ‘preprod’ MR(1039)

  • [Front] Merge preprod into master MR(1037)

  • [Front] feat: use a directive for dev features MR(1034)

  • [Front] fix: allow using score api on postprocessing or prediction MR(1033)

  • [Front] remove old dataset parameter MR(1032)

  • [Front] Feat:scores without reference dataset if [column_to_predict]_true provided in evaluated dataset MR(1026)

  • [Front] Feat/edit train image MR(1031)

  • [Front] feat: show train image MR(1030)

  • [Front] feat: add dataset to optimization screen MR(1029)

  • [Front] Merge Preprod into master MR(1028)

  • [Front] feat: allow enabling suggestion for column names MR(1025)

2023-07-17

  • [Backend] Integrate timestamp in pipeline_run steps name MR(538)

  • [Backend] Preprod MR(536)

  • [Backend] Forward project / pipeline / dataset id MR(530)

  • [Backend] stop verbose printout in vbrain-tests MR(533)

  • [Backend] Oups. I forgot to use the parameter returned by the function. MR(532)

  • [Backend] Revert __repr__ MR(525)

  • [Backend] Fix stuck backend when no pipeline for a step MR(527)

  • [Backend] Remove old score and fix new ones MR(524)

  • [Backend] now return step name, rather than number, to identify error MR(523)

  • [Backend] Fix bq export MR(522)

  • [Api] fix create project MR(812)

  • [Api] Fix create project MR(811)

  • [Api] Fix/datasets paginated queries MR(807)

  • [Api] Preprod MR(805)

  • [Api] Fix: performance pipeline runs MR(803)

  • [Api] Fix/merge preprod MR(795)

  • [Api] Preprod MR(794)

  • [Api] fix: config reorder MR(793)

  • [Api] fix: make use of new validator and fix merge MR(788)

  • [Api] Feat: autocompletion for pipelines, datasets MR(758)

  • [Api] Feat: add and use schema store MR(748)

  • [Api] fix: rename variables to app_runs MR(782)

  • [Api] fix: add two missing parameters to run api locally MR(769)

  • [Api] fix: missing pipeline runs rename MR(775)

  • [Api] allow edit of user right MR(772)

  • [Api] Support both args MR(779)

  • [Api] Merge branch… MR(774)

  • [Api] fix deployment MR(770)

  • [Api] fix nighlies MR(764)

  • [Api] fix nightlies again MR(768)

  • [Api] chore: simplify setup MR(761)

  • [Api] Stop creating old score step in pipelines MR(760)

  • [Api] correct-method-create_versioned_pipeline_run_configuration-after-renaming (2) MR(765)

  • [Api] correct create_versioned_pipeline_configuration function after renamming MR(763)

  • [Api] Generating api key when creating user MR(762)

  • [Api] dupplicate api with new route MR(756)

  • [Front] Preprod MR(1042)

  • [Front] fix: loading for failed app run MR(1040)

  • [Front] Fix/old apps params MR(1038)

  • [Front] Preprod MR(1036)

  • [Front] fix: performance issues on pipeline runs screen MR(1035)

  • [Front] Merge Preprod into master MR(1028)

  • [Front] fix: rename config experiments MR(1027)

  • [Front] fix: smaller config warnings MR(1024)

  • [Front] use dynamic schemas MR(1007)

  • [Front] Feat: add and use schema store MR(1005)

  • [Front] fix delete project user routes MR(1021)

  • [Front] merge preprod into master MR(1019)

  • [Front] Preprod MR(1014)

  • [Front] rename app run schedule MR(1012)

  • [Front] Rename api routes MR(1011)

  • [Front] feat: add notifications page MR(1061)

  • [Engine] Feat: add and use schema store MR(1437)

  • [Engine] now do categorical native encoding in one place MR(1441)

  • [Engine] Remove prediction api MR(1436)

  • [Engine] Remove historic score step doing a prediction too MR(1433)

  • [Engine] make weekly fill series follow ISO weeks MR(1432)

2023-06-20

  • [Backend] Set optimization config MR(537)

  • [Backend] Preprod MR(536)

  • [Backend] Return local file MR(531)

  • [Backend] Version config for pipeline recipe MR(529)

  • [Backend] From preprod fix stuck backend when no pipeline for a step MR(528)

  • [Backend] We need a config MR(526)

  • [Backend] fix import bq view MR(521)

  • [Backend] Convert to string MR(519)

  • [Backend] Get configuration from pipeline MR(518)

  • [Backend] Get config from DB MR(517)

  • [Backend] handle header correctly MR(515)

  • [Backend] Fix optimization pipeline and add test MR(516)

  • [Backend] add method read_configuration_from_db MR(513)

  • [Backend] Drive params MR(514)

  • [Backend] ‘’ does not seem to be the same as False for exit code. MR(512)

  • [Backend] Improve importer code to match exporter code MR(509)

  • [Backend] Propagate synapp -> project_id renaming MR(511)

  • [Backend] fix rosetta rename synapp project MR(510)

  • [Backend] rename synapp and component to project MR(508)

  • [Backend] Fix alembic migration + dry-run MR(505)

  • [Backend] Connector drive folder MR(499)

  • [Backend] Better error handling MR(498)

  • [Backend] Add filter on experiment MR(507)

  • [Backend] Copy / paste error MR(506)

  • [Backend] Fix import no refresh MR(504)

  • [Backend] Feat/creation pipeline configurations table MR(495)

  • [Backend] chore: readme backend MR(503)

  • [Backend] Add timestamp to pipeline_run_name MR(501)

  • [Api] Replace dataset by uuid MR(785)

  • [Api] From preprod/fix post of solo step MR(784)

  • [Api] Fix: getting configuration for results MR(777)

  • [Api] Fix auth0 role MR(780)

  • [Api] fix: change join method for lone steps MR(781)

  • [Api] fix/retrieve-the-pipeline-configuration MR(776)

  • [Api] Merge branch… MR(774)

  • [Api] Merge branch… MR(773)

  • [Api] Fix: lone steps being filtered out MR(767)

  • [Api] Merge fix/integrate-configuration-id-fix branch MR(766)

  • [Api] Keep order MR(755)

  • [Api] add yaml.dump sort_keys=False MR(753)

  • [Api] Get config from DB, not backend MR(752)

  • [Api] modif get method in DB MR(751)

  • [Api] Forward GDrive mode to backend MR(749)

  • [Api] Update version for vtg_config MR(746)

  • [Api] fix route not protected by fga MR(744)

  • [Api] fix: endpoint_relation typos MR(743)

  • [Api] feat: show active and total steps MR(742)

  • [Api] fix users list MR(733)

  • [Api] avoid order problem in check key MR(736)

  • [Api] fix: prevent starring from substeps of unfinished pipeline runs MR(738)

  • [Api] API : Feat/query to insert or update configuration string in db MR(716)

  • [Front] Fix: postprocessing post failing MR(1023)

  • [Front] Fix: get step config MR(1022)

  • [Front] merge preprod into master MR(1019)

  • [Front] merge prod into preprod MR(1018)

  • [Front] Fix: lone steps being filtered out MR(1016)

  • [Front] Feat: add advanced dashboards MR(1015)

  • [Front] Preprod MR(1014)

  • [Front] fix: creating scores MR(1008)

  • [Front] fix: last run date for apps configured with recipe MR(1010)

  • [Front] fix: smaller titles and add missing inline code syntax help MR(1006)

  • [Front] feat: add markdown example MR(1003)

  • [Front] change back to synapp_manager MR(1004)

  • [Front] feat: allow markdown preview MR(1001)

  • [Front] Revert “Merge branch ‘fix/disable-upcoming-options-until-ready’ into ‘preprod’” MR(1002)

  • [Front] remove bucket fetching MR(1000)

  • [Front] Fix/bugherd small improvements MR(999)

  • [Front] fix: run parameters refresh for optimization app MR(997)

  • [Front] feat: get db configuration when available MR(998)

  • [Front] fix: change starred scores from same pipeline run without refreshing MR(996)

  • [Front] feat: add active-total step for running badge MR(994)

  • [Front] Test/tables with content MR(985)

  • [Front] feat: colors for user roles MR(993)

  • [Engine] Updrade pylint MR(1431)

  • [Engine] Stop reordering while dumping yaml configuration to file MR(1430)

  • [Engine] Decode config transmitted from backend MR(1428)

  • [Engine] Embed word similarity into docker image MR(1426)

  • [Engine] Rename synapps and brain_component to project MR(1424)

2023-05-10

  • [Front] fix: exports from app runs table MR(988)

  • [Front] fix optimizations screen with optimization dataset as direct relationship MR(989)

  • [Front] fix: fetching complete configuration that doesn’t exist since step has failed MR(991)

  • [Front] fix: disable starring substeps of unfinished pipeline runs MR(990)

  • [Front] fix: disable upcoming options until ready MR(987)

  • [Front] fix: optimization dataset id passed as dict MR(986)

  • [Front] fix: starred as true boolean MR(984)

  • [Front] chore: add test for calculated features MR(981)

  • [Front] fix: hide app run resources tab for business users MR(980)

  • [Front] Merge branch ‘fix/replace-zip-metadata’ into ‘master’ MR(982)

  • [Front] fix: replace zip metadata MR(979)

  • [Front] Chore/refacto imports MR(975)

  • [Front] Merge branch ‘fix/windows-zip-import’ into ‘master’ MR(977)

  • [Front] fix: windows zip import MR(976)

  • [Front] Fix/other permissions MR(974)

  • [Front] Fix/persist displayed columns MR(973)

  • [Front] fix: multiselect attrs masked by unused prop MR(972)

  • [Front] feat: pipeline star MR(966)

  • [Front] chore: adjust cypress env variables MR(968)

  • [Front] chore: rename synapps routes to projects MR(967)

  • [Front] fix: add export_to_datasource permission to restrict export dropdown options MR(969)

  • [Front] fix: larger app modal MR(970)

  • [Front] fix: show again stop button for pipeline runs MR(971)

  • [Front] Feat/highlight recipe config error MR(964)

  • [Front] chore: group variables of each environment in separate files MR(961)

  • [Front] feat: display optimization configuration instead of constraints MR(965)

  • [Front] feat: pipeline run description update MR(963)

  • [Front] feat: add gd options to dataset creation MR(962)

  • [Front] feat: add permission directive with one example MR(952)

  • [Front] fix: show again app run errors MR(960)

  • [Front] fix: trainings graph label length MR(959)

  • [Front] merge Master fixes into preprod MR(958)

  • [Front] fix: refresh table data when resolution changes MR(957)

  • [Front] fix : restore graph tooltip for hyperparameters tuning MR(956)

  • [Front] fix: date format payload MR(955)

  • [Front] Merge branch ‘fix/fetch-of-recipe-when-not-configured’ into ‘master’ MR(954)

  • [Front] fix: prediction dataset id MR(953)

  • [Front] fix: model option disappearing MR(950)

  • [Front] Fix/score multi res MR(946)

  • [Front] fix: datasources not showing in export panel MR(948)

  • [Front] fix: prediction creation MR(947)

  • [Front] fix: forecast runs with missing .value causing improper payload MR(949)

  • [Front] fix: cypress test MR(945)

  • [Front] feat: add resourecs tabs for app runs results (recipe) + fix dropdown font size MR(943)

  • [Front] fix: fetch of recipe when not configured MR(942)

  • [Front] fix: auto deploy dev MR(941)

  • [Front] feat: delete pipeline run with all resources option MR(940)

  • [Front] Feat/paginated results MR(938)

  • [Api] Fix: exports from app table configurated with pipeline MR(731)

  • [Api] Fix: star from substeps of unfinished pipeline runs MR(739)

  • [Api] fix unable to launch run with recipe MR(737)

  • [Api] fix project id not defined MR(735)

  • [Api] fix all user have access to everything MR(734)

  • [Api] Fix/starred list order MR(732)

  • [Api] change_project_users_list_for_business_expert MR(730)

  • [Api] feat: add support for starred in pipeline substeps MR(726)

  • [Api] fix invite synapp_manager MR(729)

  • [Api] replace all check on method param with is_valid_uuid by a decorator on each method MR(725)

  • [Api] rename projects_id to project MR(724)

  • [Api] chore: change vbrain-config sha MR(723)

  • [Api] Enable pagination MR(721)

  • [Api] Add a JSON schema route to the API module MR(718)

  • [Api] Star pipeline MR(720)

  • [Api] Add projects routes MR(715)

  • [Api] Should be created to start with. MR(719)

  • [Api] Change status so that we can handle update in backend. MR(704)

  • [Api] ressources filtrées sur le run ID MR(713)

  • [Api] Add route to list authorized access depending on profil MR(702)

  • [Api] fix: auto deploy dev MR(712)

  • [Api] fix: yaml load of recipes MR(710)

  • [Api] fix: allow results without aggregation MR(699)

  • [Api] Attach dataset to optimization MR(709)

  • [Api] More space for schedule MR(705)

  • [Backend] Export parquet to bq MR(500)

  • [Backend] fix: missing run_id in pipeline MR(502)

  • [Backend] feat: change starred as non-nullable MR(496)

  • [Backend] Ensure that we export a dataset that has been refresh during this run, whatever its name. MR(497)

  • [Backend] Handled patched schedules MR(488)

  • [Backend] Look for parquet file MR(493)

  • [Backend] Add empty configuration string when calling engine script MR(494)

  • [Backend] Star pipeline MR(491)

  • [Backend] Move fields to right place MR(492)

  • [Backend] add new migration script for the pipeline_configurations table creation MR(489)

  • [Backend] Bahlors ! MR(490)

  • [Backend] Introduce exporters and apply to BQ MR(487)

  • [Backend] Check number of responses MR(486)

  • [Backend] Add alembic MR(484)

  • [Backend] fix BigQuery Dataset loading MR(485)

  • [Backend] Log time and memory use in connector MR(483)

  • [Backend] Delete cronjob from k8s and DB MR(481)

  • [Backend] Add field into DB. MR(478)

  • [Engine] make-engine-ready-to-support-config-in-db MR(1422)

  • [Engine] chore: change vbrain-config sha MR(1423)

  • [Engine] Keep on improving preprocessing readability MR(1421)

2023-04-20

  • [Front] merge Master fixes into preprod MR(958)

  • [Front] fix: refresh table data when resolution changes MR(957)

  • [Front] fix : restore graph tooltip for hyperparameters tuning MR(956)

  • [Front] fix: date format payload MR(955)

  • [Front] Merge branch ‘fix/fetch-of-recipe-when-not-configured’ into ‘master’ MR(954)

  • [Front] fix: prediction dataset id MR(953)

  • [Front] fix: cypress test MR(945)

  • [Front] feat: add resourecs tabs for app runs results (recipe) + fix dropdown font size MR(943)

  • [Front] fix: fetch of recipe when not configured MR(942)

  • [Front] fix: auto deploy dev MR(941)

  • [Front] feat: delete pipeline run with all resources option MR(940)

  • [Front] Feat/paginated results MR(938)

2023-04-17

  • [Front] fix: model option disappearing MR(950)

  • [Front] Fix/score multi res MR(946)

  • [Front] fix: datasources not showing in export panel MR(948)

  • [Front] fix: prediction creation MR(947)

  • [Front] fix: forecast runs with missing .value causing improper payload MR(949)

2023-04-14

  • [Engine] reset index before building a resolution’s x and y datasets for prediction MR(1420)

  • [Engine] Simplify preprocessing code MR(1418)

  • [Engine] Fine tune condition for enabling native encoding MR(1419)

  • [Backend] More space for schedule MR(482)

  • [Backend] Fix write dispotion error message in connectors MR(480)

  • [Backend] Skip run with no config MR(479)

  • [Backend] Add recipe field MR(466)

  • [Backend] Add scheduler MR(453)

  • [Backend] Timestamp recipe run MR(477)

  • [Backend] Export error into errors file MR(476)

  • [Backend] Export sql alchemy error to user MR(470)

  • [Backend] Bugfix transform parquet to csv from sf on gcs smarter MR(475)

  • [Backend] Use defaut engine when pyarrow fails MR(473)

  • [Backend] Fix slack connecttimeout MR(472)

  • [Backend] Try to get files with all possible extensions MR(469)

  • [Backend] Handle slack timeout MR(468)

  • [Backend] Add export method parameter when expoting to bq MR(462)

  • [Backend] Fix pandas read csv pyarrow MR(467)

  • [Backend] One more error MR(465)

  • [Backend] If there is already a dataset with the same name, back up it MR(463)

  • [Backend] Expose run error MR(464)

  • [Backend] allow new lines for bigquery export MR(461)

  • [Backend] feat: add app displayed results MR(460)

  • [Backend] Change pipeline step name MR(456)

  • [Backend] Revert “Merge branch ‘fix_old_bug’ into ‘master’” MR(459)

  • [Backend] Remove line that should not be there. MR(457)

  • [API] Feat: return deleted ids MR(679)

  • [API] Merge branch ‘fix/last-optimization-run’ into ‘master’ MR(707)

  • [API] fix: last optimization run not correctly sorted MR(706)

  • [API] Ajout du check recipe dans la method post de la classe RecipesRoute MR(696)

  • [API] Return 200 and null when no schedule exists MR(703)

  • [API] Add patch route MR(701)

  • [API] A business case can now have only one schedule MR(700)

  • [API] Protect all api method with fga MR(682)

  • [API] Fix deploy doc MR(697)

  • [API] fix: empty displayed results patch MR(698)

  • [API] fix download csv for parquet file MR(694)

  • [API] Add recurring run model MR(683)

  • [API] feat: add params to recipe steps route MR(693)

  • [API] fix default values MR(692)

  • [API] Add recipe to db MR(691)

  • [API] add newly created recipe to parameters as quick fix MR(690)

  • [API] Add recipe field MR(689)

  • [API] Creation response recipe MR(686)

  • [API] feat: authorize patch of displayed results for app MR(685)

  • [API] feat: add app displayed results MR(684)

  • [Front] Merge branch ‘fix/fetch-of-recipe-when-not-configured’ into ‘master’ MR(944)

  • [Front] fix app.config.json MR(939)

  • [Front] feat: replace optimization modal with optimization panel for creation on optimization step MR(937)

  • [Front] feat: scheduler interface MR(932)

  • [Front] Fix/moar bugherds bugs MR(935)

  • [Front] Fix/bugherd bugs MR(933)

  • [Front] Fix/display bugs MR(931)

  • [Front] fix pipeline routes from recipes MR(930)

  • [Front] fix: ze script loading MR(929)

  • [Front] chore: feature importance rework MR(923)

  • [Front] Feat/table size MR(926)

  • [Front] Fix/create app and type error MR(928)

  • [Front] Feat/get pipeline steps ids MR(927)

  • [Front] Fix: improve performance, avoid unnecessary template refreshes MR(925)

  • [Front] Fix/test pipeline MR(924)

  • [Front] feat: add modal for app results MR(911)

  • [Front] fix: bugs MR(922)

  • [Front] fix: graph size and maxBarThickness MR(921)

  • [Front] feat: add icons for datatypes MR(920)

  • [Front] fix : recipe config payload back in string format MR(919)

  • [Front] Feat/add cypress e2e MR(908)

  • [Front] fix: build after name changed for some methods MR(918)

  • [Front] chore : add some unit tests MR(917)

  • [Front] app run results finalization MR(914)

  • [Front] Chore/remove extra fonts MR(916)

  • [Front] fix: app modal experiment context MR(915)

  • [Front] feat : apprun results rework first step MR(912)

  • [Front] fix: badge style and bootstrap colors override MR(913)

  • [Front] fix: restore line breaks for logs MR(910)

  • [Front] feat: remove recipe menu and move recipe configuration to app runs view MR(909)

  • [Front] chore: enforce typing of some table items MR(907)

  • [Front] feat: implement vis-network MR(904)

  • [Front] fix: refresh variable name MR(902)

  • [Front] Feat/variable type chart MR(903)

  • [Front] replace b-col with div class=”col” and remove useless b-col MR(898)

  • [Front] feat: first vitest snapshot MR(894)

  • [Front] Fix/allow optimization refresh settings MR(895)

  • [Front] introduce variables chart MR(891)

  • [Front] Vue3/runnings MR(892)

  • [Front] remove b-table and replace with simpletable MR(888)

  • [Front] Merge refacto/vue-3 into master MR(887)

  • [Front] use of Bootstrap classes instead of bootstrap-vue prop incorrectly typed MR(886)

  • [Front] merge Refacto/vue 3 into master MR(882)

  • [Front] Draft: vue 3 MR(849)

  • [Front] Refacto/restore ci MR(885)

  • [Front] restore zendesk widget with new theme MR(883)

  • [Front] fix: TS errors MR(884)

  • [Front] CSS adjustments mainly for table MR(878)

  • [Front] Fix/dataset screen MR(879)

  • [Front] Fix/bugherd batch MR(876)

  • [Front] Vue3/change b tables MR(875)

  • [Front] implement FileInput and allow zipped file upload MR(874)

  • [Front] Vue3/types packages MR(873)

  • [Front] add last missing screens ;) MR(872)

  • [Front] Vue3/recipes and data MR(871)

  • [Front] Vue3/optimization view MR(869)

  • [Front] Fix/bugherd batch MR(868)

  • [Front] add training, postprocessing, preprocessing MR(867)

  • [Front] add training, postprocessing, preprocessing MR(866)

  • [Front] add pipeline runs MR(865)

  • [Front] add multiselect, datepicker and forecast modal, optimization modal, recipe modal MR(864)

  • [Front] add api composables + Dtos MR(863)

  • [Front] finish importing MR(862)

  • [Front] finish importing MR(861)

  • [Front] Refacto/vue 3 import files MR(858)

  • [Front] table : css adjustments and filter MR(860)

  • [Front] app runs MR(859)

  • [Front] implement gradient colors for charts MR(857)

  • [Front] Vue3/apps app modal MR(855)

  • [Front] merge refacto/vue-2 into master MR(856)

  • [Front] Feat: show app resources MR(845)

  • [Front] fix : pipeline run mapper MR(846)

  • [Front] linkto mapper MR(844)

  • [Front] Refacto/log and store requests MR(843)

  • [Front] script setup training MR(841)

  • [Front] refacto: change graph.vue to script setup MR(842)

  • [Front] Refacto/script setup apikey score MR(840)

  • [Front] script setup forecast modal MR(839)

  • [Front] fix columns dropdown being clipped MR(838)

  • [Front] script setup preprocessing MR(835)

  • [Front] script setup run MR(834)

  • [Front] fix: scores and trainings metrics when no resolution is selected MR(837)

  • [Front] add useLogsErrorWarningApi composable MR(833)

  • [Front] Reafcto/table implem on views MR(832)

  • [Front] Refacto/script setup next MR(831)

  • [Front] refacto: loader during upload & more explicit names MR(829)

  • [Front] Refacto/table MR(819)

  • [Front] Refacto/script setup suite MR(824)

  • [Front] fix: missing css prefix on secondary menu MR(827)

  • [Front] Merge branch ‘fix/card-opacity’ into ‘master’ MR(828)

  • [Front] Refacto/simplify store MR(823)

  • [Front] right panel implementation MR(814)

  • [Front] Revert “Merge branch ‘cherry-pick-d83848cc’ into ‘refacto/vue-2’” MR(822)

  • [Front] Merge branch ‘bug/refresh-after-delete-app’ into ‘master’ MR(821)

  • [Front] Merge branch ‘fix/business-case-forecast-permissions’ into ‘master’ MR(818)

  • [Front] right side bar first step & useApi MR(810)

  • [Front] Merge branch ‘fix/business-case-run-not-usin-right-experiment’ into ‘master’ MR(813)

  • [Front] refacto: better naming for css classes MR(811)

  • [Front] Make use of card in pipelines, recipes and home view MR(809)

  • [Front] Merge branch ‘fix/pipeline-runs-not-displaying’ into ‘master’ MR(808)

  • [Front] refacto : add multiselect wrapper MR(806)

2023-04-11

  • [API] fix: last optimization run not correctly sorted MR(706)

2023-04-06

  • [Front] fix: new scores not displaying MR(934)

2023-03-30

  • [API] Support parameters modif MR(680)

  • [Backend] Look for dataset at synapps level MR(452)

  • [Backend] added clone_datasets to init MR(455)

  • [Backend] Right name for unzipped files MR(454)

  • [Backend] fixing cloned dataset’s datasource, adding test, big move of k8s into handler MR(451)

  • [Backend] Use pandas 2.0 + pyarrow MR(449)

  • [Backend] Become experiment agnostic MR(450)

2023-03-21

  • [Front] Feat: allow zipped files MR(901)

  • [Front] Fix: optimization modal variable name MR(906)

2023-03-20

  • [Engine] Keep column to predict in prediction result if existing MR(1396)

  • [Engine] fix clustering error message MR(1406)

  • [Engine] Make score available on prediction and postprocessing MR(1403)

  • [Engine] Fix google key error 500 MR(1408)

  • [Engine] Revert fix public key since resolved MR(1409)

  • [Engine] preprod env MR(1407)

  • [Engine] Fix fill series changing date order MR(1413)

  • [Engine] Pandas 2.0 MR(1412)

  • [Engine] now ignore headers when counting rows in files MR(1416)

  • [Engine] Native categorical encoding xgb MR(1411)

  • [Engine] fixing categorical features in xgboost MR(1417)

  • [API] Check pipeline config MR(669)

  • [API] Add code to create optimization pipeline MR(668)

  • [API] preprod env MR(657)

  • [API] fix statistics from empty resources MR(667)

  • [API] fix remove user from synapps MR(671)

  • [API] Allow to store zip file in bucket MR(672)

  • [API] fix: statistics request with auth0-fga method MR(673)

  • [API] Feat: show app run ressources MR(662)

  • [API] Feat/export and datasets all experiments MR(660)

  • [API] Use native encoding for categorical values in XGB MR(670)

  • [API] fix: binary_data being decoded MR(675)

  • [API] Fix: empty default optimization config & allow empty recipe config MR(676)

  • [API] chore: route slashes reuniformization MR(678)

  • [API] merge auth0 identities MR(674)

  • [Backend] Update status MR(421)

  • [Backend] Use right status MR(422)

  • [Backend] Filter out deleted datasets MR(423)

  • [Backend] Rename step_import_from_dataset MR(426)

  • [Backend] Add post processing to pipeline MR(428)

  • [Backend] Rename input_dataset_name MR(427)

  • [Backend] Add pipeline step export MR(425)

  • [Backend] Handle case when step type in config in not valid MR(429)

  • [Backend] Give more memory to EMG MR(431)

  • [Backend] Automatically create scores on postprocessing and prediction MR(430)

  • [Backend] Fix google key error 500 MR(432)

  • [Backend] Revert fix public ket since resolved MR(434)

  • [Backend] preprod env MR(424)

  • [Backend] Add pipeline optimization step MR(435)

  • [Backend] Move launch jobs cron MR(433)

  • [Backend] Filter delete data source MR(437)

  • [Backend] Typo MR(439)

  • [Backend] Unzip file and convert it to csv. MR(440)

  • [Backend] stop removing header in row count MR(442)

  • [Backend] Refresh by default MR(441)

  • [Backend] Catch exception MR(438)

  • [Backend] Export optimiztion step MR(443)

  • [Backend] Add zip MR(444)

  • [Backend] Download csv files as well as parquet ones. MR(445)

  • [Backend] Don’t export index MR(446)

  • [Backend] Revert “Merge branch ‘more_meory_for_emg’ MR(448)

  • [Front] fix: restore feedback on experiments button selection MR(736)

  • [Front] refactor: improve sturdiness of BC form validation MR(722)

  • [Front] add CRUD to recipe in front MR(731)

  • [Front] chore: remove unused packages MR(732)

  • [Front] fix user feedback from rupert MR(735)

  • [Front] refactor: remove obsolete runtypes MR(738)

  • [Front] chore: uniformize route endings MR(737)

  • [Front] refactor: finish cleaning old runtypes MR(742)

  • [Front] refactor: replace vue-meta with native functionality MR(743)

  • [Front] feat: implement apps page MR(744)

  • [Front] left side menu rework MR(747)

  • [Front] fix sass warnings MR(746)

  • [Front] Fix/header buttons MR(749)

  • [Front] fix token redirect loop MR(750)

  • [Front] Feat: finish apps page functionalities MR(748)

  • [Front] Fix/runnings icon MR(751)

  • [Front] rework synappId and experimentId getters + requests optimizations MR(752)

  • [Front] feat : split profile menu into submenus MR(753)

  • [Front] Fix/design fixes MR(754)

  • [Front] Add option entry to select recipe MR(745)

  • [Front] feat : rework design of page header and sticky header MR(756)

  • [Front] Fix/various fixes MR(758)

  • [Front] Feat/add generic clickable-card component MR(757)

  • [Front] fix: stop propagation on clickable component MR(760)

  • [Front] Feat: update pipelines design MR(761)

  • [Front] feat: side menu design updated MR(759)

  • [Front] feat: update deployments design (previously recipes) MR(763)

  • [Front] feat: add-confirmation for app deletion in modal & rename right side bar text to app MR(764)

  • [Front] Feat/design training MR(762)

  • [Front] implement add button in apps page MR(765)

  • [Front] Feat apply design to views MR(766)

  • [Front] feat datasets as default menu for data MR(767)

  • [Front] fix add user MR(768)

  • [Front] add borders for users and synapp selection, rework colors MR(769)

  • [Front] Fix/wording MR(770)

  • [Front] update recipe design MR(771)

  • [Front] fix recipe modal MR(772)

  • [Front] feat : update table design MR(773)

  • [Front] feat : header font and set main titles MR(774)

  • [Front] feat : add ellipsis for large experiment name MR(775)

  • [Front] feat: replace X button with Cancel button on sidebars and align title to the left MR(777)

  • [Front] feat: change export button and place export csv icon directly into table MR(778)

  • [Front] feat: main title colored with icon MR(779)

  • [Front] fix apps loading when no apps MR(780)

  • [Front] fix : add missing borders and fix some design MR(781)

  • [Front] feat : add breadcrumb synapp and pipeline MR(782)

  • [Front] Fix/stuttering loading MR(783)

  • [Front] remove some css MR(785)

  • [Front] feat : add app settings button in page header MR(786)

  • [Front] fix: header align when there’s no icon MR(787)

  • [Front] chore: global spinner for views MR(788)

  • [Front] minor buttons changes MR(790)

  • [Front] chore : wording MR(789)

  • [Front] feat: add multiselect to inputs and alphabetical sorting MR(792)

  • [Front] feat : deployment with a secondary menu MR(791)

  • [Front] Feat/menu icon position MR(795)

  • [Front] Feat/deployment creation MR(793)

  • [Front] feat : add spinner verteego MR(794)

  • [Front] Feat: cover for apps MR(796)

  • [Front] fix: new verteego spinner MR(797)

  • [Front] Feat/add missing borders MR(798)

  • [Front] Feat/warnings design MR(799)

  • [Front] fix : align stat to the left and add min width MR(800)

  • [Front] feat : add information when no apps or no recipes are created yet MR(801)

  • [Front] fix : prevent ctrl click from changing menu colors MR(802)

  • [Front] feat : new position and size of header with breadcrumb MR(803)

  • [Front] feat : add display all datasets button MR(804)

  • [Front] feat : header design update, icon size and positioning MR(804)

  • [Front] fix : pipeline runs not displaying MR(807)

  • [Front] fix/business-case-forecast-permissions MR(817)

  • [Front] bug : refresh apps view after deleting an app MR(820)

  • [Front] Fix/card opacity MR(826)

  • [Front] fix: normalize string when prefill run recipe name MR(830)

  • [Front] add pipeline type MR(850)

  • [Front] feat: add optimization dataset field on optimization pipeline run create panel MR(852)

  • [Front] preprod env MR(880)

  • [Front] fix refresh and remov client-specific code MR(893)

2023-02-23

  • [Engine] Add test for identity model MR(1404)

  • [Engine] Stop using one hot encoding when meta_model is used MR(1405)

2023-02-21

  • [Engine] spreading_coefficient_input_percentage where overwritten. Add more logs. MR(1402)

2023-02-20

  • [Engine] Remove na and na t before exporting to bq MR(1401)

2023-02-16

  • [Engine] Minor fixes MR(1399)

  • [Engine] Fix nan nat creating error when exporting step results to bq MR(1398)

2023-02-13

  • [Engine] Aggregation preprocessing should have a step argument MR(1395)

  • [Engine] fix global calculators using store in model MR(1397)

2023-02-06

  • [Engine] Generate list of one hot encoded columns name from values. MR(1376)

  • [Engine] sanitize HPT params handling MR(1384)

  • [Engine] Add mem info in logger MR(1392)

  • [Engine] Retry when connection fails MR(1394)

  • [Engine] Add custom upper and lower weight for relaxation MR(1393)

  • [Engine] Fix filtering not working MR(1391)

  • [API] Update vbrain-config requirement MR(655)

  • [Backend] adding test of stop-pipeline MR(412)

  • [Backend] Add the long awaited check_recipe_runs MR(407)

  • [Backend] fix memory requirement MR(416)

  • [Backend] Add run_id for export MR(415)

  • [Backend] Add export step MR(414)

  • [Backend] Don’t export index in BQ MR(418)

  • [Backend] Step pipeline MR(417)

  • [Backend] Log step name MR(419)

  • [Backend] SQLAlchemy ! MR(420)

2023-01-30

  • [API] invite user from front MR(635)

  • [API] Add possibility to change destination bucket for sf import MR(646)

  • [API] Refactoring/split of synapps.py MR(647)

  • [API] Add new relations with run and recipe MR(649)

  • [API] Recipe snapshot MR(648) MR(650) MR(651)

  • [Backend] fix stuck backend MR(401)

  • [Backend] Fix backend k8s auth MR(403)

  • [Backend] Use gcloud BQ API and autodetect option MR(400)

  • [Backend] add possibility to choose bucket of export for snowflake import MR(404)

  • [Backend] Pin requirement MR(409)

  • [Backend] Adapt db to enable new recipe MR(406)

  • [Backend] Fix models MR(410)

  • [Backend] Fix missing parameters in check dataset MR(411)

  • [Backend] pin sql alchemy requirement MR(413)

2023-01-24

  • [Engine] Investigate weather calc MR(1390)

  • [Engine] check gps coordinates format MR(1389)

2023-01-18

  • [Engine] fix similarity calc with custom label col. add string test for binary calc. MR(1388)

  • [Engine] fix weather for large query : adding option to only include daily data, without hourly detail MR(1387)

2023-01-17

2023-01-13

  • [Api] Update vbrain config version MR(644)

2023-01-12

  • [Engine] Fix integration test ci MR(1378)

  • [Engine] Embeddings classification calculator MR(1381)

  • [Engine] Fix weather error MR(1382)

2023-01-06

  • [Engine] Fill series changes integers to floats MR(1377)

  • [Engine] use right python version MR(1379)

  • [Engine] Update deps MR(1380)

  • [Backend] Expose error to user. MR(1380)

  • [Backend] Recipes invalid dataset MR(1380)

  • [Backend] Improve onboarding for developers MR(1380)

  • [Api] fix user feedback from rupert MR(1380)

  • [Api] chore: uniformize route endings MR(1380)

  • [Api] refactor: remove obsolete runtypes MR(1380)

  • [Api] Update deps MR(1380)

2023-01-04

  • [Engine] separate build requirement from build app MR(1370)

  • [Engine] add custom metrics doc MR(1371)

  • [Engine] update hierarchical aggregate doc MR(1373)

  • [Engine] Include weather doc MR(1372)

  • [Engine] Python 3.10 MR(1374)

  • [Engine] Migrate api to python 3 10 MR(1375)

2023-01-02

  • [Backend] Add pre query for sql dataset MR(396)

2022-12-29

  • [Api] Paginate Table in all Views MR(622)

  • [Api] add sort and filters to recipes MR(632)

  • [Api] Add pre query for sql dataset MR(633)

  • [Front] Paginate Table in all Views MR(716)

  • [Front] feat: add user cards as a table replacement MR(734)

  • [Front] Fetch less data for datasets MR(727)

  • [Front] Fix type error for hpt scores Graphs MR(725)

  • [Front] Fix regression & refacto of additional data fetching for Tables MR(726)

  • [Front] fix case where datasources would be empty MR(728)

2022-12-15

2022-12-13

  • [Engine] Apply nbv calculation only for status != downselling MR(1367)

  • [API] update config for custom events calculator MR(630)

2022-12-12

  • [Engine] fix bad merge MR(1366)

  • [Engine] Create custom countdown calc MR(1363)

  • [Engine] actually remove deprecated code MR(1365)

2022-12-09

2022-12-08

2022-12-07

2022-12-06

  • [Backend] Catch pyarrow error. MR(394)

  • [Backend] When refreshing a dataset, don’t failed when exporting to BQ MR(391)

  • [Backend] Allow to read parquet file MR(389)

2022-12-05

  • [API] Separate statistics from Home Page & fix CLI synapps command MR(623)

  • [API] don’t launch score when column to predict doesn’t exist MR(624)

2022-12-01

  • [Engine] Fix pandas error raised at preprocessing MR(1361)

  • [Engine] Ease debug MR(1359)

  • [Backend] optimisation must have either a preprocesing nor a dataset MR(381)

  • [Backend] Optimize call to list_namespaced_job MR(379)

  • [Backend] Use string instead of UUID MR(383)

  • [Backend] Use string instead of UUID part 2 MR(384)

  • [Backend] change optimization not launching message error MR(385)

  • [Backend] Replace or by and! MR(386)

  • [Backend] Improve report performance MR(382)

  • [Backend] Add missing parallelizer in rosetta docker MR(387)

  • [Backend] Use threading instead of loky, to avoir serializtion with pickle MR(388)

2022-11-30

  • [Engine] Fix error on preprocessing introduced by mr1351 MR(1358)

  • [Engine] Fix linter MR(1357)

  • [Engine] Solver fixes MR(1355)

  • [Engine] Optimize vars creation MR(1356)

2022-11-28

  • [Engine] meteo calculator MR(1345)

  • [Engine] Detect empty cv test set MR(1351)

  • [Engine] change column type category in hierarchical aggregate MR(1349)

2022-11-15

  • [Engine] update vtg config validation to not modify constraints… MR(1346)

  • [Engine] Don’t keep original variables when merging MR(1348)

  • [Engine] fix order and binary constraint required columns MR(1347)

  • [API] update vtg config validation to not modify constraints… MR(619)

  • [Front] Add zendesk widget MR(713)

2022-11-14

  • [Engine] Load only required columns MR(1344)

  • [Engine] fix aggregation constraint for corner cases with weight cols and variable cols MR(1336)

  • [Backend] launch recipes with runs MR(380)

  • [Backend] fix name checking MR(377)

  • [Api] add recipe object MR(613)

  • [Api] launch recipes with runs MR(615)

  • [Api] Add route to allow business cases migration MR(611)

  • [Api] reduce home screen loading time - Part 1 MR(614)

  • [Front] fix eslint not working for vue files MR(712)

  • [Front] Fix regression for list of errors MR(710)

  • [Front] Vue lazy load & reduce default image MR(711)

  • [Front] enforce <script> before <template> tags for consistency MR(709)

  • [Front] increase line length to 120 MR(708)

  • [Front] Latest system dataset by name pattern or select in dropdown MR(705)

2022-11-04

  • [Engine] fix get from dataset index duplicates MR(1342)

  • [Engine] Patch get from dataset MR(1343)

2022-10-27

  • [Engine] Speed up variable creation, corrected MR MR(1340)

  • [Engine] update to the vtg-config commit that removes deprecated features MR(1338)

  • [Engine] Investigate pediction drop rows when nan in resolution MR(1335)

  • [Engine] update deprecated configs in tests MR(1337)

  • [Engine] fix get from dataset MR(1334)

  • [Engine] now using vtg_config for constraint validation MR(1325)

  • [API] add feedback for name errors from is_string_valid function MR(610)

  • [API] update to the vtg-config commit that removes deprecated features MR(612)

2022-10-19

  • [Engine] add mathematical expression calculator MR(1329)

  • [Engine] get feedback for integration tests MR(1332)

  • [Engine] add lightgbm to the doc MR(1333)

  • [Engine] ensure val and groupby in aggregate calculator are disjoint MR(1331)

  • [Engine] Inconsistent dataset when using model resolution MR(1328)

  • [Engine] Upgrade SMAC MR(1188)

  • [API] Don’t notify for 404 MR(609)

  • [API] validate constraints when creating a business run, or an optimize step MR(608)

  • [API] fix paginating for users list MR(607)

  • [Backend] fix launch_jobs crash when optimization step does not have a dataset MR(376)

  • [Backend] change dataset refresh mecanism MR(375)

  • [Backend] Catch BQ error and write error in error file MR(374)

  • [Backend] Overflow can occur when trying to infor column type. MR(373)

  • [Front] validate constraints when creating a business run, or an optimize step MR(706)

  • [Front] add user to synapps MR(703)

  • [Front] improve size of GD & table-search icons in table for Datasets View MR(689)

  • [Front] fix profile invisible in Home View & add synapp name in Users View MR(704)

2022-10-13

  • [Engine] Throw clearer error when weight is not numerical MR(1313)

  • [Engine] fixing hierarchical calculator when using dtf indices MR(1326)

  • [Engine] Fix date weight calculator MR(1327)

2022-10-11

  • [API] Upgrade to new vtg_config folder structure MR(604)

  • [API] Upgrade vbrain config version MR(606)

  • [Engine] Upgrade config check for output columns validation MR(1324)

  • [Engine] Upgrade to new vtg_config folder structure MR(1323)

2022-10-06

  • [engine] optimize hierarchical aggregate MR(1320)

2022-02-04

  • Preprocessing: add columns used in stored_keys of calculators in output

  • Preprocessing: add train/test and CV index info when logging

  • xgb_regressor model: add support for dart parameters

  • aggregate_val_group_by_key calculator: allow count like operations on any type

  • fix bug when columns used for model resolution have values with _ inside

2022-01-26

  • front: add new dashboard tab in forecast page with KPI and graphs

  • support launching an Optimization from a Postprocessing, only Preprocessings were previously supported

  • engine: add a warning when trying to load a non existing column from an external Dataset

2022-01-19

2022-01-13

  • add support for trend_coeff parameter in xgboost and random_forest algorithms

  • Optimization: also export raw and floor solutions, it adds 2 new columns to the output with respectively the _raw and _floor suffixes

2021-12-21

2021-12-17

  • front: revamp export and download options on resource pages

2021-12-10

  • front: multiple resources can now be selected and deleted in one step

2021-12-09

  • add support for email notifications

2021-12-08

  • engine: add support for asymetric_squared_error objective function and asymetric_squared_scorer scorer, and support new configuration parameter alpha for xgboost regression

  • engine: print current version in the log file before starting any step

2021-12-06

  • Synapps are no longer associated with a use case

  • Runs can now be aborted with an error message displayed on the Run individual page

  • front: display Runs and Optimizations statistics instead of Trainings and Predictions for Synapps without any Training

2021-12-02

  • notifications: add support for run events

  • add support for update, delete, launch, and stop events

2021-12-01

  • configuration: add checks on tuning_search_params configuration entry

  • add new icon in navigation bar to activate a dropdown with the list of active ressources created by the current user

  • only display export option for finished ressources, and stop option for running ones

  • disable submit buttons once clicked to prevent creating twice the same ressource

2021-11-30

  • add new Variables tab on Prediction and Postprocessing pages

  • several improvements and bug fixes related to Optimization

  • return an error when trying to create Pipelines or steps from a valid Dataset with no rows

2021-11-29

  • add create events when a User is creating Experiments, Datasources, and Datasets; populate Created By columns accordingly in the web interface

  • improve PostgreSQL Datasets parameters display, do not print the whole query but Host and Database instead; and for Google Storage Datasets print the whole link using both Datasource and Dataset parameters

  • front: do not print multiple times the same warning on steps individual pages

2021-11-22

  • new calculator get_from_dataset to replace get_from_csv, and a message to warn the user that get_from_csv is deprecated and will eventualy be removed

2021-11-17

  • front: store in browser selected columns for each table

2021-11-16

  • front: add history card in Profile page with the 10 latest actions of the current user

2021-11-15

2021-11-09

  • front: last selected Experiment is now saved in cache for each Synapp, thus reentering a Synapp will automatically select the saved Experiment

2021-11-05

  • add infrastructure to keep track of all events happening, start by collecting resource creation events for now

  • front: display the name of the user who created the resource

2021-11-04

  • PostgreSQL connector: add port option, if not specified default port 5432 is used

2021-10-29

  • add an option to delete all the steps when deleting a Pipeline

  • add more filtering options for Datasets: Datasets generated during a Run, Datasets used for a Preprocessing, and Datasets used for a Prediction

  • configuration: for each calculated column, check the number of input and output columns (cols and col_names) is supported by the calculator, and also check that each entry in params is supported and has the expected type

2021-10-25

  • front: support daily, weekly, monthly, and yearly split when creating a new Forecast

2021-10-20

  • CLI release 0.5.0

2021-10-19

  • add support for BigQuery views when creating a new Dataset

2021-10-18

  • export and display warnings for each step of the pipeline

  • front: group edit, export, delete, and stop buttons in table views

2021-10-15

  • front: new link column in Datasources page with external link to Datasource for GS, GD, and BQ

  • engine: new allowed parameter for xgboost regression: quantile

2021-10-14

  • Datasets can now be created from Prediction, Postprocessing, and Optimization output

2021-10-13

  • front: rename Experiment menu section to AI Lab

  • front: close configuration update modal on successful update

  • front: add buttons to create Training and Score

  • front: move experiment selector from title to breadcrumb

2021-10-11

  • Training now exposes metrics, features importance, and best parameters for each model resolution

  • add Feasability section in Preprocessing page, it contains indicators on whether the model is likely to generate good results

2021-10-08

  • front: add YAML syntax highlighting in the Configuration tab of each step

  • configuration: when creating a Pipeline or Preprocessing, return an error if the column in column_to_predict is not in the Dataset or in the output of a calculated column

  • configuration: return an error on configuration update if an entry in the col_names section of a calculated column contains an unsupported character

2021-10-07

  • engine: fix feature importances when using AutoML (meta_model)

  • front: for each step, display both the configuration provided by the user and the complete configuration with default values

  • front: add Stop buttons for Pipeline and each step

2021-10-06

  • add several new checks when uploading a new version of the configuration

2021-10-05

  • front: in the configuration tab of each step, add a checkbox to show the complete configuration, this means the configuration with default values added

  • front: improve error message when updating the configuration

2021-10-04

  • front: creating a new Dataset using direct CSV upload is available when default Datasource is selected

2021-09-30

  • Runs of all types can now be deleted, it only deletes the Run and not the linked resources like Datasets or Pipelines

  • configuration: add new check for calculated columns, return errors if entries in col_names are already in cols or in cols_type

2021-09-29

  • engine: fix Hyperparameter Tuning when using AutoML (meta_model)

  • generate weekly and yearly seasonality report after Preprocessing, only if date_col configuration is set and item_id or pos_id columns are present, and skip if it takes more than 5 minutes

2021-09-23

  • front: add new My Business menu section, merge of Forecast and Simulation sections, and move this new section above Experiment

2021-09-21

  • Recurring Exports: add support for optimization target

  • configuration: add checks when updating the configuration on algorithm related entries: algo_type, algo_name, and algorithm_parameters

2021-09-15

  • add support for PostgreSQL Exports

  • Google Drive connector: fetch Revision ID and Mime Type when downloading the file, store these information in the report, and display them in the web interface

  • front: when downloading a CSV file, set the file name based on the name of the step or Dataset to download

  • front: for Exports, prefill file or table name based on the name of the target to export

2021-09-08

  • add support for Google Drive Exports

2021-09-07

  • Experiments now have a minimal default configuration when created

  • a default Experiment is now added when creating a new Synapp

  • configuration: add check for resampling option

2021-09-06

  • front: forecast pages (Baseline, Promotion, Traffic, and Cash) now display Postprocessing results instead of Prediction, export to CSV button has also been updated

2021-09-03

  • front: add status column in Experiments page

  • front: support cloned and cloning status for Datasets

2021-09-01

  • add support for Exports on Optimization and Score targets

  • web: support Exports for all targets, only Preprocessing was previously supported

  • web: fix bug when trying to edit the Experiment configuration when the configuration is empty