Commit Graph

91 Commits

Author SHA1 Message Date
Carl-Gerhard Lindesvärd
de3ea6c8be chore(buffer): remove unused deps 2025-02-04 12:03:44 +01:00
Carl-Gerhard Lindesvärd
be83b484bc improve(buffer): better clean up 2025-02-03 21:50:35 +01:00
Carl-Gerhard Lindesvärd
de1a4faf28 fix(buffer): dont save bot events when testing 2025-02-03 09:42:53 +01:00
Carl-Gerhard Lindesvärd
ff2dca42f6 improve(buffer): prep postgres buffer 2025-02-03 09:19:00 +01:00
Carl-Gerhard Lindesvärd
a2b74a9b4d test(buffer): testing new buffer (only inserts, no processing) 2025-01-31 00:09:25 +00:00
Carl-Gerhard Lindesvärd
71bf22af51 feature(queue): use postgres instead of redis for buffer
* wip(buffer): initial implementation of psql buffer

* wip(buffer): add both profile and bots buffer
2025-01-30 22:50:57 +00:00
Carl-Gerhard Lindesvärd
a3f39b95d2 fix(buffer): tmp lower inserts 2025-01-30 22:32:04 +00:00
Carl-Gerhard Lindesvärd
033a6acd43 fix(buffer): chunk inserts 2025-01-29 16:07:43 +00:00
Carl-Gerhard Lindesvärd
12ab8fc0af fix(buffer): increase lock timer 2024-12-03 14:38:21 +01:00
Carl-Gerhard Lindesvärd
ee0f7e7d75 fix(api,worker): general improvements for workers, debugging and logging 2024-12-03 13:25:05 +01:00
Carl-Gerhard Lindesvärd
500cce2918 fix(buffer): ensure insert correct date format 2024-11-30 22:48:07 +01:00
Carl-Gerhard Lindesvärd
d80754a6fd fix(buffer): max call stack issue with buffer 2024-11-29 10:39:12 +01:00
Carl-Gerhard Lindesvärd
e21cd7ed73 revert 2024-11-28 21:11:22 +01:00
Carl-Gerhard Lindesvärd
ab8bce7752 chore(dashboard,db): prepping for migration time 2024-11-28 20:58:18 +01:00
Carl-Gerhard Lindesvärd
3e7a3ea6c9 fix(buffer): keep a backup of the buffer if something goes wrong 2024-11-19 20:45:35 +01:00
Carl-Gerhard Lindesvärd
25a7365569 perf(worker): try to improve perf of worker 2024-09-24 09:19:30 +02:00
Carl-Gerhard Lindesvärd
1242f0e9c9 chore(buffer): clean up old files 2024-09-20 10:35:21 +02:00
Carl-Gerhard Lindesvärd
7a0e50a764 fix(buffer): use correct name 2024-09-20 09:38:49 +02:00
Carl-Gerhard Lindesvärd
25f329a4cd chore(buffer): iron out the buffer issues 2024-09-19 21:38:40 +02:00
Carl-Gerhard Lindesvärd
e18ac4d79e fix(buffer): fixed issues with buffer 2024-09-18 23:46:38 +02:00
Carl-Gerhard Lindesvärd
13a83155cf fix(db): change buffer lock interval 2024-09-18 23:46:38 +02:00
Carl-Gerhard Lindesvärd
545cbfd520 feature(worker+api): improve buffer 2024-09-18 23:46:37 +02:00
Carl-Gerhard Lindesvärd
32e91959f6 chore(root): migrate to biome 2024-09-18 23:46:11 +02:00
Carl-Gerhard Lindesvärd
1f6e198336 fix 2024-09-18 23:22:01 +02:00
Carl-Gerhard Lindesvärd
c674127784 test(buffer): disable auto flush on profile 2024-09-14 22:57:50 +02:00
Carl-Gerhard Lindesvärd
c819c18962 fix(root): add hyperdx and better logging 2024-09-13 22:05:25 +02:00
Carl-Gerhard Lindesvärd
efd24ca67a perf(api): improve inserting events 2024-09-12 22:09:35 +02:00
Carl-Gerhard Lindesvärd
46fe17e558 perf(api): add bot events with buffer 2024-09-12 20:51:54 +02:00
Carl-Gerhard Lindesvärd
dbc2a32458 fix(buffer): avoid merging properties 2024-09-10 23:30:41 +02:00
Carl-Gerhard Lindesvärd
ccfddc215f save sdk name and version 2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
89c5732efe fix redis timeout connection on serverless (avoid init redis directly) 2024-07-22 21:49:46 +02:00
Carl-Gerhard Lindesvärd
0fea45c9f7 rename IServiceCreateEventPayload 2024-07-21 23:55:04 +02:00
Carl-Gerhard Lindesvärd
f2298a1b05 init redis lazy 2024-07-20 20:17:32 +02:00
Carl-Gerhard Lindesvärd
3993b493e3 prep events partition 2024-07-19 22:08:22 +02:00
Carl-Gerhard Lindesvärd
9ee8626f96 add retry if timeout error for clickhouse 2024-07-18 21:16:07 +02:00
Carl-Gerhard Lindesvärd
7a0190c186 better error for buffer 2024-07-18 14:15:19 +02:00
Carl-Gerhard Lindesvärd
ba1bd0e035 wip 2024-07-17 23:50:59 +02:00
Carl-Gerhard Lindesvärd
4893a42b26 wip 2024-07-17 23:43:23 +02:00
Carl-Gerhard Lindesvärd
f0a2cafa74 enable publish on event 2024-07-17 23:28:59 +02:00
Carl-Gerhard Lindesvärd
b782aafea6 disabled 2024-07-17 22:30:57 +02:00
Carl-Gerhard Lindesvärd
5e225b7ae6 batching events 2024-07-17 17:27:19 +02:00