Carl-Gerhard Lindesvärd
90881e5ffb
wip
2026-03-18 21:16:16 +01:00
Carl-Gerhard Lindesvärd
4483e464d1
fix: optimize event buffer ( #278 )
...
* fix: how we fetch profiles in the buffer
* perf: optimize event buffer
* remove unused file
* fix
* wip
* wip: try groupmq 2
* try simplified event buffer with duration calculation on the fly instead
2026-03-16 13:29:40 +01:00
Carl-Gerhard Lindesvärd
da59622dce
fix: overall perf improvements
...
* fix: ignore private ips
* fix: performance related fixes
* fix: simply event buffer
* fix: default to 1 events queue shard
* add: cleanup scripts
* fix: comments
* fix comments
* fix
* fix: groupmq
* wip
* fix: sync cachable
* remove cluster names and add it behind env flag (if someone want to scale)
* fix
* wip
* better logger
* remove reqid and user agent
* fix lock
* remove wait_for_async_insert
2025-11-15 22:13:59 +01:00
Carl-Gerhard Lindesvärd
af580333b4
fix: bump groupmq, fix stalled sessions in buffers, improve heavy event count
2025-10-06 22:20:14 +02:00
Carl-Gerhard Lindesvärd
0b4fcbad69
feat: use groupmq instead of bullmq for incoming events ( #206 )
...
* wip
* wip working group queue
* wip
* wip
* wip
* fix: groupmq package (tests failed)
* minor fixes
* fix: zero is fine for duration
* add logger
* fix: make buffers more lightweight
* bump groupmq
* new buffers and bump groupmq
* fix: buffers based on comments
* fix: use profileId as groupId if exists
* bump groupmq
* add concurrency env for only events
2025-10-04 21:07:55 +02:00
Carl-Gerhard Lindesvärd
ec8aaf24fb
fix(buffer): move to redis again 😅 but better
2025-02-08 21:38:27 +01:00
Carl-Gerhard Lindesvärd
a2b74a9b4d
test(buffer): testing new buffer (only inserts, no processing)
2025-01-31 00:09:25 +00:00
Carl-Gerhard Lindesvärd
a3f39b95d2
fix(buffer): tmp lower inserts
2025-01-30 22:32:04 +00:00
Carl-Gerhard Lindesvärd
033a6acd43
fix(buffer): chunk inserts
2025-01-29 16:07:43 +00:00
Carl-Gerhard Lindesvärd
d80754a6fd
fix(buffer): max call stack issue with buffer
2024-11-29 10:39:12 +01:00
Carl-Gerhard Lindesvärd
25a7365569
perf(worker): try to improve perf of worker
2024-09-24 09:19:30 +02:00
Carl-Gerhard Lindesvärd
25f329a4cd
chore(buffer): iron out the buffer issues
2024-09-19 21:38:40 +02:00
Carl-Gerhard Lindesvärd
e18ac4d79e
fix(buffer): fixed issues with buffer
2024-09-18 23:46:38 +02:00
Carl-Gerhard Lindesvärd
545cbfd520
feature(worker+api): improve buffer
2024-09-18 23:46:37 +02:00
Carl-Gerhard Lindesvärd
32e91959f6
chore(root): migrate to biome
2024-09-18 23:46:11 +02:00
Carl-Gerhard Lindesvärd
1f6e198336
fix
2024-09-18 23:22:01 +02:00
Carl-Gerhard Lindesvärd
c819c18962
fix(root): add hyperdx and better logging
2024-09-13 22:05:25 +02:00
Carl-Gerhard Lindesvärd
dbc2a32458
fix(buffer): avoid merging properties
2024-09-10 23:30:41 +02:00
Carl-Gerhard Lindesvärd
89c5732efe
fix redis timeout connection on serverless (avoid init redis directly)
2024-07-22 21:49:46 +02:00
Carl-Gerhard Lindesvärd
0fea45c9f7
rename IServiceCreateEventPayload
2024-07-21 23:55:04 +02:00
Carl-Gerhard Lindesvärd
f2298a1b05
init redis lazy
2024-07-20 20:17:32 +02:00
Carl-Gerhard Lindesvärd
3993b493e3
prep events partition
2024-07-19 22:08:22 +02:00
Carl-Gerhard Lindesvärd
ba1bd0e035
wip
2024-07-17 23:50:59 +02:00
Carl-Gerhard Lindesvärd
4893a42b26
wip
2024-07-17 23:43:23 +02:00
Carl-Gerhard Lindesvärd
f0a2cafa74
enable publish on event
2024-07-17 23:28:59 +02:00
Carl-Gerhard Lindesvärd
b782aafea6
disabled
2024-07-17 22:30:57 +02:00
Carl-Gerhard Lindesvärd
5e225b7ae6
batching events
2024-07-17 17:27:19 +02:00
